2023-08-10T10:00:07.997 INFO:root:teuthology version: 0.0.1.dev181+g7fda959 2023-08-10T10:00:07.998 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552 --name rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/orig.config.yaml 2023-08-10T10:00:08.044 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:00:08.122 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552 branch: wip-rishabh-2023Aug1-3 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} email: null first_in_suite: false job_id: '7364552' kernel: client: branch: testing flavor: default kdb: true sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-rishabh-2023Aug1-3 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Aug1-3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Aug1-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wpnKCIikdp0BqxJqI/9xcGy/x9i/pb84v8jm6pptJQjZTRhXYHyv0PqPh22WebOF1YopHoYEz9Bh0rBS6NRc= smithi187.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDg3yWpJ25I1+DYhU8GPbrnjwI2ohh4qrbh9pKYPWEsLIOqEcQO2XhiRIHsU1i7fIgnBGnToa6wL7m0woVaxa10A/B5el4Awi5tBKdk3kaFgQ5qt5dbbqfhe29MyVc119Uy4mrxx4Xc3zo1Cqyy1fSTUsIhI6es9ny/j63ErK5H+khOnsL8nTSB9fJusgz7eM+6mNzOpj772bw6Y8pyxhFyP8OQlerWf2unlfSPecI1u3HQVVvQA//tPNYbwIZwGIqDK62vn+CIgGm3OYged002Gqr4dUwJiUwXeqxVU1SNwx1Ad/r5MtbukP5IMSi/ywXR/hDnvC43xN55p9z6Ui0bV8HoakfM4HzJ/ZUbJeR7lm6/7GT/YxmnXtDYIEf+Lgt1QnqWLEZk5BfGpESTbCZDoefJ2qmfe7PsjK8z8NeZcKwwdPrp3m5oAyS273F3qdNxrGH8kmY1H6SIwS9xyxo3tVDMtCa9Fm26i7TlK4nZZ9j4YuNn4ZUqLyeSnkXZP7s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - workunit: clients: all: - fs/quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 7fda95956ac10132c9b74016ba832db907df09fa timestamp: 2023-08-10_09:50:44 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-10T10:00:08.122 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa; will attempt to use it 2023-08-10T10:00:08.123 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks 2023-08-10T10:00:08.123 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-10T10:00:08.125 INFO:teuthology.task.internal:Checking packages... 2023-08-10T10:00:08.155 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8bf445f2d27d8e12e060dff0fd151d481b5290b' 2023-08-10T10:00:08.155 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-10T10:00:08.155 INFO:teuthology.packaging:ref: None 2023-08-10T10:00:08.156 INFO:teuthology.packaging:tag: None 2023-08-10T10:00:08.156 INFO:teuthology.packaging:branch: wip-rishabh-2023Aug1-3 2023-08-10T10:00:08.156 INFO:teuthology.packaging:sha1: a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:00:08.156 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Aug1-3 2023-08-10T10:00:08.507 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5118.ga8bf445f 2023-08-10T10:00:08.507 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-10T10:00:08.515 INFO:teuthology.task.internal:no buildpackages task found 2023-08-10T10:00:08.515 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-10T10:00:08.520 INFO:teuthology.task.internal:Saving configuration 2023-08-10T10:00:08.537 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-10T10:00:08.543 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:00:08.571 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:02.020187', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wpnKCIikdp0BqxJqI/9xcGy/x9i/pb84v8jm6pptJQjZTRhXYHyv0PqPh22WebOF1YopHoYEz9Bh0rBS6NRc='} 2023-08-10T10:00:08.592 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:02.021526', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJF1NFV/SPVIXEFoggD3Tprr4DgPGfYPsc4GQkMjNjf0RgU4Bn1IXM94yj2E5mO/yDno1o9nNnFKWZD9wwX9CUk='} 2023-08-10T10:00:08.592 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-10T10:00:08.598 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-10T10:00:08.599 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-10T10:00:08.599 INFO:teuthology.run_tasks:Running task console_log... 2023-08-10T10:00:08.664 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0eff0a1f70>, signals=[15]) 2023-08-10T10:00:08.665 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-10T10:00:08.671 INFO:teuthology.task.internal:Opening connections... 2023-08-10T10:00:08.671 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:00:08.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:08.742 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:00:08.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:00:08.808 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-10T10:00:08.815 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-08-10T10:00:08.836 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-08-10T10:00:08.836 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-08-10T10:00:08.896 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2023-08-10T10:00:08.896 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-08-10T10:00:08.897 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T10:00:08.898 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:00:08.898 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:00:08.898 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:00:08.898 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:00:08.899 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-08-10T10:00:08.923 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-08-10T10:00:08.944 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-08-10T10:00:08.944 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8" 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8" 2023-08-10T10:00:09.004 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 8" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-10T10:00:09.005 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-08-10T10:00:09.006 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-08-10T10:00:09.022 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-10T10:00:09.032 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-10T10:00:09.037 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-10T10:00:09.037 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:00:09.040 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-08-10T10:00:09.063 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-10T10:00:09.069 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-10T10:00:09.069 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:00:09.100 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-08-10T10:00:09.131 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-10T10:00:09.182 INFO:teuthology.run_tasks:Running task kernel... 2023-08-10T10:00:09.197 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'} 2023-08-10T10:00:09.198 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-08-10T10:00:09.198 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-08-10T10:00:09.199 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:00:09.199 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-10T10:00:09.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:00:09.219 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-10T10:00:09.222 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:00:09.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2023-08-10T10:00:09.667 DEBUG:teuthology.task.kernel:sha1 for client.1 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:00:09.667 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:00:09.667 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-08-10T10:00:09.688 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-489.el8.x86_64 2023-08-10T10:00:09.688 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:00:09.689 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:00:09.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum upgrade -y linux-firmware 2023-08-10T10:00:09.692 DEBUG:teuthology.task.kernel:sha1 for client.0 is a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:00:09.693 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a7fb1265323db972dd333f71b9a53e9479f62e37"... 2023-08-10T10:00:09.693 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-08-10T10:00:09.715 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-489.el8.x86_64 2023-08-10T10:00:09.715 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-489.el8.x86_64 vs a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:00:09.715 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-08-10T10:00:09.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum upgrade -y linux-firmware 2023-08-10T10:00:15.483 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 9.5 MB/s | 31 MB 00:03 2023-08-10T10:00:20.280 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 3.9 MB/s | 31 MB 00:07 2023-08-10T10:00:22.899 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-08-10T10:00:27.579 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 24 MB/s | 41 MB 00:01 2023-08-10T10:00:29.207 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 54 kB/s | 18 kB 00:00 2023-08-10T10:00:29.674 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 23 kB/s | 6.8 kB 00:00 2023-08-10T10:00:30.059 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 15 kB/s | 3.5 kB 00:00 2023-08-10T10:00:33.946 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 52 kB/s | 18 kB 00:00 2023-08-10T10:00:34.380 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 26 kB/s | 6.8 kB 00:00 2023-08-10T10:00:34.681 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-08-10T10:04:51.914 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 61 kB/s | 16 MB 04:21 2023-08-10T10:04:55.655 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-08-10T10:04:59.107 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-08-10T10:04:59.108 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-08-10T10:04:59.108 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repo Size 2023-08-10T10:04:59.108 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-08-10T10:04:59.108 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 1 Package 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:04:59.109 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 266 M 2023-08-10T10:04:59.110 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-08-10T10:05:00.447 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 60 kB/s | 16 MB 04:25 2023-08-10T10:05:04.197 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 437 kB/s | 24 kB 00:00 2023-08-10T10:05:07.130 INFO:teuthology.orchestra.run.smithi088.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 33 MB/s | 266 MB 00:07 2023-08-10T10:05:07.131 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:05:07.131 INFO:teuthology.orchestra.run.smithi088.stdout:Total 33 MB/s | 266 MB 00:08 2023-08-10T10:05:07.642 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-08-10T10:05:07.643 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-08-10T10:05:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repo Size 2023-08-10T10:05:07.644 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-08-10T10:05:07.644 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-08-10T10:05:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: linux-firmware noarch 20230515-115.gitd1962891.el8 baseos 266 M 2023-08-10T10:05:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:05:07.645 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-08-10T10:05:07.645 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-08-10T10:05:07.645 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 1 Package 2023-08-10T10:05:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:05:07.646 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 266 M 2023-08-10T10:05:07.646 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-08-10T10:05:08.705 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-08-10T10:05:08.770 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-08-10T10:05:08.770 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-08-10T10:05:10.447 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-08-10T10:05:10.465 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-08-10T10:05:17.189 INFO:teuthology.orchestra.run.smithi187.stdout:linux-firmware-20230515-115.gitd1962891.el8.noa 28 MB/s | 266 MB 00:09 2023-08-10T10:05:17.189 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:05:17.189 INFO:teuthology.orchestra.run.smithi187.stdout:Total 28 MB/s | 266 MB 00:09 2023-08-10T10:05:18.762 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-08-10T10:05:18.833 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-08-10T10:05:18.833 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-08-10T10:05:20.488 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-08-10T10:05:20.510 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-08-10T10:05:28.539 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-08-10T10:05:28.886 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-10T10:05:29.134 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:29.357 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:29.358 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-10T10:05:30.038 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:05:30.039 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-08-10T10:05:30.039 INFO:teuthology.orchestra.run.smithi088.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-08-10T10:05:30.040 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:05:30.040 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-08-10T10:05:30.196 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-10T10:05:30.197 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:05:30.342 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-10T10:05:30.342 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-10T10:05:30.348 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi088.front.sepia.ceph.com to complete... 2023-08-10T10:05:38.313 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-08-10T10:05:38.649 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-10T10:05:38.910 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:39.136 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:39.136 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : linux-firmware-20230515-115.gitd1962891.el8.noarch 1/2 2023-08-10T10:05:39.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : linux-firmware-20230217-113.git83f1d778.el8.noarch 2/2 2023-08-10T10:05:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:05:39.785 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-08-10T10:05:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: linux-firmware-20230515-115.gitd1962891.el8.noarch 2023-08-10T10:05:39.785 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:05:39.785 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-08-10T10:05:39.947 INFO:teuthology.task.kernel:Downloading kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-10T10:05:39.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a7fb1265323db972dd333f71b9a53e9479f62e37 2023-08-10T10:05:40.221 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ 2023-08-10T10:05:40.222 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/ --input-file=- 2023-08-10T10:05:40.224 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-08-10T10:05:43.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10 10:05:43 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:05:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:FINISHED --2023-08-10 10:05:43-- 2023-08-10T10:05:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:Total wall clock time: 13s 2023-08-10T10:05:43.381 INFO:teuthology.orchestra.run.smithi088.stderr:Downloaded: 1 files, 363M in 13s (28.5 MB/s) 2023-08-10T10:05:43.382 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.0... 2023-08-10T10:05:43.382 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:05:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:Verifying... ######################################## 2023-08-10T10:05:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:Preparing... ######################################## 2023-08-10T10:05:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:Updating / installing... 2023-08-10T10:06:23.300 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:06:27.987 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10 10:06:27 URL:https://1.chacra.ceph.com/r/kernel/testing/a7fb1265323db972dd333f71b9a53e9479f62e37/centos/8/flavors/default/x86_64/kernel-6.5.0_rc4_ga7fb1265323d-1.x86_64.rpm [380807140/380807140] -> "/tmp/kernel.x86_64.rpm" [1] 2023-08-10T10:06:27.987 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2023-08-10 10:06:27-- 2023-08-10T10:06:27.987 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 48s 2023-08-10T10:06:27.988 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 363M in 47s (7.72 MB/s) 2023-08-10T10:06:27.989 INFO:teuthology.task.kernel:Installing kernel a7fb1265323db972dd333f71b9a53e9479f62e37 on client.1... 2023-08-10T10:06:27.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-08-10T10:06:29.661 INFO:teuthology.orchestra.run.smithi187.stdout:Verifying... ######################################## 2023-08-10T10:06:29.704 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing... ######################################## 2023-08-10T10:06:29.813 INFO:teuthology.orchestra.run.smithi187.stdout:Updating / installing... 2023-08-10T10:06:44.964 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:06:44.964 DEBUG:teuthology.orchestra.run.smithi088:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:45.019 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.019 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.020 INFO:teuthology.orchestra.run.smithi088.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.020 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.020 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:06:45.020 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:06:45.021 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:06:45.022 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:06:45.023 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:06:45.024 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:06:45.025 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:06:45.026 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:06:45.027 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:06:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:06:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:06:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:06:45.028 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:06:45.029 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:06:45.029 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:06:45.029 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:06:45.030 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:06:45.030 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:06:45.031 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:06:45.031 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:06:45.031 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:06:45.031 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:06:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:06:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:06:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:06:45.032 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:06:45.033 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:06:45.033 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:06:45.033 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:06:45.033 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:06:45.034 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:06:45.034 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:06:45.034 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:06:45.034 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:06:45.034 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:06:45.035 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:06:45.035 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:06:45.035 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:06:45.035 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:06:45.036 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:06:45.036 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:06:45.036 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:06:45.036 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:06:45.036 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:06:45.037 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:06:45.037 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:06:45.037 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:06:45.037 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:06:45.038 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:06:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:06:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:06:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:06:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:06:45.039 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:06:45.040 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:06:45.041 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:06:45.042 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:06:45.043 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:06:45.044 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:06:45.045 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:06:45.046 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:06:45.047 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:06:45.048 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:06:45.049 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:06:45.050 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:06:45.051 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:06:45.051 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:06:45.051 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:06:45.051 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:06:45.051 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:06:45.052 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:06:45.052 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:06:45.052 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:06:45.052 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:06:45.052 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:06:45.053 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:06:45.054 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:06:45.055 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:06:45.056 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:06:45.057 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:06:45.058 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:06:45.059 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:06:45.060 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:06:45.061 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:06:45.062 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:06:45.063 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:06:45.064 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:06:45.065 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:06:45.066 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:06:45.067 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:06:45.068 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:06:45.069 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:06:45.070 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:06:45.070 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:06:45.070 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:06:45.070 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:06:45.070 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:06:45.071 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:06:45.072 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:06:45.073 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:06:45.074 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:06:45.075 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:06:45.076 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:06:45.077 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:06:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:06:45.079 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:06:45.080 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:06:45.081 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:06:45.082 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:06:45.083 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:06:45.084 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:06:45.085 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:06:45.086 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:06:45.087 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:06:45.088 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:06:45.089 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:06:45.090 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:06:45.091 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:06:45.092 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:06:45.092 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:06:45.093 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:06:45.094 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:06:45.095 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:06:45.096 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:06:45.097 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:06:45.098 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:06:45.099 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:06:45.100 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:06:45.101 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:06:45.102 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:06:45.103 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:06:45.104 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:06:45.105 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:06:45.106 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:06:45.107 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:06:45.108 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:06:45.109 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:06:45.110 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:06:45.111 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:06:45.112 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:06:45.113 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:06:45.114 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:06:45.115 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:06:45.116 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:06:45.117 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:06:45.118 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:06:45.119 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:06:45.120 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:06:45.121 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:06:45.122 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:06:45.123 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:06:45.124 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:06:45.125 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:06:45.126 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:06:45.127 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:06:45.128 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:06:45.129 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:06:45.130 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:06:45.131 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:06:45.132 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:06:45.133 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:06:45.134 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:06:45.135 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:06:45.136 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:06:45.137 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:06:45.138 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:06:45.139 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:06:45.140 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:06:45.141 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:06:45.142 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:06:45.143 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:06:45.144 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:06:45.145 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:06:45.146 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:06:45.147 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:06:45.148 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:06:45.149 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:06:45.150 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:06:45.151 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:06:45.152 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:06:45.153 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:06:45.154 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:06:45.155 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:06:45.156 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:06:45.157 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:06:45.158 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:06:45.159 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:06:45.160 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:06:45.161 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:06:45.162 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:06:45.163 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:06:45.164 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:06:45.165 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:06:45.166 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:06:45.167 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:06:45.168 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:06:45.169 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:06:45.170 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:06:45.171 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:06:45.172 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:06:45.173 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:06:45.174 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:06:45.175 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:06:45.176 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:06:45.177 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:06:45.178 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:06:45.179 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:06:45.180 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:06:45.181 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:06:45.182 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:06:45.183 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:06:45.184 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:06:45.185 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:06:45.186 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:06:45.187 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:06:45.188 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:06:45.189 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:06:45.190 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:06:45.191 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:06:45.192 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:06:45.193 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:06:45.194 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:06:45.195 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:06:45.196 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:06:45.197 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:06:45.198 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:06:45.198 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:06:45.199 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:06:45.199 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:06:45.199 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:06:45.199 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:06:45.199 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:06:45.200 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:06:45.201 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:06:45.202 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:06:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:06:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:06:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:06:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:06:45.203 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:06:45.204 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:06:45.204 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:06:45.204 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:06:45.204 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:06:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:06:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:06:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:06:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:06:45.205 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:06:45.206 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:06:45.207 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:06:45.208 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:06:45.209 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:06:45.210 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:06:45.210 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:06:45.210 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:06:45.210 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:06:45.210 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:06:45.211 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:06:45.211 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:06:45.211 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:06:45.211 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:06:45.211 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:06:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:06:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:06:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:06:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:06:45.212 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:06:45.213 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:06:45.214 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:06:45.215 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:06:45.216 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:06:45.216 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:06:45.216 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:06:45.216 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:06:45.216 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:06:45.217 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:06:45.218 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:06:45.219 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:06:45.220 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:06:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:06:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:06:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:06:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:06:45.221 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:06:45.222 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:06:45.223 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:06:45.224 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:06:45.225 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:06:45.226 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:06:45.227 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:06:45.227 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:06:45.227 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:06:45.227 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:06:45.228 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:06:45.228 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:06:45.228 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:06:45.229 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:06:45.229 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:06:45.229 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:06:45.229 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:06:45.230 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:06:45.230 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:06:45.230 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:06:45.230 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:06:45.231 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:06:45.231 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:06:45.231 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:06:45.232 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:06:45.232 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:06:45.232 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:06:45.232 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:06:45.233 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:06:45.233 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:06:45.233 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:06:45.233 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:06:45.234 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:06:45.234 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:06:45.234 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:06:45.234 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:06:45.235 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:06:45.235 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:06:45.235 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:06:45.235 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:06:45.236 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:06:45.236 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:06:45.236 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:06:45.236 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:06:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:06:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:06:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:06:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:06:45.237 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:06:45.238 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:06:45.239 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:06:45.240 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:06:45.240 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:06:45.240 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:06:45.240 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:06:45.241 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:06:45.242 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:06:45.243 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:06:45.244 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:06:45.245 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:06:45.246 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:06:45.247 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:06:45.248 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:06:45.249 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:06:45.250 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:06:45.251 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:06:45.252 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:06:45.253 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:06:45.254 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:06:45.255 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:06:45.256 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:06:45.257 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:06:45.258 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:06:45.259 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:06:45.260 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:06:45.261 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:06:45.262 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:06:45.263 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:06:45.264 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:06:45.265 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:06:45.266 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:06:45.267 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:06:45.268 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:06:45.269 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:06:45.270 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:06:45.271 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:06:45.272 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:06:45.273 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:06:45.274 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:06:45.275 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:06:45.276 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:06:45.277 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:06:45.278 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:06:45.279 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:06:45.280 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:06:45.281 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:06:45.282 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:06:45.283 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:06:45.284 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:06:45.285 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:06:45.286 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:06:45.287 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:06:45.288 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:06:45.289 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:06:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:06:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:06:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:06:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:06:45.290 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:06:45.291 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:06:45.292 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:06:45.293 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:06:45.294 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:06:45.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:06:45.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:06:45.295 INFO:teuthology.orchestra.run.smithi088.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:06:45.296 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.296 DEBUG:teuthology.orchestra.run.smithi088:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:06:45.321 INFO:teuthology.orchestra.run.smithi088.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:06:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:06:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.322 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.323 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-08-10T10:06:45.324 INFO:teuthology.orchestra.run.smithi088.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:06:45.324 INFO:teuthology.orchestra.run.smithi088.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:06:45.324 INFO:teuthology.orchestra.run.smithi088.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.324 INFO:teuthology.orchestra.run.smithi088.stdout:fi 2023-08-10T10:06:45.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-08-10T10:06:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-08-10T10:06:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-08-10T10:06:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-08-10T10:06:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 129.el8 2023-08-10T10:06:45.401 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9265586 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-10T10:06:45.402 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : CentOS BuildSystem 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-08-10T10:06:45.403 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:06:45.404 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:06:45.405 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:06:45.405 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:45.406 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:06:50.994 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-08-10T10:06:53.178 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-08-10T10:06:53.180 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-08-10T10:06:53.230 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.o6At6t2Aa4 2023-08-10T10:06:53.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.o6At6t2Aa4 2023-08-10T10:06:53.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.o6At6t2Aa4 2023-08-10T10:06:53.388 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.o6At6t2Aa4 is 6KB 2023-08-10T10:06:53.412 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.o6At6t2Aa4 2023-08-10T10:06:53.430 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:06:53.515 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-10T10:06:53.515 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-10T10:06:53.516 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-10T10:06:53.516 INFO:teuthology.orchestra.run.smithi088.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:06:53.517 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:06:53.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-08-10T10:07:07.711 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-6.5.0_rc4_ga7fb1265323d-1 ######################################## 2023-08-10T10:07:23.645 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-08-10T10:07:23.645 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:07:23.646 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:07:30.871 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-08-10T10:07:30.872 DEBUG:teuthology.orchestra.run.smithi187:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-08-10T10:07:30.936 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:30.937 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/config-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:30.937 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/vmlinuz-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:30.938 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:30.938 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel 2023-08-10T10:07:30.938 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch 2023-08-10T10:07:30.939 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86 2023-08-10T10:07:30.939 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto 2023-08-10T10:07:30.939 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-08-10T10:07:30.939 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-08-10T10:07:30.939 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-08-10T10:07:30.940 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-08-10T10:07:30.940 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-08-10T10:07:30.940 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-08-10T10:07:30.940 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-08-10T10:07:30.940 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-08-10T10:07:30.941 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-08-10T10:07:30.942 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-amd.ko 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm-intel.ko 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/arch/x86/kvm/kvm.ko 2023-08-10T10:07:30.943 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ansi_cprng.ko 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/anubis.ko 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/arc4.ko 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_memcpy.ko 2023-08-10T10:07:30.944 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_pq.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_tx.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/async_xor.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/async_tx/raid6test.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authenc.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/authencesn.ko 2023-08-10T10:07:30.945 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blake2b_generic.ko 2023-08-10T10:07:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_common.ko 2023-08-10T10:07:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/blowfish_generic.ko 2023-08-10T10:07:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/camellia_generic.ko 2023-08-10T10:07:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast5_generic.ko 2023-08-10T10:07:30.946 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast6_generic.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cast_common.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/ccm.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cmac.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crc32_generic.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_engine.ko 2023-08-10T10:07:30.947 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/crypto_user.ko 2023-08-10T10:07:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/cts.ko 2023-08-10T10:07:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/des_generic.ko 2023-08-10T10:07:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/dh_generic.ko 2023-08-10T10:07:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/echainiv.ko 2023-08-10T10:07:30.948 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/essiv.ko 2023-08-10T10:07:30.949 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/fcrypt.ko 2023-08-10T10:07:30.949 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/khazad.ko 2023-08-10T10:07:30.949 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4.ko 2023-08-10T10:07:30.949 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/lz4hc.ko 2023-08-10T10:07:30.949 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/md4.ko 2023-08-10T10:07:30.950 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/michael_mic.ko 2023-08-10T10:07:30.950 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcbc.ko 2023-08-10T10:07:30.950 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/pcrypt.ko 2023-08-10T10:07:30.950 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/rmd160.ko 2023-08-10T10:07:30.950 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/seed.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/serpent_generic.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tcrypt.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/tea.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_common.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/twofish_generic.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/vmac.ko 2023-08-10T10:07:30.951 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/wp512.ko 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xcbc.ko 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xor.ko 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/crypto/xxhash_generic.ko 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_ipmi.ko 2023-08-10T10:07:30.952 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/acpi_pad.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/custom_method.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/ec_sys.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/platform_profile.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbs.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/sbshc.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/acpi/video.ko 2023-08-10T10:07:30.953 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/acard-ahci.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ahci_platform.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/ata_generic.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/libahci_platform.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_acpi.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ali.ko 2023-08-10T10:07:30.954 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_amd.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_artop.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atiixp.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_atp867x.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd640.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cmd64x.ko 2023-08-10T10:07:30.955 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_cypress.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_efar.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt366.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt37x.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_hpt3x3.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it8213.ko 2023-08-10T10:07:30.956 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_it821x.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_jmicron.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_marvell.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_mpiix.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_netcell.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ninja32.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87410.ko 2023-08-10T10:07:30.957 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_ns87415.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_oldpiix.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_opti.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_optidma.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pcmcia.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc2027x.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-08-10T10:07:30.958 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_piccolo.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_rdc.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sch.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_serverworks.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sil680.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sis.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_sl82c105.ko 2023-08-10T10:07:30.959 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_triflex.ko 2023-08-10T10:07:30.960 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pata_via.ko 2023-08-10T10:07:30.960 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/pdc_adma.ko 2023-08-10T10:07:30.960 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_inic162x.ko 2023-08-10T10:07:30.960 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_mv.ko 2023-08-10T10:07:30.960 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_nv.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_promise.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_qstor.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sil24.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sis.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_svw.ko 2023-08-10T10:07:30.961 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_sx4.ko 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_uli.ko 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_via.ko 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ata/sata_vsc.ko 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/auxdisplay/ks0108.ko 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base 2023-08-10T10:07:30.962 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/bcma/bcma.ko 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/aoe/aoe.ko 2023-08-10T10:07:30.963 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/brd.ko 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/drbd/drbd.ko 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/floppy.ko 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/loop.ko 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx 2023-08-10T10:07:30.964 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/nbd.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/null_blk/null_blk.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/pktcdvd.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/rbd.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/virtio_blk.ko 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback 2023-08-10T10:07:30.965 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-08-10T10:07:30.966 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/xen-blkfront.ko 2023-08-10T10:07:30.966 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram 2023-08-10T10:07:30.966 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/block/zram/zram.ko 2023-08-10T10:07:30.966 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char 2023-08-10T10:07:30.966 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hangcheck-timer.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/amd-rng.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/intel-rng.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/via-rng.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-08-10T10:07:30.967 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-08-10T10:07:30.968 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/lp.ko 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/mwave/mwave.ko 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/ppdev.ko 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tlclk.ko 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm 2023-08-10T10:07:30.969 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/uv_mmtimer.ko 2023-08-10T10:07:30.970 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/char/virtio_console.ko 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-08-10T10:07:30.971 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/powernow-k8.ko 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/ccp/ccp.ko 2023-08-10T10:07:30.972 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-08-10T10:07:30.973 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-aes.ko 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/padlock-sha.ko 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dca/dca.ko 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-08-10T10:07:30.974 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma 2023-08-10T10:07:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw 2023-08-10T10:07:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/dw/dw_dmac.ko 2023-08-10T10:07:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat 2023-08-10T10:07:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/dma/ioat/ioatdma.ko 2023-08-10T10:07:30.975 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/amd64_edac.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/e752x_edac.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/edac_mce_amd.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3000_edac.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i3200_edac.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5100_edac.ko 2023-08-10T10:07:30.976 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i5400_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7300_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i7core_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/i82975x_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/ie31200_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/sb_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/edac/x38_edac.ko 2023-08-10T10:07:30.977 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/edd.ko 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/firmware/iscsi_ibft.ko 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-ich.ko 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/gpio/gpio-viperboard.ko 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid 2023-08-10T10:07:30.978 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-appleir.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-aureal.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-axff.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-dr.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elecom.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-elo.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-emsff.ko 2023-08-10T10:07:30.979 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gaff.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gt683r.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-gyration.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-holtekff.ko 2023-08-10T10:07:30.980 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-hyperv.ko 2023-08-10T10:07:30.981 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-icade.ko 2023-08-10T10:07:30.981 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-keytouch.ko 2023-08-10T10:07:30.981 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-kye.ko 2023-08-10T10:07:30.981 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lcpower.ko 2023-08-10T10:07:30.981 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-led.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-lenovo.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-dj.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-multitouch.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-ortek.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-penmount.ko 2023-08-10T10:07:30.982 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-petalynx.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-picolcd.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-pl.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-plantronics.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-primax.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-rmi.ko 2023-08-10T10:07:30.983 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-08-10T10:07:30.984 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-common.ko 2023-08-10T10:07:30.984 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-isku.ko 2023-08-10T10:07:30.984 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kone.ko 2023-08-10T10:07:30.985 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-08-10T10:07:30.985 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-08-10T10:07:30.985 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-08-10T10:07:30.985 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-lua.ko 2023-08-10T10:07:30.986 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-08-10T10:07:30.986 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-08-10T10:07:30.986 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat-savu.ko 2023-08-10T10:07:30.986 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-roccat.ko 2023-08-10T10:07:30.987 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-saitek.ko 2023-08-10T10:07:30.987 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-samsung.ko 2023-08-10T10:07:30.987 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sensor-hub.ko 2023-08-10T10:07:30.988 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sjoy.ko 2023-08-10T10:07:30.988 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sony.ko 2023-08-10T10:07:30.988 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-speedlink.ko 2023-08-10T10:07:30.988 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-steelseries.ko 2023-08-10T10:07:30.989 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-sunplus.ko 2023-08-10T10:07:30.989 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-thrustmaster.ko 2023-08-10T10:07:30.989 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tivo.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-tmff.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-topseed.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-twinhan.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-uclogic.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-waltop.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-wiimote.ko 2023-08-10T10:07:30.990 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-xinmo.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zpff.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/hid-zydacron.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/uhid.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hid/wacom.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_balloon.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_utils.ko 2023-08-10T10:07:30.991 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hv/hv_vmbus.ko 2023-08-10T10:07:30.992 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon 2023-08-10T10:07:30.992 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru.ko 2023-08-10T10:07:30.992 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/abituguru3.ko 2023-08-10T10:07:30.992 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7414.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ad7418.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adc128d818.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1025.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1026.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1029.ko 2023-08-10T10:07:30.993 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm1031.ko 2023-08-10T10:07:30.994 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adm9240.ko 2023-08-10T10:07:30.994 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ads7828.ko 2023-08-10T10:07:30.994 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7410.ko 2023-08-10T10:07:30.994 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7411.ko 2023-08-10T10:07:30.994 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7462.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7470.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7475.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/adt7x10.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/amc6821.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/applesmc.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asb100.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asc7621.ko 2023-08-10T10:07:30.995 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/asus_atk0110.ko 2023-08-10T10:07:30.996 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/atxp1.ko 2023-08-10T10:07:30.996 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/coretemp.ko 2023-08-10T10:07:30.996 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-08-10T10:07:30.996 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/dme1737.ko 2023-08-10T10:07:30.996 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds1621.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ds620.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc1403.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/emc6w201.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71805f.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f71882fg.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/f75375s.ko 2023-08-10T10:07:30.997 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fam15h_power.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/fschmd.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g760a.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/g762.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl518sm.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/gl520sm.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/hwmon-vid.ko 2023-08-10T10:07:30.998 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5500_temp.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/i5k_amb.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmaem.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ibmpex.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina209.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ina2xx.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/it87.ko 2023-08-10T10:07:30.999 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k10temp.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/k8temp.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lineage-pem.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm63.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm73.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm75.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm77.ko 2023-08-10T10:07:31.000 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm78.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm80.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm83.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm85.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm87.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm90.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm92.ko 2023-08-10T10:07:31.001 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm93.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95234.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95241.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/lm95245.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc2945.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4151.ko 2023-08-10T10:07:31.002 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4215.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4222.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4245.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4260.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/ltc4261.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max16065.ko 2023-08-10T10:07:31.003 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1619.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max1668.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max197.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6639.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6650.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/max6697.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/mcp3021.ko 2023-08-10T10:07:31.004 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6683.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775-core.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct6775.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/nct7802.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87360.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pc87427.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pcf8591.ko 2023-08-10T10:07:31.005 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-08-10T10:07:31.006 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/powr1220.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5627.ko 2023-08-10T10:07:31.007 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch5636.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sch56xx-common.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht15.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sht21.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/shtc1.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/sis5595.ko 2023-08-10T10:07:31.008 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47b397.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m1.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/smsc47m192.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/thmc50.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp102.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp103.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp401.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/tmp421.ko 2023-08-10T10:07:31.009 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via-cputemp.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/via686a.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt1211.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/vt8231.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627ehf.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83627hf.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83781d.ko 2023-08-10T10:07:31.010 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83791d.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83792d.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83793.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83795.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l785ts.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/hwmon/w83l786ng.ko 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c 2023-08-10T10:07:31.011 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-08-10T10:07:31.012 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-08-10T10:07:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-08-10T10:07:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-08-10T10:07:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-08-10T10:07:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-08-10T10:07:31.013 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-08-10T10:07:31.014 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-via.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-08-10T10:07:31.015 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-dev.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-mux.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-smbus.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/i2c/i2c-stub.ko 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband 2023-08-10T10:07:31.016 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_cm.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_core.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_umad.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/iw_cm.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-08-10T10:07:31.017 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5 2023-08-10T10:07:31.018 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser 2023-08-10T10:07:31.019 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-08-10T10:07:31.020 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input 2023-08-10T10:07:31.021 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport 2023-08-10T10:07:31.021 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-08-10T10:07:31.021 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/fm801-gp.ko 2023-08-10T10:07:31.021 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/gameport.ko 2023-08-10T10:07:31.021 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/lightning.ko 2023-08-10T10:07:31.022 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/gameport/ns558.ko 2023-08-10T10:07:31.022 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/joydev.ko 2023-08-10T10:07:31.022 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard 2023-08-10T10:07:31.023 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-08-10T10:07:31.023 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse 2023-08-10T10:07:31.023 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/appletouch.ko 2023-08-10T10:07:31.023 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/bcm5974.ko 2023-08-10T10:07:31.024 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/cyapatp.ko 2023-08-10T10:07:31.024 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/elan_i2c.ko 2023-08-10T10:07:31.024 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/sermouse.ko 2023-08-10T10:07:31.025 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-08-10T10:07:31.025 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-08-10T10:07:31.025 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-08-10T10:07:31.026 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4 2023-08-10T10:07:31.026 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/rmi4/rmi_core.ko 2023-08-10T10:07:31.026 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio 2023-08-10T10:07:31.026 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/altera_ps2.ko 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/arc_ps2.ko 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/serio/serio_raw.ko 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/input/sparse-keymap.ko 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd 2023-08-10T10:07:31.027 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-blinkm.ko 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lm3530.ko 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-lp3944.ko 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/leds-ss4200.ko 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger 2023-08-10T10:07:31.028 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-08-10T10:07:31.029 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/bcache/bcache.ko 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-bio-prison.ko 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache-smq.ko 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-cache.ko 2023-08-10T10:07:31.030 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-crypt.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-delay.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-flakey.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-log-userspace.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-multipath.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-queue-length.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-raid.ko 2023-08-10T10:07:31.031 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-round-robin.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-service-time.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-switch.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-thin-pool.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/dm-verity.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/faulty.ko 2023-08-10T10:07:31.032 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/linear.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/multipath.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid0.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid1.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid10.ko 2023-08-10T10:07:31.033 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/md/raid456.ko 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptbase.ko 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptctl.ko 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptfc.ko 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptlan.ko 2023-08-10T10:07:31.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptsas.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptscsih.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/message/fusion/mptspi.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_ich.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/lpc_sch.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/mfd-core.ko 2023-08-10T10:07:31.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/sm501.ko 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/viperboard.ko 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/vx855.ko 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/mfd/wl1273-core.ko 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-08-10T10:07:31.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds9802als.ko 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/apds990x.ko 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/bh1770glc.ko 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/cb710/cb710.ko 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/at24.ko 2023-08-10T10:07:31.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/eeprom/max6875.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/enclosure.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/hpilo.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29003.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/isl29020.ko 2023-08-10T10:07:31.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d 2023-08-10T10:07:31.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-08-10T10:07:31.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-08-10T10:07:31.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei 2023-08-10T10:07:31.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-me.ko 2023-08-10T10:07:31.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei-txe.ko 2023-08-10T10:07:31.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/mei/mei.ko 2023-08-10T10:07:31.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru 2023-08-10T10:07:31.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-gru/gru.ko 2023-08-10T10:07:31.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp 2023-08-10T10:07:31.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xp.ko 2023-08-10T10:07:31.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-08-10T10:07:31.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-08-10T10:07:31.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_7xx1.ko 2023-08-10T10:07:31.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tifm_core.ko 2023-08-10T10:07:31.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/tsl2550.ko 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_balloon.ko 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/bonding/bonding.ko 2023-08-10T10:07:31.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6060.ko 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-08-10T10:07:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/dummy.ko 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/eql.ko 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-08-10T10:07:31.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-08-10T10:07:31.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-08-10T10:07:31.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390 2023-08-10T10:07:31.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/8390.ko 2023-08-10T10:07:31.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-08-10T10:07:31.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-08-10T10:07:31.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-08-10T10:07:31.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-08-10T10:07:31.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-08-10T10:07:31.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-08-10T10:07:31.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-08-10T10:07:31.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-08-10T10:07:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-08-10T10:07:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-08-10T10:07:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-08-10T10:07:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-08-10T10:07:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-08-10T10:07:31.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-08-10T10:07:31.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-08-10T10:07:31.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco 2023-08-10T10:07:31.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic 2023-08-10T10:07:31.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-08-10T10:07:31.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/dnet.ko 2023-08-10T10:07:31.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ethoc.ko 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/fealnx.ko 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel 2023-08-10T10:07:31.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e100.ko 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-08-10T10:07:31.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf 2023-08-10T10:07:31.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/jme.ko 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-08-10T10:07:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-08-10T10:07:31.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-08-10T10:07:31.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-08-10T10:07:31.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-08-10T10:07:31.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-08-10T10:07:31.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-08-10T10:07:31.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan 2023-08-10T10:07:31.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-08-10T10:07:31.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis 2023-08-10T10:07:31.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-08-10T10:07:31.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-08-10T10:07:31.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-08-10T10:07:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/niu.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-08-10T10:07:31.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-08-10T10:07:31.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet 2023-08-10T10:07:31.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-08-10T10:07:31.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-08-10T10:07:31.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom 2023-08-10T10:07:31.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-08-10T10:07:31.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/geneve.ko 2023-08-10T10:07:31.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv 2023-08-10T10:07:31.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-08-10T10:07:31.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154 2023-08-10T10:07:31.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ieee802154/fakelb.ko 2023-08-10T10:07:31.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ifb.ko 2023-08-10T10:07:31.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan 2023-08-10T10:07:31.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-08-10T10:07:31.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvlan.ko 2023-08-10T10:07:31.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/macvtap.ko 2023-08-10T10:07:31.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio 2023-08-10T10:07:31.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio.ko 2023-08-10T10:07:31.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-08-10T10:07:31.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-08-10T10:07:31.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-08-10T10:07:31.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/mii.ko 2023-08-10T10:07:31.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/net_failover.ko 2023-08-10T10:07:31.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/netconsole.ko 2023-08-10T10:07:31.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/nlmon.ko 2023-08-10T10:07:31.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs 2023-08-10T10:07:31.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-08-10T10:07:31.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-08-10T10:07:31.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy 2023-08-10T10:07:31.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/amd.ko 2023-08-10T10:07:31.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-08-10T10:07:31.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-08-10T10:07:31.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm7xxx.ko 2023-08-10T10:07:31.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/bcm87xx.ko 2023-08-10T10:07:31.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/broadcom.ko 2023-08-10T10:07:31.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/cicada.ko 2023-08-10T10:07:31.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/davicom.ko 2023-08-10T10:07:31.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/dp83640.ko 2023-08-10T10:07:31.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/et1011c.ko 2023-08-10T10:07:31.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/icplus.ko 2023-08-10T10:07:31.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/lxt.ko 2023-08-10T10:07:31.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/marvell.ko 2023-08-10T10:07:31.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/micrel.ko 2023-08-10T10:07:31.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/national.ko 2023-08-10T10:07:31.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/phylink.ko 2023-08-10T10:07:31.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/qsemi.ko 2023-08-10T10:07:31.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/realtek.ko 2023-08-10T10:07:31.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/smsc.ko 2023-08-10T10:07:31.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/ste10Xp.ko 2023-08-10T10:07:31.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/phy/vitesse.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/bsd_comp.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_async.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_generic.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-08-10T10:07:31.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppoe.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pppox.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/ppp/pptp.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slhc.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/slip/slip.ko 2023-08-10T10:07:31.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/sungem_phy.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tap.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-08-10T10:07:31.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_random.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/tun.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/veth.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/virtio_net.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-08-10T10:07:31.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/vxlan/vxlan.ko 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/net/xen-netfront.ko 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ntb/ntb.ko 2023-08-10T10:07:31.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme-core.ko 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/nvme/host/nvme.ko 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport.ko 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_cs.ko 2023-08-10T10:07:31.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_pc.ko 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/parport/parport_serial.ko 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/pcie/aer_inject.ko 2023-08-10T10:07:31.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pci/xen-pcifront.ko 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/i82092.ko 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/pd6729.ko 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pcmcia/yenta_socket.ko 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel 2023-08-10T10:07:31.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acer-wmi.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/acerhdf.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/apple-gmux.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-laptop.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-08-10T10:07:31.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/asus-wmi.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-08-10T10:07:31.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/hdaps.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/intel_ips.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/msi-wmi.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-08-10T10:07:31.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/samsung-q10.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/platform/x86/wmi.ko 2023-08-10T10:07:31.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_common.ko 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-gpio.ko 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-08-10T10:07:31.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/clients/pps_parport.ko 2023-08-10T10:07:31.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/pps/pps_core.ko 2023-08-10T10:07:31.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp 2023-08-10T10:07:31.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp.ko 2023-08-10T10:07:31.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ptp/ptp_kvm.ko 2023-08-10T10:07:31.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq32k.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-bq4802.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1286.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1307.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1374.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1511.ko 2023-08-10T10:07:31.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1553.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1672.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds1742.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds2404.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-ds3232.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-em3027.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-fm3130.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl12022.ko 2023-08-10T10:07:31.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-isl1208.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m41t80.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t35.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-m48t59.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-max6900.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-msm6242.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-08-10T10:07:31.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-08-10T10:07:31.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-08-10T10:07:31.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-08-10T10:07:31.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-08-10T10:07:31.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8025.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-rx8581.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-08-10T10:07:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/rtc/rtc-x1205.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-9xxx.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-sas.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/3w-xxxx.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/BusLogic.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/a100u2w.ko 2023-08-10T10:07:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/advansys.ko 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-08-10T10:07:31.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/am53c974.ko 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/atp870u.ko 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa 2023-08-10T10:07:31.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bfa/bfa.ko 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ch.ko 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor 2023-08-10T10:07:31.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-08-10T10:07:31.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dc395x.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/dmx3191d.ko 2023-08-10T10:07:31.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/esp_scsi.ko 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic 2023-08-10T10:07:31.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/fnic/fnic.ko 2023-08-10T10:07:31.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hpsa.ko 2023-08-10T10:07:31.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hptiop.ko 2023-08-10T10:07:31.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/hv_storvsc.ko 2023-08-10T10:07:31.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/initio.ko 2023-08-10T10:07:31.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ipr.ko 2023-08-10T10:07:31.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ips.ko 2023-08-10T10:07:31.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci 2023-08-10T10:07:31.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/isci/isci.ko 2023-08-10T10:07:31.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-08-10T10:07:31.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/iscsi_tcp.ko 2023-08-10T10:07:31.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc 2023-08-10T10:07:31.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libfc/libfc.ko 2023-08-10T10:07:31.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi.ko 2023-08-10T10:07:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-08-10T10:07:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas 2023-08-10T10:07:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/libsas/libsas.ko 2023-08-10T10:07:31.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc 2023-08-10T10:07:31.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-08-10T10:07:31.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid 2023-08-10T10:07:31.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid.ko 2023-08-10T10:07:31.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-08-10T10:07:31.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-08-10T10:07:31.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-08-10T10:07:31.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas 2023-08-10T10:07:31.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-08-10T10:07:31.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas 2023-08-10T10:07:31.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-08-10T10:07:31.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/mvumi.ko 2023-08-10T10:07:31.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001 2023-08-10T10:07:31.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-08-10T10:07:31.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/pmcraid.ko 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla1280.ko 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx 2023-08-10T10:07:31.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/raid_class.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_debug.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-08-10T10:07:31.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/ses.ko 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/st.ko 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/stex.ko 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/virtio_scsi.ko 2023-08-10T10:07:31.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/scsi/wd719x.ko 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ssb/ssb.ko 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-08-10T10:07:31.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/loopback/tcm_loop.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_file.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_iblock.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_mod.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_pscsi.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/target_core_user.ko 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc 2023-08-10T10:07:31.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-08-10T10:07:31.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-08-10T10:07:31.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless 2023-08-10T10:07:31.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_gsm.ko 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/n_hdlc.ko 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/nozomi.ko 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-08-10T10:07:31.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/arc_uart.ko 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/tty/synclink_gt.ko 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-08-10T10:07:31.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_aec.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_cif.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_pci_generic.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/uio/uio_sercos3.ko 2023-08-10T10:07:31.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-acm.ko 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/cdc-wdm.ko 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usblp.ko 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/class/usbtmc.ko 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host 2023-08-10T10:07:31.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/host/sl811-hcd.ko 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/mdc800.ko 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/image/microtek.ko 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/adutux.ko 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/appledisplay.ko 2023-08-10T10:07:31.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi26.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/emi62.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ezusb.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/idmouse.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/iowarrior.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/isight_firmware.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/ldusb.ko 2023-08-10T10:07:31.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/legousbtower.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/trancevibrator.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usb3503.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usblcd.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/usbsevseg.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/uss720.ko 2023-08-10T10:07:31.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/misc/yurex.ko 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/phy/phy-generic.ko 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/aircable.ko 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ark3116.ko 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/belkin_sa.ko 2023-08-10T10:07:31.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ch341.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cp210x.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cyberjack.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/cypress_m8.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/empeg.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-08-10T10:07:31.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/garmin_gps.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_edgeport.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/io_ti.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipaq.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ipw.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ir-usb.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-08-10T10:07:31.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/kobil_sct.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mct_u232.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7720.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/mos7840.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/navman.ko 2023-08-10T10:07:31.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/omninet.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/opticon.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/option.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/oti6858.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/pl2303.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcaux.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/qcserial.ko 2023-08-10T10:07:31.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/quatech2.ko 2023-08-10T10:07:31.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/safe_serial.ko 2023-08-10T10:07:31.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/sierra.ko 2023-08-10T10:07:31.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/spcp8x5.ko 2023-08-10T10:07:31.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ssu100.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/symbolserial.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_debug.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/usb_wwan.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/visor.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/whiteheat.ko 2023-08-10T10:07:31.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/serial/xsens_mt.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/uas.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-alauda.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-cypress.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-datafab.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-08-10T10:07:31.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-freecom.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-isd200.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-karma.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-realtek.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-08-10T10:07:31.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/ums-usbat.ko 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/storage/usb-storage.ko 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-core.ko 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/usbip-host.ko 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci 2023-08-10T10:07:31.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_iotlb.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_net.ko 2023-08-10T10:07:31.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/vhost/vhost_scsi.ko 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/apple_bl.ko 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/lcd.ko 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/video/backlight/platform_lcd.ko 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio 2023-08-10T10:07:31.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_balloon.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_mmio.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/virtio/virtio_ring.ko 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1 2023-08-10T10:07:31.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2482.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/masters/ds2490.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-08-10T10:07:31.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_smem.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/slaves/w1_therm.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/w1/wire.ko 2023-08-10T10:07:31.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/hpwdt.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/i6300esb.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-08-10T10:07:31.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ib700wdt.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ibmasr.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/it87_wdt.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/machzwd.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/nv_tco.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_pci.ko 2023-08-10T10:07:31.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/pcwd_usb.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/softdog.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/sp5100_tco.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/via_wdt.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-08-10T10:07:31.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/wdt_pci.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/watchdog/xen_wdt.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-acpi-processor.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-evtchn.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntalloc.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-gntdev.ko 2023-08-10T10:07:31.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xen-privcmd.ko 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/drivers/xen/xenfs/xenfs.ko 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/9p/9p.ko 2023-08-10T10:07:31.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/affs/affs.ko 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/befs/befs.ko 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/binfmt_misc.ko 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/btrfs/btrfs.ko 2023-08-10T10:07:31.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cachefiles/cachefiles.ko 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ceph/ceph.ko 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/coda/coda.ko 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/cramfs/cramfs.ko 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm 2023-08-10T10:07:31.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/dlm/dlm.ko 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ecryptfs/ecryptfs.ko 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/f2fs/f2fs.ko 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/fat.ko 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/msdos.ko 2023-08-10T10:07:31.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fat/vfat.ko 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fscache/fscache.ko 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/cuse.ko 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/fuse/fuse.ko 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2 2023-08-10T10:07:31.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/gfs2/gfs2.ko 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfs/hfs.ko 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/hfsplus/hfsplus.ko 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/isofs/isofs.ko 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs 2023-08-10T10:07:31.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/jfs/jfs.ko 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/lockd/lockd.ko 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/minix/minix.ko 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/netfs/netfs.ko 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs 2023-08-10T10:07:31.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfs.ko 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv3.ko 2023-08-10T10:07:31.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs/nfsv4.ko 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/grace.ko 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfs_common/nfs_acl.ko 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nfsd/nfsd.ko 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2 2023-08-10T10:07:31.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nilfs2/nilfs2.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-celtic.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-centeuro.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-croatian.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-cyrillic.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-gaelic.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-greek.ko 2023-08-10T10:07:31.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-iceland.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-inuit.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-roman.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-romanian.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/mac-turkish.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1250.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1251.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp1255.ko 2023-08-10T10:07:31.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp737.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp775.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp850.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp852.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp855.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp857.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp860.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp861.ko 2023-08-10T10:07:31.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp862.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp863.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp864.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp865.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp866.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp869.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp874.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp932.ko 2023-08-10T10:07:31.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp936.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp949.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_cp950.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_euc-jp.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-1.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-13.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-14.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-15.ko 2023-08-10T10:07:31.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-2.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-3.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-4.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-5.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-6.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-7.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_iso8859-9.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-r.ko 2023-08-10T10:07:31.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-ru.ko 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_koi8-u.ko 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/nls/nls_utf8.ko 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm 2023-08-10T10:07:31.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs 2023-08-10T10:07:31.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/overlayfs/overlay.ko 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/pstore/ramoops.ko 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/reiserfs/reiserfs.ko 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/romfs/romfs.ko 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb 2023-08-10T10:07:31.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/client/cifs.ko 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_arc4.ko 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/smb/common/cifs_md4.ko 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/squashfs/squashfs.ko 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv 2023-08-10T10:07:31.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/sysv/sysv.ko 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/udf/udf.ko 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/ufs/ufs.ko 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/fs/xfs/xfs.ko 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel 2023-08-10T10:07:31.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/rcu/rcutorture.ko 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/torture.ko 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/asn1_encoder.ko 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc-itu-t.ko 2023-08-10T10:07:31.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crc8.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libarc4.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/crypto/libdes.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/libcrc32c.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lru_cache.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4_compress.ko 2023-08-10T10:07:31.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/lz4/lz4hc_compress.ko 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/math/cordic.ko 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/raid6/raid6_pq.ko 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/reed_solomon/reed_solomon.ko 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_bm.ko 2023-08-10T10:07:31.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_fsm.ko 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/ts_kmp.ko 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/lib/zstd/zstd_compress.ko 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/mm/hwpoison-inject.ko 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan 2023-08-10T10:07:31.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/6lowpan.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_dest.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_fragment.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_hop.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_ipv6.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_mobility.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_routing.ko 2023-08-10T10:07:31.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/6lowpan/nhc_udp.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/garp.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/mrp.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/p8022.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/psnap.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/802/stp.ko 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q 2023-08-10T10:07:31.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/8021q/8021q.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_fd.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_rdma.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/9p/9pnet_virtio.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/batman-adv/batman-adv.ko 2023-08-10T10:07:31.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/br_netfilter.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/bridge.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_among.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-08-10T10:07:31.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_log.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-08-10T10:07:31.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-08-10T10:07:31.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/ebtables.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ceph/libceph.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/failover.ko 2023-08-10T10:07:31.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/core/pktgen.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_diag.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv4.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dccp/dccp_ipv6.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dns_resolver/dns_resolver.ko 2023-08-10T10:07:31.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/dsa_core.ko 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_brcm.ko 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_dsa.ko 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_none.ko 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/dsa/tag_trailer.ko 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154 2023-08-10T10:07:31.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ieee802154/ieee802154_socket.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ah4.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/esp4.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/fou.ko 2023-08-10T10:07:31.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/gre.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/inet_diag.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_gre.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_tunnel.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ip_vti.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipcomp.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/ipip.ko 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter 2023-08-10T10:07:31.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-08-10T10:07:31.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-08-10T10:07:31.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_bic.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_dctcp.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_diag.ko 2023-08-10T10:07:31.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_highspeed.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_htcp.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_hybla.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_illinois.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_lp.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_scalable.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_vegas.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_veno.ko 2023-08-10T10:07:31.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_westwood.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tcp_yeah.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/tunnel4.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_diag.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/udp_tunnel.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ah6.ko 2023-08-10T10:07:31.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/esp6.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/fou6.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_tunnel.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ip6_vti.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/ipcomp6.ko 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter 2023-08-10T10:07:31.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-08-10T10:07:31.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-08-10T10:07:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-08-10T10:07:31.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/sit.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/tunnel6.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/key/af_key.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_core.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_debugfs.ko 2023-08-10T10:07:31.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_eth.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ip6.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_netlink.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/l2tp/l2tp_ppp.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/llc/llc.ko 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154 2023-08-10T10:07:31.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mac802154/mac802154.ko 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/mpls/mpls_gso.ko 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set.ko 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-08-10T10:07:31.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-08-10T10:07:31.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-08-10T10:07:31.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-08-10T10:07:31.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conncount.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-08-10T10:07:31.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-08-10T10:07:31.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_dup_netdev.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_log_syslog.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat.ko 2023-08-10T10:07:31.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_amanda.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_ftp.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_irc.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_sip.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_nat_tftp.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_synproxy_core.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nf_tables.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink.ko 2023-08-10T10:07:31.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_acct.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_log.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_osf.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nfnetlink_queue.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_chain_nat.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_compat.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_ct.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_dup_netdev.ko 2023-08-10T10:07:31.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fib.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_hash.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_limit.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_log.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_masq.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_nat.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_numgen.ko 2023-08-10T10:07:31.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_queue.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_quota.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_redir.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_reject_inet.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_socket.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/nft_tunnel.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_AUDIT.ko 2023-08-10T10:07:31.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_CT.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_DSCP.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HL.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_HMARK.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-08-10T10:07:31.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LED.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_LOG.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NETMAP.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFLOG.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_RATEEST.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_REDIRECT.ko 2023-08-10T10:07:31.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_SECMARK.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPMSS.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TEE.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TPROXY.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_TRACE.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_addrtype.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_bpf.ko 2023-08-10T10:07:31.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cgroup.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cluster.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_comment.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connbytes.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlabel.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connlimit.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_connmark.ko 2023-08-10T10:07:31.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_conntrack.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_cpu.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dccp.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_devgroup.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_dscp.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ecn.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_esp.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hashlimit.ko 2023-08-10T10:07:31.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_helper.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_hl.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipcomp.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_iprange.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_ipvs.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_l2tp.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_length.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_limit.ko 2023-08-10T10:07:31.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mac.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_mark.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_multiport.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nat.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_nfacct.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_osf.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_owner.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_physdev.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_pkttype.ko 2023-08-10T10:07:31.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_policy.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_quota.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_rateest.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_realm.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_recent.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_sctp.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_set.ko 2023-08-10T10:07:31.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_socket.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_state.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_statistic.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_string.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_tcpmss.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_time.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netfilter/xt_u32.ko 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink 2023-08-10T10:07:31.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/netlink/netlink_diag.ko 2023-08-10T10:07:31.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh 2023-08-10T10:07:31.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/nsh/nsh.ko 2023-08-10T10:07:31.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/openvswitch.ko 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-geneve.ko 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-gre.ko 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/openvswitch/vport-vxlan.ko 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/packet/af_packet_diag.ko 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds 2023-08-10T10:07:31.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_rdma.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/rds/rds_tcp.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_csum.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_gact.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_ipt.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_mirred.ko 2023-08-10T10:07:31.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_nat.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_pedit.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_police.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_simple.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_skbedit.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/act_vlan.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_basic.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_bpf.ko 2023-08-10T10:07:31.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_flow.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_fw.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_route.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/cls_u32.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_cmp.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_ipset.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_meta.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_nbyte.ko 2023-08-10T10:07:31.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_text.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/em_u32.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_choke.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_codel.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_drr.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_fq.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_gred.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hfsc.ko 2023-08-10T10:07:31.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_hhf.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_htb.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_ingress.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_mqprio_lib.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_multiq.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_netem.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_pie.ko 2023-08-10T10:07:31.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_plug.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_prio.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_qfq.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_red.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfb.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_sfq.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_tbf.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sched/sch_teql.ko 2023-08-10T10:07:31.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp.ko 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sctp/sctp_diag.ko 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/sunrpc.ko 2023-08-10T10:07:31.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/diag.ko 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/tipc/tipc.ko 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/unix/unix_diag.ko 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock 2023-08-10T10:07:31.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_diag.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-08-10T10:07:31.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/security/keys/trusted-keys/trusted.ko 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib 2023-08-10T10:07:31.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/kernel/virt/lib/irqbypass.ko 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.alias.bin 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.bin 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.builtin.modinfo 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.dep.bin 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.devname 2023-08-10T10:07:31.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.order 2023-08-10T10:07:31.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.softdep 2023-08-10T10:07:31.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols 2023-08-10T10:07:31.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc4-ga7fb1265323d/modules.symbols.bin 2023-08-10T10:07:31.233 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:31.233 DEBUG:teuthology.orchestra.run.smithi187:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-08-10T10:07:31.260 INFO:teuthology.orchestra.run.smithi187.stdout:postinstall scriptlet (using /bin/sh): 2023-08-10T10:07:31.260 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d -a -r /boot/System.map-6.5.0-rc4-ga7fb1265323d ]; then 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/System.map-6.5.0-rc4-ga7fb1265323d /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/vmlinuz-6.5.0-rc4-ga7fb1265323d /boot/System.map-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/installkernel 6.5.0-rc4-ga7fb1265323d /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/.vmlinuz-6.5.0-rc4-ga7fb1265323d-rpm /boot/.System.map-6.5.0-rc4-ga7fb1265323d-rpm 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:preuninstall scriptlet (using /bin/sh): 2023-08-10T10:07:31.261 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:new-kernel-pkg --remove 6.5.0-rc4-ga7fb1265323d --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc4-ga7fb1265323d.img 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-install remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:postuninstall scriptlet (using /bin/sh): 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/update-bootloader ]; then 2023-08-10T10:07:31.262 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/update-bootloader --remove 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:31.263 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-08-10T10:07:31.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2023-08-10T10:07:31.341 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2023-08-10T10:07:31.341 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2023-08-10T10:07:31.341 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.02 2023-08-10T10:07:31.341 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 129.el8 2023-08-10T10:07:31.341 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Group : System Environment/Base 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 9265586 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2023-08-10T10:07:31.342 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : kbuilder.bsys.centos.org 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:Relocations : (not relocatable) 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : CentOS BuildSystem 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:07:31.343 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-08-10T10:07:31.344 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2023-08-10T10:07:31.344 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2023-08-10T10:07:31.344 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2023-08-10T10:07:31.344 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:07:31.344 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2023-08-10T10:07:31.345 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-08-10T10:07:31.345 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:31.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-08-10T10:07:36.113 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-08-10T10:07:38.226 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-08-10T10:07:38.228 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-08-10T10:07:38.264 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.hq3Fvk0lBI 2023-08-10T10:07:38.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.hq3Fvk0lBI 2023-08-10T10:07:38.347 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.hq3Fvk0lBI 2023-08-10T10:07:38.481 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.hq3Fvk0lBI is 6KB 2023-08-10T10:07:38.529 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.hq3Fvk0lBI 2023-08-10T10:07:38.546 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2023-08-10T10:07:38.615 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2023-08-10T10:07:38.615 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2023-08-10T10:07:38.615 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2023-08-10T10:07:38.615 INFO:teuthology.orchestra.run.smithi187.stdout:a1b29d6c289747bdb22930598d39874a-6.5.0-rc4-ga7fb1265323d.conf 2023-08-10T10:07:38.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-6.5.0-rc4-ga7fb1265323d 2023-08-10T10:07:38.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2023-08-10T10:07:58.324 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-10T10:08:07.334 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:08:07.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:08.770 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-08-10T10:08:08.771 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:08:08.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:10.416 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-08-10T10:08:22.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:08:22.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:27.248 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-10T10:08:36.253 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:08:36.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:39.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-10T10:08:51.324 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:08:51.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:08:54.260 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-08-10T10:08:54.668 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:08:54.668 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:08:54.669 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-08-10T10:08:54.715 INFO:teuthology.orchestra.run.smithi088.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:08:54.715 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:08:54.715 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:08:54.716 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-10T10:08:55.717 DEBUG:teuthology.parallel:result is None 2023-08-10T10:09:09.744 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-08-10T10:09:24.745 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:09:24.746 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:09:25.111 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-08-10T10:09:25.553 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:09:25.554 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.5.0-rc4-ga7fb1265323d"... 2023-08-10T10:09:25.554 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-08-10T10:09:25.604 INFO:teuthology.orchestra.run.smithi187.stdout:6.5.0-rc4-ga7fb1265323d 2023-08-10T10:09:25.604 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc4-ga7fb1265323d vs 6.5.0-rc4-ga7fb1265323d 2023-08-10T10:09:25.604 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-10T10:09:25.605 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-08-10T10:09:26.606 DEBUG:teuthology.parallel:result is None 2023-08-10T10:09:26.607 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-10T10:09:26.616 INFO:teuthology.task.internal:Creating test directory... 2023-08-10T10:09:26.617 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:09:26.622 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-10T10:09:26.675 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-10T10:09:26.689 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-10T10:09:26.728 INFO:teuthology.task.internal:Creating archive directory... 2023-08-10T10:09:26.729 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:09:26.734 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-10T10:09:26.802 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-10T10:09:26.810 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-10T10:09:26.811 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:09:26.819 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-10T10:09:26.959 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:09:26.973 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:09:26.995 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:09:27.025 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-10T10:09:27.027 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-10T10:09:27.036 INFO:teuthology.task.internal:Configuring sudo... 2023-08-10T10:09:27.037 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:09:27.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-10T10:09:27.117 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-10T10:09:27.129 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-10T10:09:27.130 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:09:27.134 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-10T10:09:27.180 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:09:27.293 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:09:27.363 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:09:27.437 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:09:27.506 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:09:27.507 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:09:27.577 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:09:27.653 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-10T10:09:27.725 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:09:27.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-10T10:09:27.882 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:09:27.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-10T10:09:27.953 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-08-10T10:09:27.958 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-08-10T10:09:28.077 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:09:28.113 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:09:28.350 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-10T10:09:28.361 INFO:teuthology.task.internal:Starting timer... 2023-08-10T10:09:28.361 INFO:teuthology.run_tasks:Running task pcp... 2023-08-10T10:09:28.382 INFO:teuthology.run_tasks:Running task selinux... 2023-08-10T10:09:28.396 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-10T10:09:28.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-08-10T10:09:28.533 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2023-08-10T10:09:28.536 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-08-10T10:09:28.666 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-08-10T10:09:28.669 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-10T10:09:28.670 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-08-10T10:09:28.720 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-08-10T10:09:28.720 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-08-10T10:09:28.768 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-08-10T10:09:28.769 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2023-08-10T10:09:28.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:09:28.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:09:28.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:09:28.911 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:09:28.913 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-10T10:09:28.913 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:09:28.984 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-08-10T10:09:29.057 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-10T10:09:29.071 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-10T10:09:29.072 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-10T10:09:29.105 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-10T10:09:29.108 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-10T10:20:01.729 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-08-10T10:20:01.731 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:20:01.732 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:20:01.815 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-08-10T10:20:01.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-08-10T10:20:01.930 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:20:01.931 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-10T10:20:02.016 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-08-10T10:20:02.131 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-08-10T10:20:02.131 INFO:teuthology.run_tasks:Running task clock... 2023-08-10T10:20:02.142 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-10T10:20:02.143 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:20:02.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:20:02.149 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-10T10:20:02.149 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:20:02.220 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:20:02.225 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-10T10:20:02.253 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:20:02.258 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-10T10:20:02.338 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-08-10T10:20:02.347 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-08-10T10:20:02.366 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-08-10T10:20:02.375 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-08-10T10:20:02.398 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:20:02.407 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-10T10:20:02.431 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:20:02.440 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-10T10:20:02.515 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-08-10T10:20:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:20:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-08-10T10:20:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.523 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.524 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.537 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-08-10T10:20:02.544 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:20:02.544 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-08-10T10:20:02.544 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.544 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.545 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.545 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:20:02.546 INFO:teuthology.run_tasks:Running task install... 2023-08-10T10:20:02.555 DEBUG:teuthology.task.install:project ceph 2023-08-10T10:20:02.555 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}} 2023-08-10T10:20:02.555 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'} 2023-08-10T10:20:02.556 INFO:teuthology.task.install:Using flavor: default 2023-08-10T10:20:02.562 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-10T10:20:02.562 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-10T10:20:02.563 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:20:02.563 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:20:02.566 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'tag': None, 'wait_for_package': False} 2023-08-10T10:20:02.566 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:20:02.705 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:20:02.705 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:20:02.715 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/ 2023-08-10T10:20:02.716 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5118.ga8bf445f 2023-08-10T10:20:02.819 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:20:02.819 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:20:02.819 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:20:02.869 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023Aug1-3/a8bf445f2d27d8e12e060dff0fd151d481b5290b/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-10T10:20:02.869 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:20:02.869 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-10T10:20:02.889 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:20:02.890 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:20:02.939 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-10T10:20:02.940 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8bf445f2d27d8e12e060dff0fd151d481b5290b/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-10T10:20:03.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:20:03.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-10T10:20:03.096 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:20:03.146 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-10T10:20:03.165 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-08-10T10:20:03.168 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-08-10T10:20:03.215 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-08-10T10:20:03.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-08-10T10:20:03.513 INFO:teuthology.orchestra.run.smithi088.stdout:73 files removed 2023-08-10T10:20:03.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:20:03.565 INFO:teuthology.orchestra.run.smithi187.stdout:73 files removed 2023-08-10T10:20:03.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-10T10:20:04.515 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 187 kB/s | 81 kB 00:00 2023-08-10T10:20:04.558 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 194 kB/s | 81 kB 00:00 2023-08-10T10:20:05.051 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 21 kB/s | 9.4 kB 00:00 2023-08-10T10:20:05.057 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 19 kB/s | 9.4 kB 00:00 2023-08-10T10:20:05.727 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 2.3 kB/s | 1.5 kB 00:00 2023-08-10T10:20:05.833 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 2.0 kB/s | 1.5 kB 00:00 2023-08-10T10:20:09.752 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - AppStream 7.7 MB/s | 31 MB 00:03 2023-08-10T10:20:09.783 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - AppStream 7.8 MB/s | 31 MB 00:03 2023-08-10T10:20:18.232 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 41 MB 00:02 2023-08-10T10:20:18.319 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - BaseOS 17 MB/s | 41 MB 00:02 2023-08-10T10:20:24.915 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras 48 kB/s | 18 kB 00:00 2023-08-10T10:20:25.010 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras 46 kB/s | 18 kB 00:00 2023-08-10T10:20:25.608 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.8 kB 00:00 2023-08-10T10:20:25.703 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.8 kB 00:00 2023-08-10T10:20:26.884 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 8 - PowerTools 5.6 MB/s | 6.3 MB 00:01 2023-08-10T10:20:27.121 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 8 - PowerTools 5.0 MB/s | 6.3 MB 00:01 2023-08-10T10:20:28.518 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-08-10T10:20:28.764 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 10 kB/s | 3.5 kB 00:00 2023-08-10T10:24:58.339 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 60 kB/s | 16 MB 04:29 2023-08-10T10:24:58.657 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 59 kB/s | 16 MB 04:29 2023-08-10T10:25:02.739 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 413 kB/s | 24 kB 00:00 2023-08-10T10:25:02.988 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 464 kB/s | 24 kB 00:00 2023-08-10T10:25:06.717 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:25:06.718 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:25:06.731 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-10T10:25:06.732 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-10T10:25:06.732 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-10T10:25:06.733 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-10T10:25:06.734 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:25:06.736 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:25:06.739 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:25:06.740 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:25:06.918 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:25:06.919 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-10T10:25:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.40.16-4.el8.x86_64 is already installed. 2023-08-10T10:25:06.932 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-initscripts-updown-1:1.40.16-4.el8.noarch is already installed. 2023-08-10T10:25:06.933 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-08-10T10:25:06.933 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-1.el8.x86_64 is already installed. 2023-08-10T10:25:06.934 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.32.1-41.el8.x86_64 is already installed. 2023-08-10T10:25:06.935 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-10T10:25:06.937 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-10T10:25:06.940 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-10T10:25:06.941 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-10T10:25:06.946 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-08-10T10:25:06.946 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-08-10T10:25:06.946 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:25:06.947 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:25:06.948 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:25:06.949 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-08-10T10:25:06.950 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:25:06.951 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-10T10:25:06.952 INFO:teuthology.orchestra.run.smithi088.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-10T10:25:06.953 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:25:06.954 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-10T10:25:06.955 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:25:06.956 INFO:teuthology.orchestra.run.smithi088.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-10T10:25:06.957 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-10T10:25:06.958 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:25:06.959 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-10T10:25:06.960 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:25:06.961 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-10T10:25:06.962 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-10T10:25:06.963 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:25:06.964 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:25:06.965 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout:Enabling module streams: 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql 10 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:25:06.966 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-08-10T10:25:06.967 INFO:teuthology.orchestra.run.smithi088.stdout:==================================================================================================== 2023-08-10T10:25:06.967 INFO:teuthology.orchestra.run.smithi088.stdout:Install 128 Packages 2023-08-10T10:25:06.967 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 16 Packages 2023-08-10T10:25:06.967 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:25:06.968 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 213 M 2023-08-10T10:25:06.968 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-08-10T10:25:07.131 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-08-10T10:25:07.144 INFO:teuthology.orchestra.run.smithi187.stdout:==================================================================================================== 2023-08-10T10:25:07.145 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-08-10T10:25:07.145 INFO:teuthology.orchestra.run.smithi187.stdout:==================================================================================================== 2023-08-10T10:25:07.145 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-08-10T10:25:07.145 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 appstream 688 k 2023-08-10T10:25:07.145 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.4 k 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 5.4 M 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 849 k 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 167 k 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 1.6 M 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 129 k 2023-08-10T10:25:07.146 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 1.7 M 2023-08-10T10:25:07.147 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 7.4 M 2023-08-10T10:25:07.147 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 47 k 2023-08-10T10:25:07.147 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 14 M 2023-08-10T10:25:07.147 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 48 M 2023-08-10T10:25:07.147 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 258 k 2023-08-10T10:25:07.148 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 168 k 2023-08-10T10:25:07.148 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 260 k 2023-08-10T10:25:07.148 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 18 k 2023-08-10T10:25:07.148 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.189-2.el8 baseos 61 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 appstream 320 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 baseos 19 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 31 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 772 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 appstream 709 k 2023-08-10T10:25:07.149 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-42.el8 baseos 99 k 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-9.el8 baseos 3.2 M 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 10.23-1.module_el8+300+2c53004c appstream 1.6 M 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 10.23-1.module_el8+300+2c53004c appstream 903 k 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 10.23-1.module_el8+300+2c53004c appstream 5.1 M 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 197 k 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 371 k 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 364 k 2023-08-10T10:25:07.150 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 107 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 93 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.5 M 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 179 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 baseos 74 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-8.el8 baseos 143 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client x86_64 0.189-2.el8 baseos 76 k 2023-08-10T10:25:07.151 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf x86_64 0.189-2.el8 baseos 232 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs x86_64 0.189-2.el8 baseos 302 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: iproute x86_64 6.2.0-2.el8 baseos 880 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid x86_64 2.32.1-42.el8 baseos 220 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk x86_64 2.32.1-42.el8 baseos 253 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: libmount x86_64 2.32.1-42.el8 baseos 236 k 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.7 M 2023-08-10T10:25:07.152 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 3.6 M 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols x86_64 2.32.1-42.el8 baseos 179 k 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid x86_64 2.32.1-42.el8 baseos 98 k 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux x86_64 2.32.1-42.el8 baseos 2.6 M 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user x86_64 2.32.1-42.el8 baseos 102 k 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump x86_64 3.1.8-6.el8 baseos 334 k 2023-08-10T10:25:07.153 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs x86_64 5.0.0-12.el8 baseos 1.1 M 2023-08-10T10:25:07.154 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-08-10T10:25:07.154 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-7.el8 appstream 713 k 2023-08-10T10:25:07.154 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 22 M 2023-08-10T10:25:07.154 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 23 k 2023-08-10T10:25:07.154 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 2.3 M 2023-08-10T10:25:07.155 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 241 k 2023-08-10T10:25:07.155 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 4.6 M 2023-08-10T10:25:07.155 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 18 M 2023-08-10T10:25:07.155 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5118.ga8bf445f.el8 ceph-noarch 15 k 2023-08-10T10:25:07.155 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 24 k 2023-08-10T10:25:07.156 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-17.el8 baseos 83 k 2023-08-10T10:25:07.156 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-10T10:25:07.156 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-7.el8 appstream 202 k 2023-08-10T10:25:07.156 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 baseos 48 k 2023-08-10T10:25:07.156 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-22.el8 baseos 561 k 2023-08-10T10:25:07.157 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 139 k 2023-08-10T10:25:07.157 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-5.el8 baseos 39 k 2023-08-10T10:25:07.157 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-20.el8 baseos 645 k 2023-08-10T10:25:07.157 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-10T10:25:07.157 INFO:teuthology.orchestra.run.smithi187.stdout: libpq x86_64 13.5-1.el8 appstream 198 k 2023-08-10T10:25:07.158 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-20.el8 baseos 172 k 2023-08-10T10:25:07.158 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-4.el8 baseos 47 k 2023-08-10T10:25:07.159 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 473 k 2023-08-10T10:25:07.159 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 0.11.4-3.el8 appstream 354 k 2023-08-10T10:25:07.159 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 6.8 M 2023-08-10T10:25:07.159 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-8.el8 baseos 200 k 2023-08-10T10:25:07.159 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 baseos 87 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.2-2.el8 baseos 18 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.4.4-1.el8 baseos 44 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-2.el8 appstream 187 k 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2023-08-10T10:25:07.160 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-3.el8 baseos 605 k 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-3.el8 baseos 229 k 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-3.el8 baseos 220 k 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2023-08-10T10:25:07.161 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 45 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.0.0-5118.ga8bf445f.el8 ceph 122 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2023-08-10T10:25:07.162 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-6.el8 baseos 641 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-10T10:25:07.163 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-3.el8 appstream 538 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2023-08-10T10:25:07.164 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2023-08-10T10:25:07.165 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-9.el8 appstream 54 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-10T10:25:07.166 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 appstream 14 M 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-10T10:25:07.167 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2023-08-10T10:25:07.168 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-43.el8 appstream 64 k 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-21.el8 baseos 58 k 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql 10 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-08-10T10:25:07.169 INFO:teuthology.orchestra.run.smithi187.stdout:==================================================================================================== 2023-08-10T10:25:07.170 INFO:teuthology.orchestra.run.smithi187.stdout:Install 128 Packages 2023-08-10T10:25:07.170 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 16 Packages 2023-08-10T10:25:07.170 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:25:07.170 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 213 M 2023-08-10T10:25:07.171 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-08-10T10:25:10.472 INFO:teuthology.orchestra.run.smithi088.stdout:(1/144): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-08-10T10:25:10.664 INFO:teuthology.orchestra.run.smithi088.stdout:(2/144): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 4.3 MB/s | 849 kB 00:00 2023-08-10T10:25:10.714 INFO:teuthology.orchestra.run.smithi088.stdout:(3/144): ceph-immutable-object-cache-18.0.0-511 3.3 MB/s | 167 kB 00:00 2023-08-10T10:25:10.973 INFO:teuthology.orchestra.run.smithi088.stdout:(4/144): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 8.9 MB/s | 2.3 MB 00:00 2023-08-10T10:25:11.173 INFO:teuthology.orchestra.run.smithi088.stdout:(5/144): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 7.8 MB/s | 1.6 MB 00:00 2023-08-10T10:25:11.831 INFO:teuthology.orchestra.run.smithi088.stdout:(6/144): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 7.0 MB/s | 4.6 MB 00:00 2023-08-10T10:25:11.980 INFO:teuthology.orchestra.run.smithi187.stdout:(1/144): ceph-18.0.0-5118.ga8bf445f.el8.x86_64. 35 kB/s | 6.4 kB 00:00 2023-08-10T10:25:12.090 INFO:teuthology.orchestra.run.smithi088.stdout:(7/144): ceph-common-18.0.0-5118.ga8bf445f.el8. 13 MB/s | 22 MB 00:01 2023-08-10T10:25:12.364 INFO:teuthology.orchestra.run.smithi187.stdout:(2/144): ceph-fuse-18.0.0-5118.ga8bf445f.el8.x8 2.2 MB/s | 849 kB 00:00 2023-08-10T10:25:12.373 INFO:teuthology.orchestra.run.smithi088.stdout:(8/144): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 2.6 MB/s | 5.4 MB 00:02 2023-08-10T10:25:12.422 INFO:teuthology.orchestra.run.smithi187.stdout:(3/144): ceph-immutable-object-cache-18.0.0-511 2.8 MB/s | 167 kB 00:00 2023-08-10T10:25:12.482 INFO:teuthology.orchestra.run.smithi088.stdout:(9/144): ceph-selinux-18.0.0-5118.ga8bf445f.el8 225 kB/s | 24 kB 00:00 2023-08-10T10:25:13.031 INFO:teuthology.orchestra.run.smithi187.stdout:(4/144): ceph-base-18.0.0-5118.ga8bf445f.el8.x8 4.4 MB/s | 5.4 MB 00:01 2023-08-10T10:25:13.323 INFO:teuthology.orchestra.run.smithi187.stdout:(5/144): ceph-mds-18.0.0-5118.ga8bf445f.el8.x86 2.5 MB/s | 2.3 MB 00:00 2023-08-10T10:25:13.415 INFO:teuthology.orchestra.run.smithi187.stdout:(6/144): ceph-mgr-18.0.0-5118.ga8bf445f.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-08-10T10:25:13.682 INFO:teuthology.orchestra.run.smithi088.stdout:(10/144): ceph-radosgw-18.0.0-5118.ga8bf445f.el 8.5 MB/s | 14 MB 00:01 2023-08-10T10:25:13.774 INFO:teuthology.orchestra.run.smithi088.stdout:(11/144): cephfs-mirror-18.0.0-5118.ga8bf445f.e 2.8 MB/s | 260 kB 00:00 2023-08-10T10:25:13.866 INFO:teuthology.orchestra.run.smithi088.stdout:(12/144): libcephfs-devel-18.0.0-5118.ga8bf445f 338 kB/s | 31 kB 00:00 2023-08-10T10:25:14.099 INFO:teuthology.orchestra.run.smithi088.stdout:(13/144): libcephfs2-18.0.0-5118.ga8bf445f.el8. 3.2 MB/s | 772 kB 00:00 2023-08-10T10:25:14.175 INFO:teuthology.orchestra.run.smithi088.stdout:(14/144): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.8 MB/s | 139 kB 00:00 2023-08-10T10:25:14.250 INFO:teuthology.orchestra.run.smithi088.stdout:(15/144): librados-devel-18.0.0-5118.ga8bf445f. 1.8 MB/s | 139 kB 00:00 2023-08-10T10:25:14.383 INFO:teuthology.orchestra.run.smithi088.stdout:(16/144): libradosstriper1-18.0.0-5118.ga8bf445 3.5 MB/s | 473 kB 00:00 2023-08-10T10:25:14.815 INFO:teuthology.orchestra.run.smithi187.stdout:(7/144): ceph-mon-18.0.0-5118.ga8bf445f.el8.x86 3.1 MB/s | 4.6 MB 00:01 2023-08-10T10:25:15.533 INFO:teuthology.orchestra.run.smithi088.stdout:(17/144): librgw2-18.0.0-5118.ga8bf445f.el8.x86 5.9 MB/s | 6.8 MB 00:01 2023-08-10T10:25:15.617 INFO:teuthology.orchestra.run.smithi088.stdout:(18/144): python3-ceph-argparse-18.0.0-5118.ga8 538 kB/s | 45 kB 00:00 2023-08-10T10:25:15.700 INFO:teuthology.orchestra.run.smithi088.stdout:(19/144): python3-ceph-common-18.0.0-5118.ga8bf 1.4 MB/s | 122 kB 00:00 2023-08-10T10:25:15.792 INFO:teuthology.orchestra.run.smithi088.stdout:(20/144): python3-cephfs-18.0.0-5118.ga8bf445f. 2.1 MB/s | 197 kB 00:00 2023-08-10T10:25:15.911 INFO:teuthology.orchestra.run.smithi088.stdout:(21/144): python3-rados-18.0.0-5118.ga8bf445f.e 3.1 MB/s | 371 kB 00:00 2023-08-10T10:25:16.001 INFO:teuthology.orchestra.run.smithi088.stdout:(22/144): python3-rbd-18.0.0-5118.ga8bf445f.el8 3.9 MB/s | 364 kB 00:00 2023-08-10T10:25:16.060 INFO:teuthology.orchestra.run.smithi088.stdout:(23/144): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.8 MB/s | 107 kB 00:00 2023-08-10T10:25:16.127 INFO:teuthology.orchestra.run.smithi088.stdout:(24/144): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 1.4 MB/s | 93 kB 00:00 2023-08-10T10:25:16.165 INFO:teuthology.orchestra.run.smithi187.stdout:(8/144): ceph-common-18.0.0-5118.ga8bf445f.el8. 5.1 MB/s | 22 MB 00:04 2023-08-10T10:25:16.248 INFO:teuthology.orchestra.run.smithi187.stdout:(9/144): ceph-selinux-18.0.0-5118.ga8bf445f.el8 293 kB/s | 24 kB 00:00 2023-08-10T10:25:16.719 INFO:teuthology.orchestra.run.smithi088.stdout:(25/144): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 6.0 MB/s | 3.5 MB 00:00 2023-08-10T10:25:16.819 INFO:teuthology.orchestra.run.smithi088.stdout:(26/144): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 1.8 MB/s | 179 kB 00:00 2023-08-10T10:25:16.878 INFO:teuthology.orchestra.run.smithi088.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5118.g 395 kB/s | 23 kB 00:00 2023-08-10T10:25:16.932 INFO:teuthology.orchestra.run.smithi187.stdout:(10/144): ceph-osd-18.0.0-5118.ga8bf445f.el8.x8 5.1 MB/s | 18 MB 00:03 2023-08-10T10:25:16.945 INFO:teuthology.orchestra.run.smithi088.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.9 MB/s | 129 kB 00:00 2023-08-10T10:25:16.999 INFO:teuthology.orchestra.run.smithi187.stdout:(11/144): cephfs-mirror-18.0.0-5118.ga8bf445f.e 3.8 MB/s | 260 kB 00:00 2023-08-10T10:25:17.075 INFO:teuthology.orchestra.run.smithi187.stdout:(12/144): libcephfs-devel-18.0.0-5118.ga8bf445f 412 kB/s | 31 kB 00:00 2023-08-10T10:25:17.245 INFO:teuthology.orchestra.run.smithi088.stdout:(29/144): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 5.7 MB/s | 1.7 MB 00:00 2023-08-10T10:25:17.291 INFO:teuthology.orchestra.run.smithi187.stdout:(13/144): libcephfs2-18.0.0-5118.ga8bf445f.el8. 3.5 MB/s | 772 kB 00:00 2023-08-10T10:25:17.383 INFO:teuthology.orchestra.run.smithi187.stdout:(14/144): libcephsqlite-18.0.0-5118.ga8bf445f.e 1.5 MB/s | 139 kB 00:00 2023-08-10T10:25:17.475 INFO:teuthology.orchestra.run.smithi187.stdout:(15/144): librados-devel-18.0.0-5118.ga8bf445f. 1.5 MB/s | 139 kB 00:00 2023-08-10T10:25:17.859 INFO:teuthology.orchestra.run.smithi187.stdout:(16/144): libradosstriper1-18.0.0-5118.ga8bf445 1.2 MB/s | 473 kB 00:00 2023-08-10T10:25:18.203 INFO:teuthology.orchestra.run.smithi088.stdout:(30/144): ceph-test-18.0.0-5118.ga8bf445f.el8.x 8.4 MB/s | 48 MB 00:05 2023-08-10T10:25:18.325 INFO:teuthology.orchestra.run.smithi088.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5118.ga8 1.9 MB/s | 241 kB 00:00 2023-08-10T10:25:18.429 INFO:teuthology.orchestra.run.smithi088.stdout:(32/144): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-08-10T10:25:18.454 INFO:teuthology.orchestra.run.smithi088.stdout:(33/144): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 369 kB/s | 47 kB 00:00 2023-08-10T10:25:18.488 INFO:teuthology.orchestra.run.smithi088.stdout:(34/144): ceph-prometheus-alerts-18.0.0-5118.ga 248 kB/s | 15 kB 00:00 2023-08-10T10:25:18.538 INFO:teuthology.orchestra.run.smithi088.stdout:(35/144): ceph-volume-18.0.0-5118.ga8bf445f.el8 3.0 MB/s | 258 kB 00:00 2023-08-10T10:25:18.563 INFO:teuthology.orchestra.run.smithi088.stdout:(36/144): cephadm-18.0.0-5118.ga8bf445f.el8.noa 2.2 MB/s | 168 kB 00:00 2023-08-10T10:25:18.614 INFO:teuthology.orchestra.run.smithi088.stdout:(37/144): cephfs-top-18.0.0-5118.ga8bf445f.el8. 239 kB/s | 18 kB 00:00 2023-08-10T10:25:18.767 INFO:teuthology.orchestra.run.smithi187.stdout:(17/144): ceph-radosgw-18.0.0-5118.ga8bf445f.el 3.4 MB/s | 14 MB 00:03 2023-08-10T10:25:18.826 INFO:teuthology.orchestra.run.smithi187.stdout:(18/144): python3-ceph-argparse-18.0.0-5118.ga8 771 kB/s | 45 kB 00:00 2023-08-10T10:25:18.876 INFO:teuthology.orchestra.run.smithi187.stdout:(19/144): python3-ceph-common-18.0.0-5118.ga8bf 2.4 MB/s | 122 kB 00:00 2023-08-10T10:25:18.935 INFO:teuthology.orchestra.run.smithi187.stdout:(20/144): python3-cephfs-18.0.0-5118.ga8bf445f. 3.3 MB/s | 197 kB 00:00 2023-08-10T10:25:19.027 INFO:teuthology.orchestra.run.smithi187.stdout:(21/144): librgw2-18.0.0-5118.ga8bf445f.el8.x86 5.8 MB/s | 6.8 MB 00:01 2023-08-10T10:25:19.052 INFO:teuthology.orchestra.run.smithi187.stdout:(22/144): python3-rados-18.0.0-5118.ga8bf445f.e 3.1 MB/s | 371 kB 00:00 2023-08-10T10:25:19.102 INFO:teuthology.orchestra.run.smithi187.stdout:(23/144): python3-rbd-18.0.0-5118.ga8bf445f.el8 4.8 MB/s | 364 kB 00:00 2023-08-10T10:25:19.127 INFO:teuthology.orchestra.run.smithi187.stdout:(24/144): python3-rgw-18.0.0-5118.ga8bf445f.el8 1.4 MB/s | 107 kB 00:00 2023-08-10T10:25:19.144 INFO:teuthology.orchestra.run.smithi187.stdout:(25/144): rbd-fuse-18.0.0-5118.ga8bf445f.el8.x8 2.2 MB/s | 93 kB 00:00 2023-08-10T10:25:19.195 INFO:teuthology.orchestra.run.smithi187.stdout:(26/144): rbd-nbd-18.0.0-5118.ga8bf445f.el8.x86 3.5 MB/s | 179 kB 00:00 2023-08-10T10:25:19.222 INFO:teuthology.orchestra.run.smithi088.stdout:(38/144): automake-1.16.1-7.el8.noarch.rpm 1.1 MB/s | 713 kB 00:00 2023-08-10T10:25:19.246 INFO:teuthology.orchestra.run.smithi187.stdout:(27/144): ceph-grafana-dashboards-18.0.0-5118.g 464 kB/s | 23 kB 00:00 2023-08-10T10:25:19.289 INFO:teuthology.orchestra.run.smithi088.stdout:(39/144): bison-3.0.4-10.el8.x86_64.rpm 1.0 MB/s | 688 kB 00:00 2023-08-10T10:25:19.313 INFO:teuthology.orchestra.run.smithi187.stdout:(28/144): ceph-mgr-cephadm-18.0.0-5118.ga8bf445 1.9 MB/s | 129 kB 00:00 2023-08-10T10:25:19.398 INFO:teuthology.orchestra.run.smithi088.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-08-10T10:25:19.423 INFO:teuthology.orchestra.run.smithi088.stdout:(41/144): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2023-08-10T10:25:19.537 INFO:teuthology.orchestra.run.smithi088.stdout:(42/144): libpq-13.5-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-08-10T10:25:19.605 INFO:teuthology.orchestra.run.smithi187.stdout:(29/144): ceph-mgr-dashboard-18.0.0-5118.ga8bf4 5.9 MB/s | 1.7 MB 00:00 2023-08-10T10:25:19.649 INFO:teuthology.orchestra.run.smithi088.stdout:(43/144): librdkafka-0.11.4-3.el8.x86_64.rpm 1.5 MB/s | 354 kB 00:00 2023-08-10T10:25:19.757 INFO:teuthology.orchestra.run.smithi088.stdout:(44/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.4 MB/s | 259 kB 00:00 2023-08-10T10:25:19.780 INFO:teuthology.orchestra.run.smithi187.stdout:(30/144): rbd-mirror-18.0.0-5118.ga8bf445f.el8. 5.4 MB/s | 3.5 MB 00:00 2023-08-10T10:25:19.816 INFO:teuthology.orchestra.run.smithi088.stdout:(45/144): libtool-2.4.6-25.el8.x86_64.rpm 2.5 MB/s | 709 kB 00:00 2023-08-10T10:25:19.866 INFO:teuthology.orchestra.run.smithi088.stdout:(46/144): oniguruma-6.8.2-2.el8.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-08-10T10:25:19.880 INFO:teuthology.orchestra.run.smithi187.stdout:(31/144): ceph-mgr-modules-core-18.0.0-5118.ga8 2.4 MB/s | 241 kB 00:00 2023-08-10T10:25:19.939 INFO:teuthology.orchestra.run.smithi187.stdout:(32/144): ceph-mgr-rook-18.0.0-5118.ga8bf445f.e 815 kB/s | 47 kB 00:00 2023-08-10T10:25:19.997 INFO:teuthology.orchestra.run.smithi187.stdout:(33/144): ceph-prometheus-alerts-18.0.0-5118.ga 250 kB/s | 15 kB 00:00 2023-08-10T10:25:20.098 INFO:teuthology.orchestra.run.smithi187.stdout:(34/144): ceph-volume-18.0.0-5118.ga8bf445f.el8 2.5 MB/s | 258 kB 00:00 2023-08-10T10:25:20.156 INFO:teuthology.orchestra.run.smithi187.stdout:(35/144): cephadm-18.0.0-5118.ga8bf445f.el8.noa 2.8 MB/s | 168 kB 00:00 2023-08-10T10:25:20.215 INFO:teuthology.orchestra.run.smithi187.stdout:(36/144): cephfs-top-18.0.0-5118.ga8bf445f.el8. 308 kB/s | 18 kB 00:00 2023-08-10T10:25:20.624 INFO:teuthology.orchestra.run.smithi187.stdout:(37/144): ceph-mgr-diskprediction-local-18.0.0- 7.3 MB/s | 7.4 MB 00:01 2023-08-10T10:25:20.866 INFO:teuthology.orchestra.run.smithi187.stdout:(38/144): automake-1.16.1-7.el8.noarch.rpm 1.1 MB/s | 713 kB 00:00 2023-08-10T10:25:21.058 INFO:teuthology.orchestra.run.smithi187.stdout:(39/144): flex-2.6.1-9.el8.x86_64.rpm 1.6 MB/s | 320 kB 00:00 2023-08-10T10:25:21.167 INFO:teuthology.orchestra.run.smithi187.stdout:(40/144): jq-1.6-7.el8.x86_64.rpm 1.8 MB/s | 202 kB 00:00 2023-08-10T10:25:21.208 INFO:teuthology.orchestra.run.smithi088.stdout:(47/144): ceph-osd-18.0.0-5118.ga8bf445f.el8.x8 1.9 MB/s | 18 MB 00:09 2023-08-10T10:25:21.275 INFO:teuthology.orchestra.run.smithi187.stdout:(41/144): libpq-13.5-1.el8.x86_64.rpm 1.8 MB/s | 198 kB 00:00 2023-08-10T10:25:21.283 INFO:teuthology.orchestra.run.smithi088.stdout:(48/144): openblas-0.3.15-4.el8.x86_64.rpm 3.2 MB/s | 4.7 MB 00:01 2023-08-10T10:25:21.350 INFO:teuthology.orchestra.run.smithi088.stdout:(49/144): openblas-threads-0.3.15-4.el8.x86_64. 3.3 MB/s | 4.9 MB 00:01 2023-08-10T10:25:21.692 INFO:teuthology.orchestra.run.smithi088.stdout:(50/144): postgresql-contrib-10.23-1.module_el8 2.2 MB/s | 903 kB 00:00 2023-08-10T10:25:21.751 INFO:teuthology.orchestra.run.smithi187.stdout:(42/144): ceph-test-18.0.0-5118.ga8bf445f.el8.x 8.7 MB/s | 48 MB 00:05 2023-08-10T10:25:21.776 INFO:teuthology.orchestra.run.smithi187.stdout:(43/144): bison-3.0.4-10.el8.x86_64.rpm 598 kB/s | 688 kB 00:01 2023-08-10T10:25:21.801 INFO:teuthology.orchestra.run.smithi187.stdout:(44/144): librdkafka-0.11.4-3.el8.x86_64.rpm 673 kB/s | 354 kB 00:00 2023-08-10T10:25:21.976 INFO:teuthology.orchestra.run.smithi187.stdout:(45/144): oniguruma-6.8.2-2.el8.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2023-08-10T10:25:22.051 INFO:teuthology.orchestra.run.smithi187.stdout:(46/144): lttng-ust-2.8.1-11.el8.x86_64.rpm 942 kB/s | 259 kB 00:00 2023-08-10T10:25:22.159 INFO:teuthology.orchestra.run.smithi088.stdout:(51/144): postgresql-10.23-1.module_el8+300+2c5 1.6 MB/s | 1.6 MB 00:00 2023-08-10T10:25:22.351 INFO:teuthology.orchestra.run.smithi088.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 2.7 MB/s | 538 kB 00:00 2023-08-10T10:25:22.393 INFO:teuthology.orchestra.run.smithi187.stdout:(47/144): libtool-2.4.6-25.el8.x86_64.rpm 1.1 MB/s | 709 kB 00:00 2023-08-10T10:25:22.418 INFO:teuthology.orchestra.run.smithi088.stdout:(53/144): postgresql-server-10.23-1.module_el8+ 4.8 MB/s | 5.1 MB 00:01 2023-08-10T10:25:22.535 INFO:teuthology.orchestra.run.smithi088.stdout:(54/144): python3-jsonpatch-1.21-2.el8.noarch.r 145 kB/s | 27 kB 00:00 2023-08-10T10:25:22.560 INFO:teuthology.orchestra.run.smithi088.stdout:(55/144): python3-jsonpointer-1.10-11.el8.noarc 141 kB/s | 20 kB 00:00 2023-08-10T10:25:22.635 INFO:teuthology.orchestra.run.smithi088.stdout:(56/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-08-10T10:25:22.661 INFO:teuthology.orchestra.run.smithi088.stdout:(57/144): python3-markupsafe-0.23-19.el8.x86_64 387 kB/s | 39 kB 00:00 2023-08-10T10:25:22.802 INFO:teuthology.orchestra.run.smithi088.stdout:(58/144): python3-babel-2.5.1-7.el8.noarch.rpm 4.3 MB/s | 4.8 MB 00:01 2023-08-10T10:25:22.878 INFO:teuthology.orchestra.run.smithi088.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.0 MB/s | 225 kB 00:00 2023-08-10T10:25:22.894 INFO:teuthology.orchestra.run.smithi187.stdout:(48/144): postgresql-10.23-1.module_el8+300+2c5 3.1 MB/s | 1.6 MB 00:00 2023-08-10T10:25:22.903 INFO:teuthology.orchestra.run.smithi088.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 439 kB/s | 44 kB 00:00 2023-08-10T10:25:22.978 INFO:teuthology.orchestra.run.smithi088.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-08-10T10:25:23.003 INFO:teuthology.orchestra.run.smithi088.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-08-10T10:25:23.079 INFO:teuthology.orchestra.run.smithi088.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.1 MB/s | 110 kB 00:00 2023-08-10T10:25:23.104 INFO:teuthology.orchestra.run.smithi088.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 539 kB/s | 54 kB 00:00 2023-08-10T10:25:23.161 INFO:teuthology.orchestra.run.smithi187.stdout:(49/144): postgresql-contrib-10.23-1.module_el8 3.3 MB/s | 903 kB 00:00 2023-08-10T10:25:23.296 INFO:teuthology.orchestra.run.smithi088.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 2.3 MB/s | 457 kB 00:00 2023-08-10T10:25:23.311 INFO:teuthology.orchestra.run.smithi187.stdout:(50/144): openblas-0.3.15-4.el8.x86_64.rpm 3.5 MB/s | 4.7 MB 00:01 2023-08-10T10:25:23.471 INFO:teuthology.orchestra.run.smithi088.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 1.8 MB/s | 323 kB 00:00 2023-08-10T10:25:23.594 INFO:teuthology.orchestra.run.smithi187.stdout:(51/144): openblas-threads-0.3.15-4.el8.x86_64. 3.1 MB/s | 4.9 MB 00:01 2023-08-10T10:25:23.622 INFO:teuthology.orchestra.run.smithi088.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 427 kB/s | 64 kB 00:00 2023-08-10T10:25:23.797 INFO:teuthology.orchestra.run.smithi088.stdout:(68/144): python3-numpy-1.14.3-10.el8.x86_64.rp 3.2 MB/s | 3.7 MB 00:01 2023-08-10T10:25:23.814 INFO:teuthology.orchestra.run.smithi088.stdout:(69/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 368 kB/s | 71 kB 00:00 2023-08-10T10:25:23.828 INFO:teuthology.orchestra.run.smithi187.stdout:(52/144): python3-jinja2-2.10.1-3.el8.noarch.rp 2.3 MB/s | 538 kB 00:00 2023-08-10T10:25:23.954 INFO:teuthology.orchestra.run.smithi187.stdout:(53/144): python3-jsonpatch-1.21-2.el8.noarch.r 212 kB/s | 27 kB 00:00 2023-08-10T10:25:24.089 INFO:teuthology.orchestra.run.smithi187.stdout:(54/144): python3-jsonpointer-1.10-11.el8.noarc 148 kB/s | 20 kB 00:00 2023-08-10T10:25:24.221 INFO:teuthology.orchestra.run.smithi187.stdout:(55/144): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2023-08-10T10:25:24.264 INFO:teuthology.orchestra.run.smithi088.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 132 kB/s | 61 kB 00:00 2023-08-10T10:25:24.306 INFO:teuthology.orchestra.run.smithi088.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 169 kB/s | 83 kB 00:00 2023-08-10T10:25:24.354 INFO:teuthology.orchestra.run.smithi187.stdout:(56/144): python3-markupsafe-0.23-19.el8.x86_64 291 kB/s | 39 kB 00:00 2023-08-10T10:25:24.438 INFO:teuthology.orchestra.run.smithi187.stdout:(57/144): python3-babel-2.5.1-7.el8.noarch.rpm 4.2 MB/s | 4.8 MB 00:01 2023-08-10T10:25:24.440 INFO:teuthology.orchestra.run.smithi088.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 274 kB/s | 48 kB 00:00 2023-08-10T10:25:24.505 INFO:teuthology.orchestra.run.smithi187.stdout:(58/144): postgresql-server-10.23-1.module_el8+ 3.8 MB/s | 5.1 MB 00:01 2023-08-10T10:25:24.547 INFO:teuthology.orchestra.run.smithi187.stdout:(59/144): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.0 MB/s | 225 kB 00:00 2023-08-10T10:25:24.614 INFO:teuthology.orchestra.run.smithi187.stdout:(60/144): python3-prettytable-0.7.2-14.el8.noar 404 kB/s | 44 kB 00:00 2023-08-10T10:25:24.615 INFO:teuthology.orchestra.run.smithi088.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 107 kB/s | 19 kB 00:00 2023-08-10T10:25:24.639 INFO:teuthology.orchestra.run.smithi187.stdout:(61/144): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.1 MB/s | 103 kB 00:00 2023-08-10T10:25:24.723 INFO:teuthology.orchestra.run.smithi187.stdout:(62/144): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-08-10T10:25:24.748 INFO:teuthology.orchestra.run.smithi187.stdout:(63/144): python3-pyasn1-modules-0.3.7-6.el8.no 1.0 MB/s | 110 kB 00:00 2023-08-10T10:25:24.765 INFO:teuthology.orchestra.run.smithi088.stdout:(74/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.2 MB/s | 561 kB 00:00 2023-08-10T10:25:24.791 INFO:teuthology.orchestra.run.smithi088.stdout:(75/144): libcom_err-devel-1.45.6-5.el8.x86_64. 222 kB/s | 39 kB 00:00 2023-08-10T10:25:24.824 INFO:teuthology.orchestra.run.smithi187.stdout:(64/144): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2023-08-10T10:25:24.932 INFO:teuthology.orchestra.run.smithi187.stdout:(65/144): python3-werkzeug-0.12.2-4.el8.noarch. 4.1 MB/s | 457 kB 00:00 2023-08-10T10:25:24.991 INFO:teuthology.orchestra.run.smithi088.stdout:(76/144): libgfortran-8.5.0-20.el8.x86_64.rpm 2.8 MB/s | 645 kB 00:00 2023-08-10T10:25:25.041 INFO:teuthology.orchestra.run.smithi187.stdout:(66/144): socat-1.7.4.1-1.el8.x86_64.rpm 2.9 MB/s | 323 kB 00:00 2023-08-10T10:25:25.141 INFO:teuthology.orchestra.run.smithi187.stdout:(67/144): uuid-1.6.2-43.el8.x86_64.rpm 642 kB/s | 64 kB 00:00 2023-08-10T10:25:25.166 INFO:teuthology.orchestra.run.smithi088.stdout:(77/144): python3-scipy-1.0.0-21.module_el8.5.0 6.6 MB/s | 14 MB 00:02 2023-08-10T10:25:25.191 INFO:teuthology.orchestra.run.smithi088.stdout:(78/144): libquadmath-8.5.0-20.el8.x86_64.rpm 430 kB/s | 172 kB 00:00 2023-08-10T10:25:25.217 INFO:teuthology.orchestra.run.smithi088.stdout:(79/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 208 kB/s | 47 kB 00:00 2023-08-10T10:25:25.242 INFO:teuthology.orchestra.run.smithi187.stdout:(68/144): xmlstarlet-1.6.1-20.el8.x86_64.rpm 707 kB/s | 71 kB 00:00 2023-08-10T10:25:25.301 INFO:teuthology.orchestra.run.smithi187.stdout:(69/144): python3-numpy-1.14.3-10.el8.x86_64.rp 3.9 MB/s | 3.7 MB 00:00 2023-08-10T10:25:25.342 INFO:teuthology.orchestra.run.smithi088.stdout:(80/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 797 kB/s | 99 kB 00:00 2023-08-10T10:25:25.367 INFO:teuthology.orchestra.run.smithi088.stdout:(81/144): libsepol-devel-2.9-3.el8.x86_64.rpm 579 kB/s | 87 kB 00:00 2023-08-10T10:25:25.459 INFO:teuthology.orchestra.run.smithi088.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 154 kB/s | 18 kB 00:00 2023-08-10T10:25:25.518 INFO:teuthology.orchestra.run.smithi088.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 292 kB/s | 44 kB 00:00 2023-08-10T10:25:25.751 INFO:teuthology.orchestra.run.smithi187.stdout:(70/144): elfutils-libelf-devel-0.189-2.el8.x86 121 kB/s | 61 kB 00:00 2023-08-10T10:25:25.777 INFO:teuthology.orchestra.run.smithi088.stdout:(84/144): libselinux-devel-2.9-8.el8.x86_64.rpm 328 kB/s | 200 kB 00:00 2023-08-10T10:25:25.793 INFO:teuthology.orchestra.run.smithi187.stdout:(71/144): fuse-2.9.7-17.el8.x86_64.rpm 169 kB/s | 83 kB 00:00 2023-08-10T10:25:25.835 INFO:teuthology.orchestra.run.smithi088.stdout:(85/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 8.5 MB/s | 3.2 MB 00:00 2023-08-10T10:25:25.868 INFO:teuthology.orchestra.run.smithi088.stdout:(86/144): pcre2-devel-10.32-3.el8.x86_64.rpm 1.7 MB/s | 605 kB 00:00 2023-08-10T10:25:25.918 INFO:teuthology.orchestra.run.smithi187.stdout:(72/144): keyutils-libs-devel-1.5.10-9.el8.x86_ 288 kB/s | 48 kB 00:00 2023-08-10T10:25:25.986 INFO:teuthology.orchestra.run.smithi088.stdout:(87/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-08-10T10:25:26.019 INFO:teuthology.orchestra.run.smithi088.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.6 MB/s | 249 kB 00:00 2023-08-10T10:25:26.052 INFO:teuthology.orchestra.run.smithi187.stdout:(73/144): libaio-devel-0.3.112-1.el8.x86_64.rpm 140 kB/s | 19 kB 00:00 2023-08-10T10:25:26.078 INFO:teuthology.orchestra.run.smithi088.stdout:(89/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 912 kB/s | 220 kB 00:00 2023-08-10T10:25:26.128 INFO:teuthology.orchestra.run.smithi088.stdout:(90/144): python3-cryptography-3.2.1-6.el8.x86_ 4.4 MB/s | 641 kB 00:00 2023-08-10T10:25:26.162 INFO:teuthology.orchestra.run.smithi088.stdout:(91/144): python3-jwt-1.6.1-2.el8.noarch.rpm 300 kB/s | 43 kB 00:00 2023-08-10T10:25:26.219 INFO:teuthology.orchestra.run.smithi187.stdout:(74/144): libcom_err-devel-1.45.6-5.el8.x86_64. 233 kB/s | 39 kB 00:00 2023-08-10T10:25:26.229 INFO:teuthology.orchestra.run.smithi088.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-08-10T10:25:26.254 INFO:teuthology.orchestra.run.smithi088.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 869 kB/s | 109 kB 00:00 2023-08-10T10:25:26.278 INFO:teuthology.orchestra.run.smithi187.stdout:(75/144): krb5-devel-1.18.2-22.el8.x86_64.rpm 1.1 MB/s | 561 kB 00:00 2023-08-10T10:25:26.312 INFO:teuthology.orchestra.run.smithi088.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 284 kB/s | 43 kB 00:00 2023-08-10T10:25:26.354 INFO:teuthology.orchestra.run.smithi088.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 595 kB/s | 74 kB 00:00 2023-08-10T10:25:26.388 INFO:teuthology.orchestra.run.smithi088.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 434 kB/s | 58 kB 00:00 2023-08-10T10:25:26.427 INFO:teuthology.orchestra.run.smithi187.stdout:(76/144): libquadmath-8.5.0-20.el8.x86_64.rpm 1.1 MB/s | 172 kB 00:00 2023-08-10T10:25:26.661 INFO:teuthology.orchestra.run.smithi187.stdout:(77/144): python3-scipy-1.0.0-21.module_el8.5.0 7.2 MB/s | 14 MB 00:01 2023-08-10T10:25:26.686 INFO:teuthology.orchestra.run.smithi187.stdout:(78/144): librabbitmq-0.9.0-4.el8.x86_64.rpm 181 kB/s | 47 kB 00:00 2023-08-10T10:25:26.720 INFO:teuthology.orchestra.run.smithi187.stdout:(79/144): libgfortran-8.5.0-20.el8.x86_64.rpm 1.3 MB/s | 645 kB 00:00 2023-08-10T10:25:26.821 INFO:teuthology.orchestra.run.smithi187.stdout:(80/144): libsepol-devel-2.9-3.el8.x86_64.rpm 650 kB/s | 87 kB 00:00 2023-08-10T10:25:26.837 INFO:teuthology.orchestra.run.smithi187.stdout:(81/144): libuuid-devel-2.32.1-42.el8.x86_64.rp 852 kB/s | 99 kB 00:00 2023-08-10T10:25:26.946 INFO:teuthology.orchestra.run.smithi187.stdout:(82/144): libverto-devel-0.3.2-2.el8.x86_64.rpm 144 kB/s | 18 kB 00:00 2023-08-10T10:25:26.971 INFO:teuthology.orchestra.run.smithi187.stdout:(83/144): libzstd-devel-1.4.4-1.el8.x86_64.rpm 327 kB/s | 44 kB 00:00 2023-08-10T10:25:27.163 INFO:teuthology.orchestra.run.smithi187.stdout:(84/144): pcre2-devel-10.32-3.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-08-10T10:25:27.289 INFO:teuthology.orchestra.run.smithi187.stdout:(85/144): libselinux-devel-2.9-8.el8.x86_64.rpm 319 kB/s | 200 kB 00:00 2023-08-10T10:25:27.314 INFO:teuthology.orchestra.run.smithi187.stdout:(86/144): pcre2-utf16-10.32-3.el8.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2023-08-10T10:25:27.397 INFO:teuthology.orchestra.run.smithi187.stdout:(87/144): openssl-devel-1.1.1k-9.el8.x86_64.rpm 7.0 MB/s | 3.2 MB 00:00 2023-08-10T10:25:27.456 INFO:teuthology.orchestra.run.smithi187.stdout:(88/144): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.7 MB/s | 249 kB 00:00 2023-08-10T10:25:27.507 INFO:teuthology.orchestra.run.smithi187.stdout:(89/144): pcre2-utf32-10.32-3.el8.x86_64.rpm 1.0 MB/s | 220 kB 00:00 2023-08-10T10:25:27.540 INFO:teuthology.orchestra.run.smithi187.stdout:(90/144): python3-cryptography-3.2.1-6.el8.x86_ 4.4 MB/s | 641 kB 00:00 2023-08-10T10:25:27.574 INFO:teuthology.orchestra.run.smithi187.stdout:(91/144): python3-jwt-1.6.1-2.el8.noarch.rpm 363 kB/s | 43 kB 00:00 2023-08-10T10:25:27.657 INFO:teuthology.orchestra.run.smithi187.stdout:(92/144): python3-oauthlib-2.1.0-1.el8.noarch.r 1.0 MB/s | 155 kB 00:00 2023-08-10T10:25:27.683 INFO:teuthology.orchestra.run.smithi187.stdout:(93/144): python3-pycparser-2.14-14.el8.noarch. 766 kB/s | 109 kB 00:00 2023-08-10T10:25:27.708 INFO:teuthology.orchestra.run.smithi187.stdout:(94/144): python3-requests-oauthlib-1.0.0-1.el8 318 kB/s | 43 kB 00:00 2023-08-10T10:25:27.792 INFO:teuthology.orchestra.run.smithi187.stdout:(95/144): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 556 kB/s | 74 kB 00:00 2023-08-10T10:25:27.817 INFO:teuthology.orchestra.run.smithi187.stdout:(96/144): zlib-devel-1.2.11-21.el8.x86_64.rpm 434 kB/s | 58 kB 00:00 2023-08-10T10:27:41.335 INFO:teuthology.orchestra.run.smithi187.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.336 INFO:teuthology.orchestra.run.smithi187.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.336 INFO:teuthology.orchestra.run.smithi187.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.487 INFO:teuthology.orchestra.run.smithi187.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 450 B/s | 59 kB 02:13 2023-08-10T10:27:41.512 INFO:teuthology.orchestra.run.smithi187.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 574 B/s | 75 kB 02:13 2023-08-10T10:27:41.538 INFO:teuthology.orchestra.run.smithi187.stdout:(99/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:13 2023-08-10T10:27:41.562 INFO:teuthology.orchestra.run.smithi187.stdout:(100/144): python3-bcrypt-3.1.6-2.el8.1.x86_64. 867 kB/s | 44 kB 00:00 2023-08-10T10:27:41.588 INFO:teuthology.orchestra.run.smithi187.stdout:(101/144): python3-beautifulsoup4-4.6.3-2.el8.1 3.6 MB/s | 185 kB 00:00 2023-08-10T10:27:41.613 INFO:teuthology.orchestra.run.smithi187.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 656 kB/s | 33 kB 00:00 2023-08-10T10:27:41.639 INFO:teuthology.orchestra.run.smithi187.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 326 kB/s | 16 kB 00:00 2023-08-10T10:27:41.680 INFO:teuthology.orchestra.run.smithi187.stdout:(104/144): python3-asyncssh-2.7.0-2.el8.noarch. 2.4 MB/s | 476 kB 00:00 2023-08-10T10:27:41.698 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] gperftools-libs-2.7-9.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/g/gperftools-libs-2.7-9.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.699 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] liboath-2.6.2-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/liboath-2.6.2-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.699 INFO:teuthology.orchestra.run.smithi088.stdout:[MIRROR] libunwind-1.3.1-3.el8.x86_64.rpm: Curl error (7): Couldn't connect to server for http://mirror.es.its.nyu.edu/epel/8/Everything/x86_64/Packages/l/libunwind-1.3.1-3.el8.x86_64.rpm [Failed to connect to mirror.es.its.nyu.edu port 80: Connection timed out] 2023-08-10T10:27:41.706 INFO:teuthology.orchestra.run.smithi187.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 1.8 MB/s | 173 kB 00:00 2023-08-10T10:27:41.723 INFO:teuthology.orchestra.run.smithi187.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.9 MB/s | 81 kB 00:00 2023-08-10T10:27:41.757 INFO:teuthology.orchestra.run.smithi187.stdout:(107/144): python3-cherrypy-18.4.0-1.el8.noarch 3.2 MB/s | 384 kB 00:00 2023-08-10T10:27:41.782 INFO:teuthology.orchestra.run.smithi187.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 147 kB/s | 11 kB 00:00 2023-08-10T10:27:41.807 INFO:teuthology.orchestra.run.smithi187.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 209 kB/s | 18 kB 00:00 2023-08-10T10:27:41.832 INFO:teuthology.orchestra.run.smithi187.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 978 kB/s | 49 kB 00:00 2023-08-10T10:27:41.835 INFO:teuthology.orchestra.run.smithi088.stdout:(97/144): liboath-2.6.2-3.el8.x86_64.rpm 444 B/s | 59 kB 02:15 2023-08-10T10:27:41.858 INFO:teuthology.orchestra.run.smithi187.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2023-08-10T10:27:41.860 INFO:teuthology.orchestra.run.smithi088.stdout:(98/144): libunwind-1.3.1-3.el8.x86_64.rpm 567 B/s | 75 kB 02:15 2023-08-10T10:27:41.891 INFO:teuthology.orchestra.run.smithi187.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.0 MB/s | 60 kB 00:00 2023-08-10T10:27:41.910 INFO:teuthology.orchestra.run.smithi088.stdout:(99/144): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 876 kB/s | 44 kB 00:00 2023-08-10T10:27:41.925 INFO:teuthology.orchestra.run.smithi187.stdout:(113/144): python3-pecan-1.3.2-9.el8.noarch.rpm 4.1 MB/s | 283 kB 00:00 2023-08-10T10:27:41.935 INFO:teuthology.orchestra.run.smithi088.stdout:(100/144): gperftools-libs-2.7-9.el8.x86_64.rpm 2.3 kB/s | 306 kB 02:15 2023-08-10T10:27:41.950 INFO:teuthology.orchestra.run.smithi187.stdout:(114/144): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2023-08-10T10:27:41.975 INFO:teuthology.orchestra.run.smithi187.stdout:(115/144): python3-repoze-lru-0.7-6.el8.noarch. 674 kB/s | 34 kB 00:00 2023-08-10T10:27:41.977 INFO:teuthology.orchestra.run.smithi088.stdout:(101/144): python3-asyncssh-2.7.0-2.el8.noarch. 3.3 MB/s | 476 kB 00:00 2023-08-10T10:27:42.003 INFO:teuthology.orchestra.run.smithi088.stdout:(102/144): python3-cachetools-3.1.1-4.el8.noarc 493 kB/s | 33 kB 00:00 2023-08-10T10:27:42.017 INFO:teuthology.orchestra.run.smithi187.stdout:(116/144): python3-kubernetes-11.0.0-6.el8.noar 4.5 MB/s | 1.2 MB 00:00 2023-08-10T10:27:42.037 INFO:teuthology.orchestra.run.smithi088.stdout:(103/144): python3-certifi-2018.10.15-7.el8.noa 277 kB/s | 16 kB 00:00 2023-08-10T10:27:42.042 INFO:teuthology.orchestra.run.smithi187.stdout:(117/144): python3-rsa-4.9-2.el8.noarch.rpm 962 kB/s | 64 kB 00:00 2023-08-10T10:27:42.062 INFO:teuthology.orchestra.run.smithi088.stdout:(104/144): python3-beautifulsoup4-4.6.3-2.el8.1 1.2 MB/s | 185 kB 00:00 2023-08-10T10:27:42.068 INFO:teuthology.orchestra.run.smithi187.stdout:(118/144): python3-routes-2.4.1-12.el8.noarch.r 1.6 MB/s | 196 kB 00:00 2023-08-10T10:27:42.088 INFO:teuthology.orchestra.run.smithi088.stdout:(105/144): python3-cheroot-8.5.2-1.el8.noarch.r 2.0 MB/s | 173 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi187.stdout:(119/144): python3-simplegeneric-0.8.1-17.el8.n 249 kB/s | 19 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi187.stdout:(120/144): python3-singledispatch-3.4.0.3-18.el 316 kB/s | 24 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi187.stdout:(121/144): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi187.stdout:(122/144): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi187.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 3.0 MB/s | 255 kB 00:00 2023-08-10T10:27:42.213 INFO:teuthology.orchestra.run.smithi088.stdout:(106/144): python3-google-auth-1.1.1-10.el8.noa 1.9 MB/s | 81 kB 00:00 2023-08-10T10:27:42.214 INFO:teuthology.orchestra.run.smithi088.stdout:(107/144): python3-cherrypy-18.4.0-1.el8.noarch 4.1 MB/s | 384 kB 00:00 2023-08-10T10:27:42.214 INFO:teuthology.orchestra.run.smithi088.stdout:(108/144): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-08-10T10:27:42.214 INFO:teuthology.orchestra.run.smithi088.stdout:(109/144): python3-jaraco-functools-2.0-4.el8.n 233 kB/s | 18 kB 00:00 2023-08-10T10:27:42.214 INFO:teuthology.orchestra.run.smithi088.stdout:(110/144): python3-logutils-0.3.5-11.el8.noarch 975 kB/s | 49 kB 00:00 2023-08-10T10:27:42.228 INFO:teuthology.orchestra.run.smithi187.stdout:(124/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.9 MB/s | 251 kB 00:00 2023-08-10T10:27:42.230 INFO:teuthology.orchestra.run.smithi088.stdout:(111/144): python3-more-itertools-7.2.0-3.el8.n 1.2 MB/s | 59 kB 00:00 2023-08-10T10:27:42.256 INFO:teuthology.orchestra.run.smithi088.stdout:(112/144): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2023-08-10T10:27:42.287 INFO:teuthology.orchestra.run.smithi187.stdout:(125/144): python3-websocket-client-0.56.0-5.el 522 kB/s | 61 kB 00:00 2023-08-10T10:27:42.298 INFO:teuthology.orchestra.run.smithi088.stdout:(113/144): python3-kubernetes-11.0.0-6.el8.noar 7.0 MB/s | 1.2 MB 00:00 2023-08-10T10:27:42.312 INFO:teuthology.orchestra.run.smithi187.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 275 kB/s | 23 kB 00:00 2023-08-10T10:27:42.323 INFO:teuthology.orchestra.run.smithi088.stdout:(114/144): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-08-10T10:27:42.346 INFO:teuthology.orchestra.run.smithi187.stdout:(127/144): python3-webtest-2.0.33-1.el8.noarch. 598 kB/s | 85 kB 00:00 2023-08-10T10:27:42.348 INFO:teuthology.orchestra.run.smithi088.stdout:(115/144): python3-portend-2.6-1.el8.noarch.rpm 170 kB/s | 16 kB 00:00 2023-08-10T10:27:42.373 INFO:teuthology.orchestra.run.smithi088.stdout:(116/144): python3-repoze-lru-0.7-6.el8.noarch. 447 kB/s | 34 kB 00:00 2023-08-10T10:27:42.404 INFO:teuthology.orchestra.run.smithi088.stdout:(117/144): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-08-10T10:27:42.413 INFO:teuthology.orchestra.run.smithi187.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-08-10T10:27:42.424 INFO:teuthology.orchestra.run.smithi088.stdout:(118/144): python3-simplegeneric-0.8.1-17.el8.n 372 kB/s | 19 kB 00:00 2023-08-10T10:27:42.449 INFO:teuthology.orchestra.run.smithi088.stdout:(119/144): python3-singledispatch-3.4.0.3-18.el 480 kB/s | 24 kB 00:00 2023-08-10T10:27:42.474 INFO:teuthology.orchestra.run.smithi088.stdout:(120/144): python3-tempora-1.14.1-5.el8.noarch. 584 kB/s | 29 kB 00:00 2023-08-10T10:27:42.500 INFO:teuthology.orchestra.run.smithi088.stdout:(121/144): python3-trustme-0.6.0-4.el8.noarch.r 547 kB/s | 27 kB 00:00 2023-08-10T10:27:42.542 INFO:teuthology.orchestra.run.smithi088.stdout:(122/144): python3-routes-2.4.1-12.el8.noarch.r 1.0 MB/s | 196 kB 00:00 2023-08-10T10:27:42.601 INFO:teuthology.orchestra.run.smithi088.stdout:(123/144): python3-waitress-1.4.3-1.el8.noarch. 2.0 MB/s | 255 kB 00:00 2023-08-10T10:27:42.626 INFO:teuthology.orchestra.run.smithi088.stdout:(124/144): python3-webob-1.8.5-1.el8.1.noarch.r 2.0 MB/s | 251 kB 00:00 2023-08-10T10:27:42.651 INFO:teuthology.orchestra.run.smithi088.stdout:(125/144): python3-websocket-client-0.56.0-5.el 563 kB/s | 61 kB 00:00 2023-08-10T10:27:42.676 INFO:teuthology.orchestra.run.smithi088.stdout:(126/144): python3-zc-lockfile-2.0-2.el8.noarch 458 kB/s | 23 kB 00:00 2023-08-10T10:27:42.701 INFO:teuthology.orchestra.run.smithi088.stdout:(127/144): python3-webtest-2.0.33-1.el8.noarch. 850 kB/s | 85 kB 00:00 2023-08-10T10:27:42.777 INFO:teuthology.orchestra.run.smithi088.stdout:(128/144): thrift-0.13.0-2.el8.x86_64.rpm 14 MB/s | 1.7 MB 00:00 2023-08-10T10:27:42.830 INFO:teuthology.orchestra.run.smithi187.stdout:(129/144): librados2-18.0.0-5118.ga8bf445f.el8. 7.1 MB/s | 3.7 MB 00:00 2023-08-10T10:27:42.897 INFO:teuthology.orchestra.run.smithi187.stdout:(130/144): librbd1-18.0.0-5118.ga8bf445f.el8.x8 6.6 MB/s | 3.6 MB 00:00 2023-08-10T10:27:42.989 INFO:teuthology.orchestra.run.smithi187.stdout:(131/144): NetworkManager-initscripts-updown-1. 250 kB/s | 143 kB 00:00 2023-08-10T10:27:43.144 INFO:teuthology.orchestra.run.smithi088.stdout:(129/144): librbd1-18.0.0-5118.ga8bf445f.el8.x8 8.2 MB/s | 3.6 MB 00:00 2023-08-10T10:27:43.289 INFO:teuthology.orchestra.run.smithi187.stdout:(132/144): elfutils-libs-0.189-2.el8.x86_64.rpm 1.0 MB/s | 302 kB 00:00 2023-08-10T10:27:43.314 INFO:teuthology.orchestra.run.smithi187.stdout:(133/144): elfutils-debuginfod-client-0.189-2.e 157 kB/s | 76 kB 00:00 2023-08-10T10:27:43.377 INFO:teuthology.orchestra.run.smithi088.stdout:(130/144): librados2-18.0.0-5118.ga8bf445f.el8. 5.3 MB/s | 3.7 MB 00:00 2023-08-10T10:27:43.403 INFO:teuthology.orchestra.run.smithi088.stdout:(131/144): NetworkManager-initscripts-updown-1. 233 kB/s | 143 kB 00:00 2023-08-10T10:27:43.523 INFO:teuthology.orchestra.run.smithi187.stdout:(134/144): elfutils-libelf-0.189-2.el8.x86_64.r 370 kB/s | 232 kB 00:00 2023-08-10T10:27:43.598 INFO:teuthology.orchestra.run.smithi187.stdout:(135/144): iproute-6.2.0-2.el8.x86_64.rpm 2.8 MB/s | 880 kB 00:00 2023-08-10T10:27:43.620 INFO:teuthology.orchestra.run.smithi088.stdout:(132/144): elfutils-debuginfod-client-0.189-2.e 159 kB/s | 76 kB 00:00 2023-08-10T10:27:43.640 INFO:teuthology.orchestra.run.smithi187.stdout:(136/144): libblkid-2.32.1-42.el8.x86_64.rpm 677 kB/s | 220 kB 00:00 2023-08-10T10:27:43.645 INFO:teuthology.orchestra.run.smithi088.stdout:(133/144): elfutils-libelf-0.189-2.el8.x86_64.r 868 kB/s | 232 kB 00:00 2023-08-10T10:27:43.724 INFO:teuthology.orchestra.run.smithi187.stdout:(137/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2023-08-10T10:27:43.749 INFO:teuthology.orchestra.run.smithi187.stdout:(138/144): libmount-2.32.1-42.el8.x86_64.rpm 1.5 MB/s | 236 kB 00:00 2023-08-10T10:27:43.816 INFO:teuthology.orchestra.run.smithi187.stdout:(139/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.0 MB/s | 179 kB 00:00 2023-08-10T10:27:43.850 INFO:teuthology.orchestra.run.smithi187.stdout:(140/144): libuuid-2.32.1-42.el8.x86_64.rpm 785 kB/s | 98 kB 00:00 2023-08-10T10:27:43.945 INFO:teuthology.orchestra.run.smithi088.stdout:(134/144): iproute-6.2.0-2.el8.x86_64.rpm 2.6 MB/s | 880 kB 00:00 2023-08-10T10:27:43.966 INFO:teuthology.orchestra.run.smithi187.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 682 kB/s | 102 kB 00:00 2023-08-10T10:27:43.970 INFO:teuthology.orchestra.run.smithi088.stdout:(135/144): libblkid-2.32.1-42.el8.x86_64.rpm 678 kB/s | 220 kB 00:00 2023-08-10T10:27:44.000 INFO:teuthology.orchestra.run.smithi187.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 2.2 MB/s | 334 kB 00:00 2023-08-10T10:27:44.079 INFO:teuthology.orchestra.run.smithi088.stdout:(136/144): elfutils-libs-0.189-2.el8.x86_64.rpm 448 kB/s | 302 kB 00:00 2023-08-10T10:27:44.092 INFO:teuthology.orchestra.run.smithi187.stdout:(143/144): util-linux-2.32.1-42.el8.x86_64.rpm 7.6 MB/s | 2.6 MB 00:00 2023-08-10T10:27:44.105 INFO:teuthology.orchestra.run.smithi088.stdout:(137/144): libfdisk-2.32.1-42.el8.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2023-08-10T10:27:44.155 INFO:teuthology.orchestra.run.smithi088.stdout:(138/144): libmount-2.32.1-42.el8.x86_64.rpm 1.3 MB/s | 236 kB 00:00 2023-08-10T10:27:44.230 INFO:teuthology.orchestra.run.smithi088.stdout:(139/144): libuuid-2.32.1-42.el8.x86_64.rpm 786 kB/s | 98 kB 00:00 2023-08-10T10:27:44.255 INFO:teuthology.orchestra.run.smithi088.stdout:(140/144): libsmartcols-2.32.1-42.el8.x86_64.rp 1.0 MB/s | 179 kB 00:00 2023-08-10T10:27:44.342 INFO:teuthology.orchestra.run.smithi187.stdout:(144/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 2.9 MB/s | 1.1 MB 00:00 2023-08-10T10:27:44.347 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:27:44.347 INFO:teuthology.orchestra.run.smithi187.stdout:Total 1.4 MB/s | 213 MB 02:37 2023-08-10T10:27:44.356 INFO:teuthology.orchestra.run.smithi088.stdout:(141/144): util-linux-user-2.32.1-42.el8.x86_64 818 kB/s | 102 kB 00:00 2023-08-10T10:27:44.448 INFO:teuthology.orchestra.run.smithi088.stdout:(142/144): xfsdump-3.1.8-6.el8.x86_64.rpm 1.7 MB/s | 334 kB 00:00 2023-08-10T10:27:44.556 INFO:teuthology.orchestra.run.smithi088.stdout:(143/144): xfsprogs-5.0.0-12.el8.x86_64.rpm 5.4 MB/s | 1.1 MB 00:00 2023-08-10T10:27:44.640 INFO:teuthology.orchestra.run.smithi088.stdout:(144/144): util-linux-2.32.1-42.el8.x86_64.rpm 5.4 MB/s | 2.6 MB 00:00 2023-08-10T10:27:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-08-10T10:27:44.644 INFO:teuthology.orchestra.run.smithi088.stdout:Total 1.3 MB/s | 213 MB 02:37 2023-08-10T10:27:46.189 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-08-10T10:27:46.461 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-08-10T10:27:46.604 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-08-10T10:27:46.604 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-08-10T10:27:46.877 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-08-10T10:27:46.878 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-08-10T10:27:48.057 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-08-10T10:27:48.061 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-08-10T10:27:48.359 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-08-10T10:27:48.363 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-08-10T10:27:53.415 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-08-10T10:27:53.640 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-08-10T10:27:53.709 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-08-10T10:27:53.823 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-08-10T10:27:53.935 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: thrift-0.13.0-2.el8.x86_64 1/1 2023-08-10T10:27:53.951 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-10T10:27:54.039 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-10T10:27:54.144 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/160 2023-08-10T10:27:54.176 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-10T10:27:54.294 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-10T10:27:54.323 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-10T10:27:54.423 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libuuid-2.32.1-42.el8.x86_64 2/160 2023-08-10T10:27:54.474 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-08-10T10:27:54.606 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-10T10:27:54.665 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-08-10T10:27:54.710 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libblkid-2.32.1-42.el8.x86_64 3/160 2023-08-10T10:27:54.845 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-08-10T10:27:54.962 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 4/160 2023-08-10T10:27:55.018 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-10T10:27:55.186 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libelf-0.189-2.el8.x86_64 5/160 2023-08-10T10:27:55.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/160 2023-08-10T10:27:55.454 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-10T10:27:55.539 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-10T10:27:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:27:55.991 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 7/160 2023-08-10T10:27:56.072 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:27:56.180 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:27:56.242 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:27:56.380 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:27:56.576 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:27:56.631 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:27:56.696 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:27:56.830 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:27:56.878 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/160 2023-08-10T10:27:56.981 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:27:57.034 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-10T10:27:57.205 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:27:57.284 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-10T10:27:57.324 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:27:57.459 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-10T10:27:57.549 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/160 2023-08-10T10:27:57.576 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-10T10:27:57.713 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-10T10:27:57.775 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-08-10T10:27:57.953 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 12/160 2023-08-10T10:27:57.968 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-08-10T10:27:58.172 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-10T10:27:58.262 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 13/160 2023-08-10T10:27:58.410 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-08-10T10:27:58.496 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 14/160 2023-08-10T10:27:58.606 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-08-10T10:27:58.681 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 15/160 2023-08-10T10:27:58.725 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 18/160 2023-08-10T10:27:58.848 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 18/160 2023-08-10T10:27:59.000 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 19/160 2023-08-10T10:27:59.107 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libpq-13.5-1.el8.x86_64 16/160 2023-08-10T10:27:59.145 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 19/160 2023-08-10T10:27:59.327 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 17/160 2023-08-10T10:27:59.346 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-08-10T10:27:59.480 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 18/160 2023-08-10T10:27:59.491 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-08-10T10:27:59.601 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 18/160 2023-08-10T10:27:59.625 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-10T10:27:59.755 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 19/160 2023-08-10T10:27:59.815 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-10T10:27:59.898 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 19/160 2023-08-10T10:27:59.983 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-10T10:28:00.108 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 20/160 2023-08-10T10:28:00.262 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-21.el8.x86_64 21/160 2023-08-10T10:28:00.404 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-10T10:28:00.544 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/160 2023-08-10T10:28:00.664 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-10T10:28:00.696 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-10T10:28:00.858 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-08-10T10:28:01.360 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/160 2023-08-10T10:28:01.552 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-08-10T10:28:01.571 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.15-4.el8.x86_64 24/160 2023-08-10T10:28:01.769 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-10T10:28:02.272 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 24/160 2023-08-10T10:28:02.481 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-10T10:28:02.622 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-10T10:28:02.992 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-08-10T10:28:03.192 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-08-10T10:28:03.312 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 25/160 2023-08-10T10:28:03.357 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-08-10T10:28:03.569 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-08-10T10:28:03.672 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/160 2023-08-10T10:28:03.782 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 30/160 2023-08-10T10:28:03.855 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 27/160 2023-08-10T10:28:03.921 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 31/160 2023-08-10T10:28:04.011 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 28/160 2023-08-10T10:28:04.175 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 32/160 2023-08-10T10:28:04.199 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/160 2023-08-10T10:28:04.436 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 30/160 2023-08-10T10:28:04.600 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 31/160 2023-08-10T10:28:04.846 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 32/160 2023-08-10T10:28:05.245 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-08-10T10:28:05.582 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-08-10T10:28:05.885 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-08-10T10:28:05.919 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 33/160 2023-08-10T10:28:06.066 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-10T10:28:06.258 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 34/160 2023-08-10T10:28:06.573 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 35/160 2023-08-10T10:28:06.770 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-10T10:28:08.165 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-10T10:28:08.503 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-08-10T10:28:08.672 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-08-10T10:28:08.835 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 36/160 2023-08-10T10:28:08.870 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-08-10T10:28:09.048 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 40/160 2023-08-10T10:28:09.123 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 37/160 2023-08-10T10:28:09.222 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 41/160 2023-08-10T10:28:09.377 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/160 2023-08-10T10:28:09.399 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-08-10T10:28:09.565 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el8.noarch 39/160 2023-08-10T10:28:09.594 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-08-10T10:28:09.752 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 40/160 2023-08-10T10:28:09.798 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-10T10:28:09.894 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-10T10:28:09.939 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 41/160 2023-08-10T10:28:10.065 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-08-10T10:28:10.116 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-libs-0.189-2.el8.x86_64 42/160 2023-08-10T10:28:10.135 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-08-10T10:28:10.278 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-08-10T10:28:10.303 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : elfutils-debuginfod-client-0.189-2.el8.x86_64 43/160 2023-08-10T10:28:10.440 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-10T10:28:10.560 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-10T10:28:10.655 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libfdisk-2.32.1-42.el8.x86_64 44/160 2023-08-10T10:28:10.844 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libmount-2.32.1-42.el8.x86_64 45/160 2023-08-10T10:28:10.922 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libmount-2.32.1-42.el8.x86_64 45/160 2023-08-10T10:28:11.024 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-10T10:28:11.073 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.32.1-42.el8.x86_64 46/160 2023-08-10T10:28:11.261 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-10T10:28:11.582 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-10T10:28:11.611 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-10T10:28:11.827 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libsmartcols-2.32.1-42.el8.x86_64 47/160 2023-08-10T10:28:11.833 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-08-10T10:28:12.096 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-08-10T10:28:12.119 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-10T10:28:12.148 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: util-linux-2.32.1-42.el8.x86_64 48/160 2023-08-10T10:28:12.326 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-08-10T10:28:12.361 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 49/160 2023-08-10T10:28:12.470 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-08-10T10:28:12.629 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-08-10T10:28:12.857 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-08-10T10:28:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 50/160 2023-08-10T10:28:13.076 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-08-10T10:28:13.237 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 51/160 2023-08-10T10:28:13.282 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-08-10T10:28:13.408 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 52/160 2023-08-10T10:28:13.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-08-10T10:28:13.575 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 53/160 2023-08-10T10:28:13.631 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-08-10T10:28:13.769 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 54/160 2023-08-10T10:28:13.855 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-08-10T10:28:13.962 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 55/160 2023-08-10T10:28:14.031 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-08-10T10:28:14.160 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 56/160 2023-08-10T10:28:14.184 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-08-10T10:28:14.361 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-08-10T10:28:14.364 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 57/160 2023-08-10T10:28:14.510 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 58/160 2023-08-10T10:28:14.610 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-08-10T10:28:14.667 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 59/160 2023-08-10T10:28:14.859 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 60/160 2023-08-10T10:28:14.873 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-08-10T10:28:15.021 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 61/160 2023-08-10T10:28:15.099 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-08-10T10:28:15.197 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 62/160 2023-08-10T10:28:15.436 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-08-10T10:28:15.460 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 63/160 2023-08-10T10:28:15.691 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 64/160 2023-08-10T10:28:15.708 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-08-10T10:28:15.910 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 65/160 2023-08-10T10:28:15.911 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-08-10T10:28:16.258 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 66/160 2023-08-10T10:28:16.520 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 67/160 2023-08-10T10:28:16.738 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 68/160 2023-08-10T10:28:16.765 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-08-10T10:28:16.956 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 70/160 2023-08-10T10:28:17.037 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 70/160 2023-08-10T10:28:17.275 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 71/160 2023-08-10T10:28:17.519 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-08-10T10:28:17.561 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 69/160 2023-08-10T10:28:17.767 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 70/160 2023-08-10T10:28:17.888 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 70/160 2023-08-10T10:28:17.906 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-08-10T10:28:18.094 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 71/160 2023-08-10T10:28:18.163 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-08-10T10:28:18.354 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-08-10T10:28:18.395 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 72/160 2023-08-10T10:28:18.608 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-08-10T10:28:18.805 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 73/160 2023-08-10T10:28:18.832 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-08-10T10:28:19.083 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 74/160 2023-08-10T10:28:19.257 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 75/160 2023-08-10T10:28:19.494 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 76/160 2023-08-10T10:28:19.702 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 77/160 2023-08-10T10:28:20.107 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-08-10T10:28:20.507 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-08-10T10:28:20.712 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-08-10T10:28:20.948 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-08-10T10:28:21.009 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/160 2023-08-10T10:28:21.247 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-08-10T10:28:21.394 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/160 2023-08-10T10:28:21.541 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-08-10T10:28:21.646 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 80/160 2023-08-10T10:28:21.760 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-08-10T10:28:21.906 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 81/160 2023-08-10T10:28:21.936 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-08-10T10:28:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 82/160 2023-08-10T10:28:22.270 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-08-10T10:28:22.494 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-08-10T10:28:22.495 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 83/160 2023-08-10T10:28:22.690 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-08-10T10:28:22.779 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 84/160 2023-08-10T10:28:22.856 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-08-10T10:28:22.993 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-3.el8.x86_64 85/160 2023-08-10T10:28:23.166 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-08-10T10:28:23.357 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-3.el8.x86_64 86/160 2023-08-10T10:28:23.409 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-08-10T10:28:23.561 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-08-10T10:28:23.622 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-3.el8.x86_64 87/160 2023-08-10T10:28:23.777 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 88/160 2023-08-10T10:28:23.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-08-10T10:28:23.994 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.2-2.el8.x86_64 89/160 2023-08-10T10:28:23.999 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-08-10T10:28:24.208 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-08-10T10:28:24.351 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 90/160 2023-08-10T10:28:24.399 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-08-10T10:28:24.563 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-08-10T10:28:24.588 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-8.el8.x86_64 91/160 2023-08-10T10:28:24.673 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-08-10T10:28:24.756 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.45.6-5.el8.x86_64 92/160 2023-08-10T10:28:24.864 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-08-10T10:28:24.949 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 93/160 2023-08-10T10:28:24.988 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-08-10T10:28:25.210 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.18.2-22.el8.x86_64 94/160 2023-08-10T10:28:25.434 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-17.el8.x86_64 95/160 2023-08-10T10:28:25.655 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 96/160 2023-08-10T10:28:25.824 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : uuid-1.6.2-43.el8.x86_64 97/160 2023-08-10T10:28:25.950 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 97/160 2023-08-10T10:28:26.159 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 98/160 2023-08-10T10:28:26.291 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 99/160 2023-08-10T10:28:27.801 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:28.054 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:28.733 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:29.097 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 101/160 2023-08-10T10:28:29.181 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:29.286 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 101/160 2023-08-10T10:28:29.440 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:29.470 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 102/160 2023-08-10T10:28:30.111 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 100/160 2023-08-10T10:28:30.430 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 101/160 2023-08-10T10:28:30.631 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 101/160 2023-08-10T10:28:30.840 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 102/160 2023-08-10T10:28:50.027 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 102/160 2023-08-10T10:28:50.027 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-08-10T10:28:50.027 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-08-10T10:28:50.028 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-08-10T10:28:50.029 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:28:50.425 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 103/160 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 102/160 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-08-10T10:28:51.289 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-08-10T10:28:51.290 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-08-10T10:28:51.290 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-08-10T10:28:51.290 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-08-10T10:28:51.290 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-08-10T10:28:51.290 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:28:51.727 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 103/160 2023-08-10T10:28:52.171 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 103/160 2023-08-10T10:28:52.401 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 104/160 2023-08-10T10:28:52.669 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 104/160 2023-08-10T10:28:52.850 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 105/160 2023-08-10T10:28:53.378 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 105/160 2023-08-10T10:28:53.471 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 103/160 2023-08-10T10:28:53.583 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 106/160 2023-08-10T10:28:53.632 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 106/160 2023-08-10T10:28:53.699 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 104/160 2023-08-10T10:28:53.849 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-08-10T10:28:53.969 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 104/160 2023-08-10T10:28:54.071 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-08-10T10:28:54.143 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 105/160 2023-08-10T10:28:54.249 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-10T10:28:54.342 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-10T10:28:54.634 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-08-10T10:28:54.671 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 105/160 2023-08-10T10:28:54.868 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 106/160 2023-08-10T10:28:54.883 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-08-10T10:28:54.918 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 106/160 2023-08-10T10:28:55.151 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 107/160 2023-08-10T10:28:55.373 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 108/160 2023-08-10T10:28:55.515 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 112/160 2023-08-10T10:28:55.551 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-10T10:28:55.650 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 109/160 2023-08-10T10:28:55.695 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 112/160 2023-08-10T10:28:55.815 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 113/160 2023-08-10T10:28:55.961 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.6-7.el8.x86_64 110/160 2023-08-10T10:28:56.029 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 114/160 2023-08-10T10:28:56.176 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.1-7.el8.noarch 111/160 2023-08-10T10:28:56.232 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 115/160 2023-08-10T10:28:56.490 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 115/160 2023-08-10T10:28:56.708 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 116/160 2023-08-10T10:28:56.800 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 112/160 2023-08-10T10:28:56.951 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 112/160 2023-08-10T10:28:57.100 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 113/160 2023-08-10T10:28:57.321 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 114/160 2023-08-10T10:28:57.576 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 115/160 2023-08-10T10:28:57.826 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 116/160 2023-08-10T10:28:57.830 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 115/160 2023-08-10T10:28:57.998 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 117/160 2023-08-10T10:28:58.073 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 116/160 2023-08-10T10:28:58.127 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 117/160 2023-08-10T10:28:58.518 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 118/160 2023-08-10T10:28:58.750 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/160 2023-08-10T10:28:58.815 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/160 2023-08-10T10:28:58.993 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 120/160 2023-08-10T10:28:59.017 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 120/160 2023-08-10T10:28:59.181 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 116/160 2023-08-10T10:28:59.211 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 121/160 2023-08-10T10:28:59.356 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-08-10T10:28:59.375 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 117/160 2023-08-10T10:28:59.500 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 117/160 2023-08-10T10:28:59.902 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 118/160 2023-08-10T10:29:00.098 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/160 2023-08-10T10:29:00.162 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 119/160 2023-08-10T10:29:00.333 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 120/160 2023-08-10T10:29:00.360 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 120/160 2023-08-10T10:29:00.562 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 121/160 2023-08-10T10:29:00.708 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-25.el8.x86_64 122/160 2023-08-10T10:29:04.360 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-08-10T10:29:05.693 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 122/160 2023-08-10T10:29:05.922 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 123/160 2023-08-10T10:29:06.182 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 124/160 2023-08-10T10:29:06.244 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 124/160 2023-08-10T10:29:06.438 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 125/160 2023-08-10T10:29:06.509 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 125/160 2023-08-10T10:29:06.697 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/160 2023-08-10T10:29:07.114 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/160 2023-08-10T10:29:07.255 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 123/160 2023-08-10T10:29:07.322 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 127/160 2023-08-10T10:29:07.488 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 124/160 2023-08-10T10:29:07.550 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 124/160 2023-08-10T10:29:07.595 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 127/160 2023-08-10T10:29:07.723 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 125/160 2023-08-10T10:29:07.794 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 125/160 2023-08-10T10:29:07.919 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-08-10T10:29:08.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/160 2023-08-10T10:29:08.422 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 126/160 2023-08-10T10:29:08.656 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 127/160 2023-08-10T10:29:08.934 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 127/160 2023-08-10T10:29:09.140 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/160 2023-08-10T10:29:09.268 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-contrib-10.23-1.module_el8+300+2c5300 128/160 2023-08-10T10:29:09.469 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-08-10T10:29:09.686 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-08-10T10:29:09.901 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-08-10T10:29:10.052 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-08-10T10:29:10.222 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 134/160 2023-08-10T10:29:10.504 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/160 2023-08-10T10:29:10.853 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1k-9.el8.x86_64 130/160 2023-08-10T10:29:11.054 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.189-2.el8.x86_64 131/160 2023-08-10T10:29:11.269 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : util-linux-user-2.32.1-42.el8.x86_64 132/160 2023-08-10T10:29:11.444 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/160 2023-08-10T10:29:11.446 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:11.640 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 134/160 2023-08-10T10:29:11.696 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:11.784 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:12.023 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-08-10T10:29:12.238 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 137/160 2023-08-10T10:29:12.422 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 138/160 2023-08-10T10:29:12.762 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 139/160 2023-08-10T10:29:12.869 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:13.048 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-08-10T10:29:13.114 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:13.202 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: postgresql-server-10.23-1.module_el8+300+2c53004 135/160 2023-08-10T10:29:13.213 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-10T10:29:13.240 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-10T10:29:13.437 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-08-10T10:29:13.452 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 136/160 2023-08-10T10:29:13.670 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-08-10T10:29:13.697 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 137/160 2023-08-10T10:29:13.780 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-08-10T10:29:13.931 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 138/160 2023-08-10T10:29:13.995 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-08-10T10:29:14.022 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-08-10T10:29:14.213 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-08-10T10:29:14.275 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 139/160 2023-08-10T10:29:14.407 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-08-10T10:29:14.574 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : iproute-6.2.0-2.el8.x86_64 140/160 2023-08-10T10:29:14.575 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-08-10T10:29:14.575 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-10T10:29:14.727 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-10T10:29:14.751 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-8.el 141/160 2023-08-10T10:29:14.850 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-10T10:29:14.850 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-10T10:29:14.958 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 142/160 2023-08-10T10:29:15.065 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-10T10:29:15.081 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-10T10:29:15.213 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/160 2023-08-10T10:29:15.218 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-10T10:29:15.218 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-10T10:29:15.325 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/160 2023-08-10T10:29:15.475 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-10T10:29:15.546 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/160 2023-08-10T10:29:15.573 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/160 2023-08-10T10:29:15.647 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-08-10T10:29:15.811 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-08-10T10:29:15.831 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-debuginfod-client-0.189-1.el8.x86_64 145/160 2023-08-10T10:29:16.013 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-10T10:29:16.014 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-10T10:29:16.038 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libs-0.189-1.el8.x86_64 146/160 2023-08-10T10:29:16.218 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 147/160 2023-08-10T10:29:16.218 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-10T10:29:16.232 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-10T10:29:16.232 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:16.414 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:16.415 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-10T10:29:16.509 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 148/160 2023-08-10T10:29:16.509 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-10T10:29:16.614 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-10T10:29:16.615 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-10T10:29:16.741 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 149/160 2023-08-10T10:29:16.757 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-10T10:29:16.789 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-10T10:29:16.789 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-10T10:29:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : NetworkManager-initscripts-updown-1:1.40.16-4.el 150/160 2023-08-10T10:29:16.878 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-10T10:29:16.964 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-10T10:29:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-10T10:29:17.138 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 151/160 2023-08-10T10:29:17.323 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : iproute-6.2.0-1.el8.x86_64 152/160 2023-08-10T10:29:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-10T10:29:17.345 INFO:teuthology.orchestra.run.smithi187.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:29:17.345 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:17.502 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : util-linux-user-2.32.1-41.el8.x86_64 153/160 2023-08-10T10:29:17.748 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-10T10:29:17.748 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-10T10:29:17.990 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libfdisk-2.32.1-41.el8.x86_64 155/160 2023-08-10T10:29:17.994 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libmount-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:18.068 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/160 2023-08-10T10:29:18.069 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/160 2023-08-10T10:29:18.069 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/160 2023-08-10T10:29:18.069 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/160 2023-08-10T10:29:18.069 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/160 2023-08-10T10:29:18.069 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/160 2023-08-10T10:29:18.070 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/160 2023-08-10T10:29:18.071 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/160 2023-08-10T10:29:18.072 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/160 2023-08-10T10:29:18.073 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/160 2023-08-10T10:29:18.073 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/160 2023-08-10T10:29:18.073 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/160 2023-08-10T10:29:18.073 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/160 2023-08-10T10:29:18.083 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/160 2023-08-10T10:29:18.084 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-08-10T10:29:18.085 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-08-10T10:29:18.086 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-08-10T10:29:18.086 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-08-10T10:29:18.086 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-08-10T10:29:18.086 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-08-10T10:29:18.086 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-08-10T10:29:18.087 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-08-10T10:29:18.088 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-08-10T10:29:18.089 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-08-10T10:29:18.090 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-08-10T10:29:18.091 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-08-10T10:29:18.092 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-08-10T10:29:18.093 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-08-10T10:29:18.094 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-08-10T10:29:18.095 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-08-10T10:29:18.096 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-08-10T10:29:18.097 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-08-10T10:29:18.098 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-08-10T10:29:18.099 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-08-10T10:29:18.100 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-08-10T10:29:18.101 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-08-10T10:29:18.266 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libmount-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:18.266 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-10T10:29:18.490 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libblkid-2.32.1-41.el8.x86_64 157/160 2023-08-10T10:29:18.491 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-10T10:29:18.732 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libuuid-2.32.1-41.el8.x86_64 158/160 2023-08-10T10:29:18.733 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-10T10:29:18.957 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libsmartcols-2.32.1-41.el8.x86_64 159/160 2023-08-10T10:29:19.130 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-10T10:29:19.361 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: elfutils-libelf-0.189-1.el8.x86_64 160/160 2023-08-10T10:29:19.384 INFO:teuthology.orchestra.run.smithi088.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-08-10T10:29:19.385 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 1/160 2023-08-10T10:29:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2/160 2023-08-10T10:29:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 3/160 2023-08-10T10:29:20.078 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 4/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5118.ga8bf4 5/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 6/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 7/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 8/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 9/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 10/160 2023-08-10T10:29:20.079 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 11/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 12/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 13/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_ 14/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 15/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 16/160 2023-08-10T10:29:20.080 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_6 17/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86 18/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 19/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el 20/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8. 21/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_6 22/160 2023-08-10T10:29:20.081 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 23/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 24/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 25/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 26/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 27/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 28/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f. 29/160 2023-08-10T10:29:20.082 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noa 30/160 2023-08-10T10:29:20.083 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.n 31/160 2023-08-10T10:29:20.092 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8b 32/160 2023-08-10T10:29:20.092 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el 33/160 2023-08-10T10:29:20.092 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 34/160 2023-08-10T10:29:20.092 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.e 35/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 36/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 37/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 38/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.1-7.el8.noarch 39/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 40/160 2023-08-10T10:29:20.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 41/160 2023-08-10T10:29:20.094 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.6-7.el8.x86_64 42/160 2023-08-10T10:29:20.094 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libpq-13.5-1.el8.x86_64 43/160 2023-08-10T10:29:20.094 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 44/160 2023-08-10T10:29:20.094 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 45/160 2023-08-10T10:29:20.094 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 46/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 47/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 48/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 49/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-10.23-1.module_el8+300+2c53004c.x86_6 50/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-contrib-10.23-1.module_el8+300+2c5300 51/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : postgresql-server-10.23-1.module_el8+300+2c53004 52/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 53/160 2023-08-10T10:29:20.095 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 54/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 55/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 56/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 57/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 58/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 59/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 60/160 2023-08-10T10:29:20.096 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 61/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 62/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 63/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 64/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 65/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 66/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 67/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 68/160 2023-08-10T10:29:20.097 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 69/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 70/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.189-2.el8.x86_64 71/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 72/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 73/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.18.2-22.el8.x86_64 74/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 75/160 2023-08-10T10:29:20.098 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.45.6-5.el8.x86_64 76/160 2023-08-10T10:29:20.099 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 77/160 2023-08-10T10:29:20.099 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 78/160 2023-08-10T10:29:20.099 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 79/160 2023-08-10T10:29:20.099 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-8.el8.x86_64 80/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 81/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.32.1-42.el8.x86_64 82/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.2-2.el8.x86_64 83/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 84/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8.x86_64 85/160 2023-08-10T10:29:20.100 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-3.el8.x86_64 86/160 2023-08-10T10:29:20.101 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-3.el8.x86_64 87/160 2023-08-10T10:29:20.101 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-3.el8.x86_64 88/160 2023-08-10T10:29:20.101 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 89/160 2023-08-10T10:29:20.101 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 90/160 2023-08-10T10:29:20.101 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 91/160 2023-08-10T10:29:20.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 92/160 2023-08-10T10:29:20.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 93/160 2023-08-10T10:29:20.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 94/160 2023-08-10T10:29:20.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/160 2023-08-10T10:29:20.102 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-21.el8.x86_64 96/160 2023-08-10T10:29:20.103 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 97/160 2023-08-10T10:29:20.103 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 98/160 2023-08-10T10:29:20.104 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 99/160 2023-08-10T10:29:20.104 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 100/160 2023-08-10T10:29:20.104 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 101/160 2023-08-10T10:29:20.105 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 102/160 2023-08-10T10:29:20.105 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 103/160 2023-08-10T10:29:20.106 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 104/160 2023-08-10T10:29:20.106 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 105/160 2023-08-10T10:29:20.106 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 106/160 2023-08-10T10:29:20.107 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 107/160 2023-08-10T10:29:20.107 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 108/160 2023-08-10T10:29:20.107 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 109/160 2023-08-10T10:29:20.107 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 110/160 2023-08-10T10:29:20.108 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 111/160 2023-08-10T10:29:20.108 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 112/160 2023-08-10T10:29:20.108 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 113/160 2023-08-10T10:29:20.109 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 114/160 2023-08-10T10:29:20.109 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 115/160 2023-08-10T10:29:20.109 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 116/160 2023-08-10T10:29:20.109 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 117/160 2023-08-10T10:29:20.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 118/160 2023-08-10T10:29:20.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 119/160 2023-08-10T10:29:20.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 120/160 2023-08-10T10:29:20.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 121/160 2023-08-10T10:29:20.110 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 122/160 2023-08-10T10:29:20.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 123/160 2023-08-10T10:29:20.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 124/160 2023-08-10T10:29:20.111 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 125/160 2023-08-10T10:29:20.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 126/160 2023-08-10T10:29:20.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 127/160 2023-08-10T10:29:20.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 128/160 2023-08-10T10:29:20.112 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 129/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 131/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-8.el 133/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-4.el 134/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-2.el8.x86_64 135/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-debuginfod-client-0.189-1.el8.x86_64 136/160 2023-08-10T10:29:20.113 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-2.el8.x86_64 137/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-0.189-1.el8.x86_64 138/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-2.el8.x86_64 139/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libs-0.189-1.el8.x86_64 140/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-6.2.0-2.el8.x86_64 141/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : iproute-6.2.0-1.el8.x86_64 142/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libblkid-2.32.1-42.el8.x86_64 143/160 2023-08-10T10:29:20.114 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libblkid-2.32.1-41.el8.x86_64 144/160 2023-08-10T10:29:20.115 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libfdisk-2.32.1-42.el8.x86_64 145/160 2023-08-10T10:29:20.115 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libfdisk-2.32.1-41.el8.x86_64 146/160 2023-08-10T10:29:20.115 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libmount-2.32.1-42.el8.x86_64 147/160 2023-08-10T10:29:20.115 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libmount-2.32.1-41.el8.x86_64 148/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsmartcols-2.32.1-42.el8.x86_64 149/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsmartcols-2.32.1-41.el8.x86_64 150/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-2.32.1-42.el8.x86_64 151/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-2.32.1-41.el8.x86_64 152/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-2.32.1-42.el8.x86_64 153/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-2.32.1-41.el8.x86_64 154/160 2023-08-10T10:29:20.116 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-user-2.32.1-42.el8.x86_64 155/160 2023-08-10T10:29:20.117 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : util-linux-user-2.32.1-41.el8.x86_64 156/160 2023-08-10T10:29:20.117 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 157/160 2023-08-10T10:29:20.117 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 158/160 2023-08-10T10:29:20.117 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 159/160 2023-08-10T10:29:20.245 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-08-10T10:29:20.245 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:20.245 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-10T10:29:20.246 INFO:teuthology.orchestra.run.smithi187.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.247 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.248 INFO:teuthology.orchestra.run.smithi187.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.248 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-10T10:29:20.248 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.249 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.250 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.251 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:29:20.252 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-7.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.253 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.254 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:29:20.255 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-10T10:29:20.256 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:29:20.257 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.258 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:29:20.259 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:29:20.260 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:29:20.261 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:29:20.262 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:29:20.263 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:29:20.264 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-10T10:29:20.264 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:29:20.264 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:29:20.264 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:29:20.265 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:29:20.266 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-10T10:29:20.267 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:29:20.267 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-10T10:29:20.267 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:20.267 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-08-10T10:29:20.553 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:22.222 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 160/160 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout: NetworkManager-initscripts-updown-1:1.40.16-8.el8.noarch 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-debuginfod-client-0.189-2.el8.x86_64 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-0.189-2.el8.x86_64 2023-08-10T10:29:22.223 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libs-0.189-2.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: iproute-6.2.0-2.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: libblkid-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: libfdisk-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: libmount-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.224 INFO:teuthology.orchestra.run.smithi088.stdout: libsmartcols-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: util-linux-user-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.1-7.el8.noarch 2023-08-10T10:29:22.225 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.226 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.227 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.228 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:18.0.0-5118.ga8bf445f.el8.noarch 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.189-2.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-17.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.6-7.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.18.2-22.el8.x86_64 2023-08-10T10:29:22.229 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.45.6-5.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-10T10:29:22.230 INFO:teuthology.orchestra.run.smithi088.stdout: libpq-13.5-1.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.231 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-8.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.32.1-42.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.2-2.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-08-10T10:29:22.232 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.15-4.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.15-4.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1k-9.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-3.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-3.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-3.el8.x86_64 2023-08-10T10:29:22.233 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-contrib-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: postgresql-server-10.23-1.module_el8+300+2c53004c.x86_64 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-10T10:29:22.234 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-08-10T10:29:22.235 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-10T10:29:22.236 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-14.el8.noarch 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-10T10:29:22.237 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-10T10:29:22.238 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.239 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-10T10:29:22.240 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.241 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:18.0.0-5118.ga8bf445f.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-10T10:29:22.242 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-21.el8.x86_64 2023-08-10T10:29:22.243 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:22.243 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-08-10T10:29:22.513 DEBUG:teuthology.parallel:result is None 2023-08-10T10:29:22.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:29:22.736 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:29:22.792 INFO:teuthology.orchestra.run.smithi088.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:29:22.793 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:29:22.794 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:29:22.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:29:22.936 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-10T10:29:22.992 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-5118.ga8bf445f.el8 2023-08-10T10:29:22.992 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5118.ga8bf445f.el8 2023-08-10T10:29:22.993 INFO:teuthology.task.install:The correct ceph version 18.0.0-5118.ga8bf445f is installed. 2023-08-10T10:29:22.993 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-10T10:29:22.994 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:22.995 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:29:23.071 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:23.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-10T10:29:23.149 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-10T10:29:23.149 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:23.150 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:29:23.220 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:29:23.330 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:23.330 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-08-10T10:29:23.401 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-10T10:29:23.515 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-10T10:29:23.515 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:23.516 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:29:23.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:29:23.697 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:23.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-10T10:29:23.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-10T10:29:23.877 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-10T10:29:23.877 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:23.878 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:29:23.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:29:24.060 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:24.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-08-10T10:29:24.129 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-10T10:29:24.237 INFO:teuthology.run_tasks:Running task ceph... 2023-08-10T10:29:24.327 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-10T10:29:24.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-08-10T10:29:24.332 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-08-10T10:29:24.402 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-10T10:29:24.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:29:24.407 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-10T10:29:24.476 INFO:tasks.ceph:Creating extra log directories... 2023-08-10T10:29:24.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:29:24.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-10T10:29:24.557 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-10T10:29:24.558 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-10T10:29:24.558 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-10T10:29:24.558 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:24.559 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:29:24.605 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:25.060 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:25.131 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:25.131 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-10T10:29:25.178 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:25.388 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:25.467 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-10T10:29:25.468 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-10T10:29:25.468 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552', 'branch': 'wip-rishabh-2023Aug1-3', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota}', 'email': None, 'first_in_suite': False, 'job_id': '7364552', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-2023Aug1-3'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-2023Aug1-3', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-rishabh-2023Aug1-3', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wpnKCIikdp0BqxJqI/9xcGy/x9i/pb84v8jm6pptJQjZTRhXYHyv0PqPh22WebOF1YopHoYEz9Bh0rBS6NRc=', 'smithi187.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDg3yWpJ25I1+DYhU8GPbrnjwI2ohh4qrbh9pKYPWEsLIOqEcQO2XhiRIHsU1i7fIgnBGnToa6wL7m0woVaxa10A/B5el4Awi5tBKdk3kaFgQ5qt5dbbqfhe29MyVc119Uy4mrxx4Xc3zo1Cqyy1fSTUsIhI6es9ny/j63ErK5H+khOnsL8nTSB9fJusgz7eM+6mNzOpj772bw6Y8pyxhFyP8OQlerWf2unlfSPecI1u3HQVVvQA//tPNYbwIZwGIqDK62vn+CIgGm3OYged002Gqr4dUwJiUwXeqxVU1SNwx1Ad/r5MtbukP5IMSi/ywXR/hDnvC43xN55p9z6Ui0bV8HoakfM4HzJ/ZUbJeR7lm6/7GT/YxmnXtDYIEf+Lgt1QnqWLEZk5BfGpESTbCZDoefJ2qmfe7PsjK8z8NeZcKwwdPrp3m5oAyS273F3qdNxrGH8kmY1H6SIwS9xyxo3tVDMtCa9Fm26i7TlK4nZZ9j4YuNn4ZUqLyeSnkXZP7s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a7fb1265323db972dd333f71b9a53e9479f62e37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'}}, {'ceph': None}, {'kclient': None}, {'workunit': {'clients': {'all': ['fs/quota']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '7fda95956ac10132c9b74016ba832db907df09fa', 'timestamp': '2023-08-10_09:50:44', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-10T10:29:25.469 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:29:25.474 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-10T10:29:25.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:29:25.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-08-10T10:29:25.604 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:25.605 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:29:25.653 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:29:25.654 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-08-10T10:29:25.742 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:29:25.742 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:25.742 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 444 Links: 1 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-08-10 10:29:19.574811397 +0000 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:19:09.965240203 +0000 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:19:09.965240203 +0000 2023-08-10T10:29:25.743 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:19:09.934240821 +0000 2023-08-10T10:29:25.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:29:25.810 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-08-10T10:29:25.811 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-08-10T10:29:25.811 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000278992 s, 1.8 MB/s 2023-08-10T10:29:25.813 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:29:25.861 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-08-10T10:29:25.906 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:29:25.907 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:25.907 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-08-10T10:29:25.907 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:25.907 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:25.907 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-08-10 10:29:19.574811397 +0000 2023-08-10T10:29:25.908 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:19:10.807223409 +0000 2023-08-10T10:29:25.908 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:19:10.807223409 +0000 2023-08-10T10:29:25.908 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:19:10.780223948 +0000 2023-08-10T10:29:25.908 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:29:26.013 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-08-10T10:29:26.014 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-08-10T10:29:26.014 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000285814 s, 1.8 MB/s 2023-08-10T10:29:26.016 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:29:26.065 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-08-10T10:29:26.111 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-08-10 10:29:19.574811397 +0000 2023-08-10T10:29:26.112 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:19:11.666206277 +0000 2023-08-10T10:29:26.113 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:19:11.666206277 +0000 2023-08-10T10:29:26.113 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:19:11.642206755 +0000 2023-08-10T10:29:26.113 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:29:26.182 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-08-10T10:29:26.182 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-08-10T10:29:26.182 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000289305 s, 1.8 MB/s 2023-08-10T10:29:26.184 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:29:26.233 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-08-10T10:29:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:29:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:26.281 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-08-10 10:29:19.574811397 +0000 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:19:12.510189443 +0000 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:19:12.510189443 +0000 2023-08-10T10:29:26.282 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:19:12.484189962 +0000 2023-08-10T10:29:26.283 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:29:26.350 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-08-10T10:29:26.350 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-08-10T10:29:26.350 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000281804 s, 1.8 MB/s 2023-08-10T10:29:26.352 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:29:26.402 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:26.403 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:26.403 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-08-10T10:29:26.451 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-10T10:29:26.451 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-08-10T10:29:26.539 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-10T10:29:26.539 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:26.539 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 448 Links: 1 2023-08-10T10:29:26.539 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:26.539 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:26.540 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-08-10 10:29:17.561379712 +0000 2023-08-10T10:29:26.540 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:19:10.416392515 +0000 2023-08-10T10:29:26.540 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:19:10.416392515 +0000 2023-08-10T10:29:26.540 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:19:10.390392908 +0000 2023-08-10T10:29:26.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-10T10:29:26.610 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-08-10T10:29:26.610 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-08-10T10:29:26.610 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000289083 s, 1.8 MB/s 2023-08-10T10:29:26.613 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-10T10:29:26.663 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 454 Links: 1 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:26.711 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-08-10 10:29:17.561379712 +0000 2023-08-10T10:29:26.712 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:19:11.257379771 +0000 2023-08-10T10:29:26.712 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:19:11.257379771 +0000 2023-08-10T10:29:26.712 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:19:11.234380119 +0000 2023-08-10T10:29:26.712 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-10T10:29:26.783 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-08-10T10:29:26.783 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-08-10T10:29:26.784 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000270036 s, 1.9 MB/s 2023-08-10T10:29:26.786 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-10T10:29:26.837 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-08-10T10:29:26.883 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-10T10:29:26.883 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:26.884 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 460 Links: 1 2023-08-10T10:29:26.884 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:26.884 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:26.885 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-08-10 10:29:17.562379696 +0000 2023-08-10T10:29:26.885 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:19:12.084367234 +0000 2023-08-10T10:29:26.885 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:19:12.084367234 +0000 2023-08-10T10:29:26.885 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:19:12.057367644 +0000 2023-08-10T10:29:26.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-10T10:29:26.991 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-08-10T10:29:26.992 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-08-10T10:29:26.992 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000266176 s, 1.9 MB/s 2023-08-10T10:29:26.993 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-10T10:29:27.044 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-08-10T10:29:27.091 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-10T10:29:27.092 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-10T10:29:27.092 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 466 Links: 1 2023-08-10T10:29:27.092 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:29:27.092 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-08-10T10:29:27.092 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-08-10 10:29:17.562379696 +0000 2023-08-10T10:29:27.093 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:19:12.922354531 +0000 2023-08-10T10:29:27.093 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:19:12.922354531 +0000 2023-08-10T10:29:27.093 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:19:12.893354971 +0000 2023-08-10T10:29:27.093 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-10T10:29:27.163 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-08-10T10:29:27.164 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-08-10T10:29:27.164 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000302255 s, 1.7 MB/s 2023-08-10T10:29:27.166 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-10T10:29:27.215 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:27.216 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:29:27.216 INFO:tasks.ceph:Generating config... 2023-08-10T10:29:27.217 INFO:tasks.ceph:[client] client mount timeout = 600 2023-08-10T10:29:27.218 INFO:tasks.ceph:[client] debug client = 20 2023-08-10T10:29:27.218 INFO:tasks.ceph:[client] debug ms = 1 2023-08-10T10:29:27.218 INFO:tasks.ceph:[client] pid file = 2023-08-10T10:29:27.219 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-08-10T10:29:27.219 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-08-10T10:29:27.219 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-08-10T10:29:27.219 INFO:tasks.ceph:[mds] debug mds = 20 2023-08-10T10:29:27.220 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-08-10T10:29:27.220 INFO:tasks.ceph:[mds] debug ms = 1 2023-08-10T10:29:27.220 INFO:tasks.ceph:[mds] mds debug frag = True 2023-08-10T10:29:27.220 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-08-10T10:29:27.220 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-08-10T10:29:27.221 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-08-10T10:29:27.221 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-08-10T10:29:27.221 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-08-10T10:29:27.221 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-08-10T10:29:27.222 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-10T10:29:27.222 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-10T10:29:27.222 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-10T10:29:27.222 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-10T10:29:27.223 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-10T10:29:27.223 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-08-10T10:29:27.223 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-10T10:29:27.223 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-10T10:29:27.224 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-10T10:29:27.224 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-10T10:29:27.224 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-10T10:29:27.224 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-10T10:29:27.224 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-10T10:29:27.225 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-10T10:29:27.225 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-10T10:29:27.225 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-10T10:29:27.225 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-10T10:29:27.225 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-10T10:29:27.226 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-08-10T10:29:27.226 INFO:tasks.ceph:Setting up mon.a... 2023-08-10T10:29:27.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-10T10:29:27.340 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.keyring 2023-08-10T10:29:27.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-10T10:29:27.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:29:27.523 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.88'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-08-10T10:29:27.524 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-08-10T10:29:27.525 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:27.525 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:29:27.572 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.88 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:27.704 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:27.704 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: generated fsid bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c 2023-08-10T10:29:27.704 INFO:teuthology.orchestra.run.smithi088.stdout:setting min_mon_release = pacific 2023-08-10T10:29:27.704 INFO:teuthology.orchestra.run.smithi088.stdout:epoch 0 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:fsid bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:last_changed 2023-08-10T10:29:27.704312+0000 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:created 2023-08-10T10:29:27.704312+0000 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:min_mon_release 16 (pacific) 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:election_strategy: 1 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-08-10T10:29:27.705 INFO:teuthology.orchestra.run.smithi088.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-08-10T10:29:27.706 INFO:teuthology.orchestra.run.smithi088.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-10T10:29:27.707 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-10T10:29:27.753 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c... 2023-08-10T10:29:27.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:29:27.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-10T10:29:27.876 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-08-10T10:29:27.876 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-08-10T10:29:27.876 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.877 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-08-10T10:29:27.878 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-08-10T10:29:27.878 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.878 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-08-10T10:29:27.878 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-08-10T10:29:27.878 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.879 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:29:27.879 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-08-10T10:29:27.879 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.879 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:29:27.879 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:29:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-08-10T10:29:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.880 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-08-10T10:29:27.881 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:29:27.882 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:29:27.882 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-08-10T10:29:27.882 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.882 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:29:27.882 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-08-10T10:29:27.883 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-08-10T10:29:27.884 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-08-10T10:29:27.884 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-08-10T10:29:27.884 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.885 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-08-10T10:29:27.886 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-08-10T10:29:27.886 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:29:27.886 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.886 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-08-10T10:29:27.886 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-08-10T10:29:27.887 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.888 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-08-10T10:29:27.889 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 20 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 20 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 10 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:29:27.890 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.891 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-08-10T10:29:27.892 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-08-10T10:29:27.892 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-08-10T10:29:27.892 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-08-10T10:29:27.892 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-08-10T10:29:27.892 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-08-10T10:29:27.893 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-08-10T10:29:27.894 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-08-10T10:29:27.894 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-08-10T10:29:27.894 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-08-10T10:29:27.894 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:29:27.894 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-08-10T10:29:27.895 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-08-10T10:29:27.895 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:29:27.895 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.895 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:29:27.895 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:29:27.896 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:29:27.896 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.896 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:29:27.897 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-08-10T10:29:27.898 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = "" 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-08-10T10:29:27.899 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-08-10T10:29:27.900 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-08-10T10:29:27.901 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-08-10T10:29:27.901 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-08-10T10:29:27.901 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-08-10T10:29:27.902 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds balancer = 20 2023-08-10T10:29:27.902 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-08-10T10:29:27.902 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-08-10T10:29:27.902 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-08-10T10:29:27.903 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-08-10T10:29:27.903 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-08-10T10:29:27.903 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-08-10T10:29:27.903 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-08-10T10:29:27.904 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-08-10T10:29:27.906 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-08-10T10:29:27.906 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-08-10T10:29:27.907 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-10T10:29:27.907 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-08-10T10:29:27.907 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.907 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-08-10T10:29:27.908 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.908 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-08-10T10:29:27.908 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.909 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-08-10T10:29:27.909 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-08-10T10:29:27.909 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.909 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-08-10T10:29:27.910 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-08-10T10:29:27.910 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.910 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-10T10:29:27.911 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-08-10T10:29:27.911 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.911 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-08-10T10:29:27.911 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-10T10:29:27.912 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.912 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-08-10T10:29:27.912 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.913 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-08-10T10:29:27.913 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-08-10T10:29:27.913 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-08-10T10:29:27.913 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-08-10T10:29:27.913 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-08-10T10:29:27.914 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.915 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-10T10:29:27.915 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.915 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-08-10T10:29:27.915 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.915 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.88,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-08-10T10:29:27.916 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on skipped message = False 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-08-10T10:29:27.917 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-08-10T10:29:27.918 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-08-10T10:29:27.919 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-08-10T10:29:27.920 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2023-08-10T10:29:27.921 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-08-10T10:29:27.922 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-08-10T10:29:27.923 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.924 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-08-10T10:29:27.925 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-08-10T10:29:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-08-10T10:29:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-08-10T10:29:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-08-10T10:29:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-08-10T10:29:27.926 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-10T10:29:27.927 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-08-10T10:29:27.928 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-10T10:29:27.929 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-08-10T10:29:27.930 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-08-10T10:29:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-08-10T10:29:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-08-10T10:29:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-08-10T10:29:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-08-10T10:29:27.931 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-08-10T10:29:27.932 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-08-10T10:29:27.933 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-08-10T10:29:27.934 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-10T10:29:27.934 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-10T10:29:28.059 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-10T10:29:28.060 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:28.060 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-10T10:29:28.107 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:28.107 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-10T10:29:28.195 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:29:28.196 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:28.196 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:29:28.196 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:29:28.333 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:29:28.334 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:28.420 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:29:28.420 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:28.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-10T10:29:28.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-10T10:29:28.516 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:29:28.517 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:28.601 INFO:tasks.ceph:Setting up mon nodes... 2023-08-10T10:29:28.602 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-10T10:29:28.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:29:28.728 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-10T10:29:28.734 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:29:28.866 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-10T10:29:28.873 INFO:tasks.ceph:Setting up mds nodes... 2023-08-10T10:29:28.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:29:29.001 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-10T10:29:29.006 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-10T10:29:29.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:29:29.198 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-10T10:29:29.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-10T10:29:29.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:29:29.394 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-10T10:29:29.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-10T10:29:29.469 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:29:29.589 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-10T10:29:29.594 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-10T10:29:29.663 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-10T10:29:29.663 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-10T10:29:29.760 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-10T10:29:29.789 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-10T10:29:29.885 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-10T10:29:29.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-10T10:29:30.019 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-10T10:29:30.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-10T10:29:30.146 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-10T10:29:30.176 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-10T10:29:30.176 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-10T10:29:30.176 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-10T10:29:30.247 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:30.247 INFO:tasks.ceph:role: osd.0 2023-08-10T10:29:30.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:29:30.248 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:29:30.326 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:30.327 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:30.327 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:30.328 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:30.328 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:30.328 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:30.328 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:30.764 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-08-10T10:29:30.768 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-08-10T10:29:30.769 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-10T10:29:30.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-10T10:29:31.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-10T10:29:31.099 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:31.100 INFO:tasks.ceph:role: osd.1 2023-08-10T10:29:31.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:29:31.100 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:29:31.177 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:31.177 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:31.177 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:31.177 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:31.177 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:31.178 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:31.178 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:31.178 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:31.581 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-08-10T10:29:31.584 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-08-10T10:29:31.585 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-10T10:29:31.714 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-10T10:29:31.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-10T10:29:31.860 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:31.860 INFO:tasks.ceph:role: osd.2 2023-08-10T10:29:31.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:29:31.861 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:29:31.937 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:31.938 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:31.939 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:31.939 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:31.939 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:32.381 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-08-10T10:29:32.385 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-08-10T10:29:32.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-10T10:29:32.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-10T10:29:32.655 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-10T10:29:32.725 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:32.727 INFO:tasks.ceph:role: osd.3 2023-08-10T10:29:32.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:29:32.727 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:29:32.803 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:32.803 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:32.804 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:32.805 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:33.237 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-08-10T10:29:33.240 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-08-10T10:29:33.241 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-10T10:29:33.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-10T10:29:33.441 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:33.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.558+0000 7f8256836640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-10T10:29:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.559+0000 7f8256836640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-10T10:29:33.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.559+0000 7f8256836640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:29:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.559+0000 7f8256836640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:29:33.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.559+0000 7f8256836640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-10T10:29:33.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:33.561+0000 7f8256836640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-10T10:29:36.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-10T10:29:36.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.624+0000 7f4269da9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-10T10:29:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.625+0000 7f4269da9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-10T10:29:36.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.625+0000 7f4269da9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:29:36.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.625+0000 7f4269da9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:29:36.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.625+0000 7f4269da9640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-10T10:29:36.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:36.626+0000 7f4269da9640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-10T10:29:39.510 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-10T10:29:39.582 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:39.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.686+0000 7f34b7a4f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-10T10:29:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.686+0000 7f34b7a4f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-10T10:29:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.686+0000 7f34b7a4f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:29:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.686+0000 7f34b7a4f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:29:39.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.686+0000 7f34b7a4f640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-10T10:29:39.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:39.688+0000 7f34b7a4f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-10T10:29:42.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-10T10:29:42.657 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:42.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.768+0000 7f391f5de640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-10T10:29:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.768+0000 7f391f5de640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-10T10:29:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.768+0000 7f391f5de640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:29:42.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.768+0000 7f391f5de640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:29:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.768+0000 7f391f5de640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-10T10:29:42.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:29:42.770+0000 7f391f5de640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-10T10:29:45.654 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-10T10:29:45.728 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-10T10:29:45.805 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:45.806 INFO:tasks.ceph:role: osd.4 2023-08-10T10:29:45.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:29:45.806 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-10T10:29:45.884 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:45.885 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:45.886 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:45.886 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:45.886 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:46.321 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-08-10T10:29:46.324 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-08-10T10:29:46.325 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-10T10:29:46.544 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-10T10:29:46.622 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-10T10:29:46.692 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:46.693 INFO:tasks.ceph:role: osd.5 2023-08-10T10:29:46.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:29:46.693 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:46.769 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:46.770 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:46.771 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:47.183 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-08-10T10:29:47.187 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-08-10T10:29:47.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-10T10:29:47.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-10T10:29:47.403 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-10T10:29:47.473 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:47.474 INFO:tasks.ceph:role: osd.6 2023-08-10T10:29:47.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:29:47.474 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-10T10:29:47.551 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:47.552 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:47.552 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:47.553 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:47.553 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:47.553 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:47.553 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:47.991 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-08-10T10:29:47.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-08-10T10:29:47.996 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-10T10:29:48.173 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-10T10:29:48.254 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-10T10:29:48.323 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-10T10:29:48.323 INFO:tasks.ceph:role: osd.7 2023-08-10T10:29:48.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:29:48.324 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-10T10:29:48.400 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-10T10:29:48.400 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-10T10:29:48.401 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-10T10:29:48.402 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-10T10:29:48.838 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-08-10T10:29:48.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-08-10T10:29:48.842 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-10T10:29:48.965 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-10T10:29:49.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:49.159 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.157+0000 7fb74bd29640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-10T10:29:49.159 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.158+0000 7fb74bd29640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-10T10:29:49.160 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.158+0000 7fb74bd29640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:29:49.160 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.158+0000 7fb74bd29640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:29:49.160 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.158+0000 7fb74bd29640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-10T10:29:49.161 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:49.160+0000 7fb74bd29640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-10T10:29:52.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-10T10:29:52.117 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:52.222 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.221+0000 7f5ba24b3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-10T10:29:52.223 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.222+0000 7f5ba24b3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-10T10:29:52.224 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.222+0000 7f5ba24b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:29:52.224 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.222+0000 7f5ba24b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:29:52.224 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.222+0000 7f5ba24b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-10T10:29:52.224 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:52.223+0000 7f5ba24b3640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-10T10:29:55.105 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-10T10:29:55.175 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:55.281 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.279+0000 7f9875401640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-10T10:29:55.281 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.280+0000 7f9875401640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-10T10:29:55.282 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.280+0000 7f9875401640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:29:55.282 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.280+0000 7f9875401640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:29:55.282 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.280+0000 7f9875401640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-10T10:29:55.283 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:55.282+0000 7f9875401640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-10T10:29:55.471 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:55.476 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:29:58.164 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-10T10:29:58.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:29:58.341 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.340+0000 7fcd8aeba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-10T10:29:58.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.340+0000 7fcd8aeba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-10T10:29:58.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.340+0000 7fcd8aeba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:29:58.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.340+0000 7fcd8aeba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:29:58.342 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.340+0000 7fcd8aeba640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-10T10:29:58.343 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:29:58.342+0000 7fcd8aeba640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-10T10:30:01.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-10T10:30:01.288 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-10T10:30:01.288 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.289 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-10T10:30:01.372 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-10T10:30:01.464 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-10T10:30:01.534 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.534 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-10T10:30:01.643 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-10T10:30:01.752 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.752 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-10T10:30:01.860 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:01.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-10T10:30:01.967 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:01.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-10T10:30:02.040 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-10T10:30:02.150 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.150 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-10T10:30:02.258 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.258 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-10T10:30:02.367 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.367 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-10T10:30:02.475 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.476 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-10T10:30:02.584 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-10T10:30:02.692 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:02.692 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-10T10:30:02.740 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:02.740 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-10T10:30:02.826 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.827 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-10T10:30:02.872 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:02.872 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-10T10:30:02.956 INFO:tasks.ceph:Adding keys to all mons... 2023-08-10T10:30:02.957 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:30:02.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-10T10:30:03.024 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-08-10T10:30:03.024 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAIvNRkwoNtKxAAw4rZfyR4cTrxXKw4KVFSDw== 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkdHMXABAAuubgvlHAvxm9VfaREEqSRw== 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkaMTWCxAA5VxAlXzNpLQKuyZNhDX5XQ== 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQANvNRkCo5WIRAAsqfviYUUblJY6DTa/Vzxrw== 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-08-10T10:30:03.025 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAQvNRkgJNIJRAAOvbKiO/SZyobowC4EGApkw== 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQATvNRkpB/xKBAAyfjD39zZ8eQw2dIBIbABiA== 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAWvNRkKsnRLRAAd1XKTL6kVCCpMQvNAJjpJA== 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAIvNRkAFCwMxAAdldzSOzXJrG6QTUBjg3btg== 2023-08-10T10:30:03.026 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkWKyLFxAAdQgwRn9pAT+6zIJlDKVbaQ== 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkIcImIxAA3EcdPJUSNDK0xCKkcsoUag== 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAdvNRkpwiDCRAAqyIVJ7/GTP5O6rl0hvac3Q== 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAgvNRkPilNDRAAfxCAjNf5RG6NAQ40RH/rbg== 2023-08-10T10:30:03.027 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAjvNRkX0XIEBAA8dCRX+6/02svmuiDjW0FCg== 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAmvNRkiE9iFBAAjxHGEp/WA3Iv6rZKVnTwgg== 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkpsdSLRAAEQR/2kKypyrX4dsTMmFp0Q== 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:[client.2] 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAJvNRkV5vMNBAA8zZ4p1y8+Zirl/RK4xGShg== 2023-08-10T10:30:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-08-10T10:30:03.029 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAKvNRkAy4sARAASYafbiWMBO3+55CWCpJXaQ== 2023-08-10T10:30:03.029 INFO:teuthology.orchestra.run.smithi088.stdout:[client.3] 2023-08-10T10:30:03.029 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAKvNRkUUm9CBAASqyiREOdRt8ZAmeFID/QSg== 2023-08-10T10:30:03.061 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-08-10T10:30:03.061 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAIvNRkwoNtKxAAw4rZfyR4cTrxXKw4KVFSDw== 2023-08-10T10:30:03.061 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkdHMXABAAuubgvlHAvxm9VfaREEqSRw== 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkaMTWCxAA5VxAlXzNpLQKuyZNhDX5XQ== 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQANvNRkCo5WIRAAsqfviYUUblJY6DTa/Vzxrw== 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAQvNRkgJNIJRAAOvbKiO/SZyobowC4EGApkw== 2023-08-10T10:30:03.062 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQATvNRkpB/xKBAAyfjD39zZ8eQw2dIBIbABiA== 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAWvNRkKsnRLRAAd1XKTL6kVCCpMQvNAJjpJA== 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAIvNRkAFCwMxAAdldzSOzXJrG6QTUBjg3btg== 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-08-10T10:30:03.063 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkWKyLFxAAdQgwRn9pAT+6zIJlDKVbaQ== 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkIcImIxAA3EcdPJUSNDK0xCKkcsoUag== 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAdvNRkpwiDCRAAqyIVJ7/GTP5O6rl0hvac3Q== 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAgvNRkPilNDRAAfxCAjNf5RG6NAQ40RH/rbg== 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-08-10T10:30:03.064 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAjvNRkX0XIEBAA8dCRX+6/02svmuiDjW0FCg== 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAmvNRkiE9iFBAAjxHGEp/WA3Iv6rZKVnTwgg== 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkpsdSLRAAEQR/2kKypyrX4dsTMmFp0Q== 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAJvNRkV5vMNBAA8zZ4p1y8+Zirl/RK4xGShg== 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-08-10T10:30:03.065 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAKvNRkAy4sARAASYafbiWMBO3+55CWCpJXaQ== 2023-08-10T10:30:03.066 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-08-10T10:30:03.066 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQAKvNRkUUm9CBAASqyiREOdRt8ZAmeFID/QSg== 2023-08-10T10:30:03.067 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:30:03.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:30:03.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:03.221 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:03.332 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:03.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:03.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.451 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.678 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.790 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:03.899 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:30:03.903 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-10T10:30:04.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:04.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:04.127 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:04.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-10T10:30:04.243 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.247 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.467 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-10T10:30:04.692 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:04.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:04.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:04.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:04.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:04.928 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:05.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:05.043 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-10T10:30:05.153 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-10T10:30:05.154 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-10T10:30:05.223 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:30:05.344 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-10T10:30:05.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-10T10:30:05.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:30:05.605 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-10T10:30:05.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-10T10:30:05.744 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-10T10:30:05.866 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-10T10:30:05.936 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:30:05.941 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-10T10:30:05.986 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-10T10:30:05.987 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-10T10:30:05.987 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-10T10:30:06.027 INFO:tasks.ceph.mon.a:Started 2023-08-10T10:30:06.028 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-10T10:30:06.028 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-10T10:30:06.032 INFO:tasks.ceph.mon.b:Started 2023-08-10T10:30:06.032 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-10T10:30:06.033 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-10T10:30:06.037 INFO:tasks.ceph.mon.c:Started 2023-08-10T10:30:06.037 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-10T10:30:06.037 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-10T10:30:06.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-10T10:30:06.041 INFO:tasks.ceph.mgr.y:Started 2023-08-10T10:30:06.042 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-10T10:30:06.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-10T10:30:06.046 INFO:tasks.ceph.mgr.x:Started 2023-08-10T10:30:06.047 INFO:tasks.ceph:Setting crush tunables to default 2023-08-10T10:30:06.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd crush tunables default 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.242+0000 7fbc923ff700 1 Processor -- start 2023-08-10T10:30:06.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.243+0000 7fbc923ff700 1 -- start start 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.244+0000 7fbc923ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.244+0000 7fbc923ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 0x7fbc8c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.244+0000 7fbc923ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc8c0d1840 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.244+0000 7fbc923ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b5320 con 0x7fbc8c0b4e90 2023-08-10T10:30:06.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.244+0000 7fbc923ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d2c20 con 0x7fbc8c0d27a0 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:38970/0 (socket says 172.21.15.88:38970) 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 -- 172.21.15.88:0/1306760875 learned_addr learned my addr 172.21.15.88:0/1306760875 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 msgr2=0x7fbc8c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 msgr2=0x7fbc8c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc8b7fe700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:30:06.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc9099c700 1 --2- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 0x7fbc8c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc9099c700 1 -- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 msgr2=0x7fbc8c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-08-10T10:30:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc9099c700 1 -- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 msgr2=0x7fbc8c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-08-10T10:30:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc9099c700 1 --2- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 0x7fbc8c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-08-10T10:30:06.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.245+0000 7fbc9099c700 1 --2- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 0x7fbc8c0b1940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-08-10T10:30:06.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877483722 0 0) 0x7fbc8c0d1840 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc740035b0 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4174825641 0 0) 0x7fbc740035b0 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 msgr2=0x7fbc8c0b4950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc8c0b4950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 msgr2=0x7fbc8c0b1940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:30:06.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 --2- 172.21.15.88:0/1306760875 >> v2:172.21.15.88:3300/0 conn(0x7fbc8c0b4e90 0x7fbc8c0b1940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c0d1b20 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fbc7c001670 con 0x7fbc8c15d1e0 2023-08-10T10:30:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 >> v1:172.21.15.88:6789/0 conn(0x7fbc8c15d1e0 legacy=0x7fbc8c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc74003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc74004850 0x7fbc74004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc74005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0b5320 con 0x7fbc74003a00 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0d2c20 con 0x7fbc74004850 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.430+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7400bba0 con 0x7fbc8c0d27a0 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc74003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8b7fe700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc74004850 0x7fbc74004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 msgr2=0x7fbc74005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c0d27a0 0x7fbc74005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc74004850 msgr2=0x7fbc74004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc74004850 0x7fbc74004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 -- 172.21.15.88:0/1306760875 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740035b0 con 0x7fbc74003a00 2023-08-10T10:30:06.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.431+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc74003e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001eb0 tx=0x7fbc74005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85954d5383bc6934 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:06.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00cc50 con 0x7fbc74003a00 2023-08-10T10:30:06.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00cdb0 con 0x7fbc74003a00 2023-08-10T10:30:06.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc8affd700 1 -- 172.21.15.88:0/1306760875 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c012660 con 0x7fbc74003a00 2023-08-10T10:30:06.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc923ff700 1 -- 172.21.15.88:0/1306760875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 msgr2=0x7fbc74003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc923ff700 1 --2- 172.21.15.88:0/1306760875 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc74003e20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c001eb0 tx=0x7fbc74005880 comp rx=0 tx=0).stop 2023-08-10T10:30:06.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc9099c700 1 -- 172.21.15.88:0/1306760875 reap_dead start 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc923ff700 1 -- 172.21.15.88:0/1306760875 shutdown_connections 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc923ff700 1 -- 172.21.15.88:0/1306760875 >> 172.21.15.88:0/1306760875 conn(0x7fbc8c0cf950 msgr2=0x7fbc8c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.432+0000 7fbc923ff700 1 -- 172.21.15.88:0/1306760875 shutdown_connections 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.433+0000 7fbc923ff700 1 -- 172.21.15.88:0/1306760875 wait complete. 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.434+0000 7fbc923ff700 1 Processor -- start 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.435+0000 7fbc923ff700 1 -- start start 2023-08-10T10:30:06.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc8c152480 0x7fbc8c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 0x7fbc8c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c153840 con 0x7fbc74003a00 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c15a490 con 0x7fbc8c152480 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc923ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8c0cb6e0 con 0x7fbc8c159ad0 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58758/0 (socket says 172.21.15.88:58758) 2023-08-10T10:30:06.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 -- 172.21.15.88:0/3582481197 learned_addr learned my addr 172.21.15.88:0/3582481197 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8b7fe700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc8c152480 0x7fbc8c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc9099c700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 0x7fbc8c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 -- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 msgr2=0x7fbc8c159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 0x7fbc8c159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 -- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc8c152480 msgr2=0x7fbc8c153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc8c152480 0x7fbc8c153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 -- 172.21.15.88:0/3582481197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc8c152900 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc9099c700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 0x7fbc8c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.436+0000 7fbc8bfff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbc740047a0 tx=0x7fbc7c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c0050c0 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c020070 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8c153a30 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c005280 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8c153ff0 con 0x7fbc74003a00 2023-08-10T10:30:06.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbc7c022030 con 0x7fbc74003a00 2023-08-10T10:30:06.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.437+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbc7c012640 con 0x7fbc74003a00 2023-08-10T10:30:06.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.438+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8c0cec10 con 0x7fbc74003a00 2023-08-10T10:30:06.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.441+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fbc7c02a020 con 0x7fbc74003a00 2023-08-10T10:30:06.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.521+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbc8c0d2190 con 0x7fbc74003a00 2023-08-10T10:30:06.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.524+0000 7fbc88ff9700 1 -- 172.21.15.88:0/3582481197 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbc7c033090 con 0x7fbc74003a00 2023-08-10T10:30:06.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 msgr2=0x7fbc8c0caad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:06.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbc740047a0 tx=0x7fbc7c000fe0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 shutdown_connections 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc8c159ad0 0x7fbc8c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbc74003a00 0x7fbc8c0caad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 --2- 172.21.15.88:0/3582481197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc8c152480 0x7fbc8c153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 >> 172.21.15.88:0/3582481197 conn(0x7fbc8c0cf950 msgr2=0x7fbc8c160060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 shutdown_connections 2023-08-10T10:30:06.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:06.525+0000 7fbc923ff700 1 -- 172.21.15.88:0/3582481197 wait complete. 2023-08-10T10:30:06.528 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2023-08-10T10:30:06.545 INFO:tasks.ceph:check_enable_crimson: False 2023-08-10T10:30:06.546 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-10T10:30:06.546 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:06.547 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-10T10:30:06.598 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:06.598+0000 7f7802afc200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:30:06.602 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:06.601+0000 7f9bf50da200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-10T10:30:06.616 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:06.616 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-10T10:30:06.733 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:06.734 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-10T10:30:06.814 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:06.814+0000 7f7802afc200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:30:06.820 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:06.818+0000 7f9bf50da200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-10T10:30:06.850 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:06.850 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-10T10:30:06.958 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:06.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-10T10:30:07.028 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:07.029 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-10T10:30:07.137 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:07.138 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-10T10:30:07.246 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:30:07.246 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-10T10:30:07.266 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:07.265+0000 7f9bf50da200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:30:07.284 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:07.284+0000 7f7802afc200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-10T10:30:07.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d91affde-f99a-4ca8-a0dc-623501d3bfb6 0 2023-08-10T10:30:07.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.589+0000 7f6a023ff700 1 Processor -- start 2023-08-10T10:30:07.590 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.589+0000 7f6a023ff700 1 -- start start 2023-08-10T10:30:07.594 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a023ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f69fc0b5060 0x7f69fc0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.594 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a023ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0d1840 con 0x7f69fc15d1e0 2023-08-10T10:30:07.594 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a023ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69fc0d1b20 con 0x7f69fc0d27a0 2023-08-10T10:30:07.595 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a023ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69fc0d2c50 con 0x7f69fc0b5060 2023-08-10T10:30:07.595 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a0099c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f69fc0b5060 0x7f69fc0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.595 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f69fb7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f69fc0d27a0 0x7f69fc0b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35926/0 (socket says 172.21.15.187:35926) 2023-08-10T10:30:07.596 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a0099c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f69fc0b5060 0x7f69fc0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35186/0 (socket says 172.21.15.187:35186) 2023-08-10T10:30:07.596 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f69fb7fe700 1 -- 172.21.15.187:0/2757740413 learned_addr learned my addr 172.21.15.187:0/2757740413 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:07.596 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f69fbfff700 1 --1- 172.21.15.187:0/2757740413 >> v1:172.21.15.88:6789/0 conn(0x7f69fc15d1e0 0x7f69fc0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.187:50332/0 (socket says 172.21.15.187:50332) 2023-08-10T10:30:07.597 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a0099c700 1 -- 172.21.15.187:0/2757740413 >> v1:172.21.15.187:6789/0 conn(0x7f69fc0d27a0 legacy=0x7f69fc0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.597 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a0099c700 1 -- 172.21.15.187:0/2757740413 >> v1:172.21.15.88:6789/0 conn(0x7f69fc15d1e0 legacy=0x7f69fc0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.597 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f6a0099c700 1 -- 172.21.15.187:0/2757740413 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69fc0d1e00 con 0x7f69fc0b5060 2023-08-10T10:30:07.598 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.591+0000 7f69faffd700 1 -- 172.21.15.187:0/2757740413 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 522052857 0 0) 0x7f69fc0d1840 con 0x7f69fc15d1e0 2023-08-10T10:30:07.598 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.592+0000 7f6a0099c700 1 --2- 172.21.15.187:0/2757740413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc0b5060 0x7f69fc0b1940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db820d668076c4c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.598 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.592+0000 7f69faffd700 1 -- 172.21.15.187:0/2757740413 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f400e070 con 0x7f69fc0b5060 2023-08-10T10:30:07.598 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.592+0000 7f69faffd700 1 -- 172.21.15.187:0/2757740413 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f400bbd0 con 0x7f69fc0b5060 2023-08-10T10:30:07.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.592+0000 7f69faffd700 1 -- 172.21.15.187:0/2757740413 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f4012430 con 0x7f69fc0b5060 2023-08-10T10:30:07.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 -- 172.21.15.187:0/2757740413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc0b5060 msgr2=0x7f69fc0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 --2- 172.21.15.187:0/2757740413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc0b5060 0x7f69fc0b1940 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:07.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 -- 172.21.15.187:0/2757740413 shutdown_connections 2023-08-10T10:30:07.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 --2- 172.21.15.187:0/2757740413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc0b5060 0x7f69fc0b1940 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 -- 172.21.15.187:0/2757740413 >> 172.21.15.187:0/2757740413 conn(0x7f69fc0cf950 msgr2=0x7f69fc0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 -- 172.21.15.187:0/2757740413 shutdown_connections 2023-08-10T10:30:07.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.593+0000 7f6a023ff700 1 -- 172.21.15.187:0/2757740413 wait complete. 2023-08-10T10:30:07.602 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.595+0000 7f6a023ff700 1 Processor -- start 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.595+0000 7f6a023ff700 1 -- start start 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 0x7f69fc0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 0x7f69fc1e7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c6f20 con 0x7f69fc0b5060 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c71c0 con 0x7f69fc15d1e0 2023-08-10T10:30:07.603 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a023ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69fc0c74a0 con 0x7f69fc0d27a0 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f6a0099c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 0x7f69fc1e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f69fb7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56344/0 (socket says 172.21.15.187:56344) 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f69fb7fe700 1 -- 172.21.15.187:0/4259470369 learned_addr learned my addr 172.21.15.187:0/4259470369 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.596+0000 7f69fbfff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 0x7f69fc0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 -- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 msgr2=0x7f69fc15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.604 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 -- 172.21.15.187:0/4259470369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 msgr2=0x7f69fc0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 0x7f69fc0c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 -- 172.21.15.187:0/4259470369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f4009a70 con 0x7f69fc15d1e0 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f69fb7fe700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f69fbfff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 0x7f69fc0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:07.605 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a0099c700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 0x7f69fc1e7410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69f4016000 tx=0x7f69f4004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f401b810 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69f4020070 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69f401bbd0 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69fc0c7780 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.597+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69fc0c7d40 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.598+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f69f4027780 con 0x7f69fc15d1e0 2023-08-10T10:30:07.606 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.598+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f69f4022070 con 0x7f69fc15d1e0 2023-08-10T10:30:07.607 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.599+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69fc0743a0 con 0x7f69fc15d1e0 2023-08-10T10:30:07.607 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.603+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f69f402c060 con 0x7f69fc15d1e0 2023-08-10T10:30:07.689 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.688+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d91affde-f99a-4ca8-a0dc-623501d3bfb6", "id": 0} v 0) v1 -- 0x7f69fc0cef10 con 0x7f69fc15d1e0 2023-08-10T10:30:07.698 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.698+0000 7f69f8ff9700 1 -- 172.21.15.187:0/4259470369 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d91affde-f99a-4ca8-a0dc-623501d3bfb6", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f69f401c4f0 con 0x7f69fc15d1e0 2023-08-10T10:30:07.698 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-08-10T10:30:07.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 msgr2=0x7f69fc1e7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 0x7f69fc1e7410 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f69f4016000 tx=0x7f69f4004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 shutdown_connections 2023-08-10T10:30:07.699 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69fc15d1e0 0x7f69fc1e7410 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f69fc0b5060 0x7f69fc0c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 --2- 172.21.15.187:0/4259470369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69fc0d27a0 0x7f69fc15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 >> 172.21.15.187:0/4259470369 conn(0x7f69fc0cf950 msgr2=0x7f69fc0d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 shutdown_connections 2023-08-10T10:30:07.700 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.699+0000 7f6a023ff700 1 -- 172.21.15.187:0/4259470369 wait complete. 2023-08-10T10:30:07.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 02326e7b-6d2c-4a3e-a9a7-31df64094245 1 2023-08-10T10:30:07.851 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:07.850+0000 7f9bf50da200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:30:07.911 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.910+0000 7f98797ff700 1 Processor -- start 2023-08-10T10:30:07.911 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.910+0000 7f98797ff700 1 -- start start 2023-08-10T10:30:07.912 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98797ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 0x7f98740b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.912 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98797ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98740b4e90 0x7f98740b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.912 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98797ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98740d1840 con 0x7f987415d1e0 2023-08-10T10:30:07.912 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98797ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98740b5320 con 0x7f98740b4e90 2023-08-10T10:30:07.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98797ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98740d2c20 con 0x7f98740d27a0 2023-08-10T10:30:07.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f9872ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f987415d1e0 0x7f98740d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35932/0 (socket says 172.21.15.187:35932) 2023-08-10T10:30:07.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f9872ffd700 1 -- 172.21.15.187:0/4276608832 learned_addr learned my addr 172.21.15.187:0/4276608832 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:07.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f986bfff700 1 --2- 172.21.15.187:0/4276608832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 0x7f98740b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.913 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98737fe700 1 --2- 172.21.15.187:0/4276608832 >> v2:172.21.15.88:3300/0 conn(0x7f98740b4e90 0x7f98740b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.914 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f986bfff700 1 -- 172.21.15.187:0/4276608832 >> v2:172.21.15.88:3300/0 conn(0x7f98740b4e90 msgr2=0x7f98740b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f986bfff700 1 --2- 172.21.15.187:0/4276608832 >> v2:172.21.15.88:3300/0 conn(0x7f98740b4e90 0x7f98740b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f98727fc700 1 -- 172.21.15.187:0/4276608832 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3302848426 0 0) 0x7f98740d1840 con 0x7f987415d1e0 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f986bfff700 1 -- 172.21.15.187:0/4276608832 >> v1:172.21.15.187:6789/0 conn(0x7f987415d1e0 legacy=0x7f98740d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.912+0000 7f986bfff700 1 -- 172.21.15.187:0/4276608832 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98740d1b20 con 0x7f98740d27a0 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f986bfff700 1 --2- 172.21.15.187:0/4276608832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 0x7f98740b4950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f985c009840 tx=0x7f985c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e00c402f0888f12 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f98727fc700 1 -- 172.21.15.187:0/4276608832 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011830 con 0x7f98740d27a0 2023-08-10T10:30:07.915 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f98727fc700 1 -- 172.21.15.187:0/4276608832 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c011990 con 0x7f98740d27a0 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f98727fc700 1 -- 172.21.15.187:0/4276608832 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c011d20 con 0x7f98740d27a0 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f98797ff700 1 -- 172.21.15.187:0/4276608832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 msgr2=0x7f98740b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.913+0000 7f98797ff700 1 --2- 172.21.15.187:0/4276608832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 0x7f98740b4950 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f985c009840 tx=0x7f985c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 -- 172.21.15.187:0/4276608832 shutdown_connections 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 --2- 172.21.15.187:0/4276608832 >> v2:172.21.15.88:3300/0 conn(0x7f98740b4e90 0x7f98740b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 --2- 172.21.15.187:0/4276608832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740d27a0 0x7f98740b4950 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 -- 172.21.15.187:0/4276608832 >> 172.21.15.187:0/4276608832 conn(0x7f98740cf950 msgr2=0x7f98740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:07.916 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 -- 172.21.15.187:0/4276608832 shutdown_connections 2023-08-10T10:30:07.917 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f98797ff700 1 -- 172.21.15.187:0/4276608832 wait complete. 2023-08-10T10:30:07.917 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:07.914+0000 7f7802afc200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.915+0000 7f98797ff700 1 Processor -- start 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.916+0000 7f98797ff700 1 -- start start 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.916+0000 7f98797ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 0x7f98740c9630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.916+0000 7f98797ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 0x7f98741e57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98797ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 0x7f98740c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98797ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741e6d80 con 0x7f98740d27a0 2023-08-10T10:30:07.919 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98797ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98741e6170 con 0x7f987415d1e0 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98797ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98741e6450 con 0x7f98740b4e90 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 0x7f98740c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 0x7f98741e57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f9872ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 0x7f98740c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56352/0 (socket says 172.21.15.187:56352) 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f9872ffd700 1 -- 172.21.15.187:0/153340854 learned_addr learned my addr 172.21.15.187:0/153340854 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98737fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 0x7f98740c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:07.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 -- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 msgr2=0x7f98740c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 0x7f98740c9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 -- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 msgr2=0x7f98740c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 0x7f98740c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f986bfff700 1 -- 172.21.15.187:0/153340854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c0094a0 con 0x7f98740d27a0 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.917+0000 7f98737fe700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 0x7f98740c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f986bfff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 0x7f98741e57b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f985c016000 tx=0x7f985c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c0036a0 con 0x7f98740d27a0 2023-08-10T10:30:07.921 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c01f070 con 0x7f98740d27a0 2023-08-10T10:30:07.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98741e6730 con 0x7f98740d27a0 2023-08-10T10:30:07.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c003a60 con 0x7f98740d27a0 2023-08-10T10:30:07.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98740c9b70 con 0x7f98740d27a0 2023-08-10T10:30:07.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.918+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f985c026480 con 0x7f98740d27a0 2023-08-10T10:30:07.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.919+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f985c021070 con 0x7f98740d27a0 2023-08-10T10:30:07.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.919+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98741e6ef0 con 0x7f98740d27a0 2023-08-10T10:30:07.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:07.922+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f985c02b020 con 0x7f98740d27a0 2023-08-10T10:30:08.008 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.008+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "02326e7b-6d2c-4a3e-a9a7-31df64094245", "id": 1} v 0) v1 -- 0x7f98741e7110 con 0x7f98740d27a0 2023-08-10T10:30:08.015 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.015+0000 7f986b7fe700 1 -- 172.21.15.187:0/153340854 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "02326e7b-6d2c-4a3e-a9a7-31df64094245", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f985c015020 con 0x7f98740d27a0 2023-08-10T10:30:08.015 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-08-10T10:30:08.016 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 msgr2=0x7f98741e57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 0x7f98741e57b0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f985c016000 tx=0x7f985c004750 comp rx=0 tx=0).stop 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 shutdown_connections 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987415d1e0 0x7f98740c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98740b4e90 0x7f98740c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 --2- 172.21.15.187:0/153340854 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98740d27a0 0x7f98741e57b0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 >> 172.21.15.187:0/153340854 conn(0x7f98740cf950 msgr2=0x7f987406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.017 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.016+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 shutdown_connections 2023-08-10T10:30:08.018 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.017+0000 7f98797ff700 1 -- 172.21.15.187:0/153340854 wait complete. 2023-08-10T10:30:08.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 04a2dbd5-759e-4973-a6de-958b30cee796 2 2023-08-10T10:30:08.084 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:08.083+0000 7f9bf50da200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:30:08.162 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:08.162+0000 7f7802afc200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-10T10:30:08.228 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.228+0000 7f9fc2dff700 1 Processor -- start 2023-08-10T10:30:08.229 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.228+0000 7f9fc2dff700 1 -- start start 2023-08-10T10:30:08.230 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc2dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc2dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 0x7f9fbc0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc2dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fbc0d1840 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc2dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fbc15d5c0 con 0x7f9fbc15d1e0 2023-08-10T10:30:08.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc2dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0b5300 con 0x7f9fbc0d1060 2023-08-10T10:30:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.230+0000 7f9fc0b9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 0x7f9fbc0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fc139c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9fbc0b4e90 0x7f9fbc0b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35940/0 (socket says 172.21.15.187:35940) 2023-08-10T10:30:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fc0b9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35210/0 (socket says 172.21.15.187:35210) 2023-08-10T10:30:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fc139c700 1 -- 172.21.15.187:0/547392240 learned_addr learned my addr 172.21.15.187:0/547392240 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 -- 172.21.15.187:0/547392240 >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 msgr2=0x7f9fbc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 --2- 172.21.15.187:0/547392240 >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 -- 172.21.15.187:0/547392240 >> v1:172.21.15.187:6789/0 conn(0x7f9fbc0b4e90 legacy=0x7f9fbc0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbb7fe700 1 -- 172.21.15.187:0/547392240 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2216143453 0 0) 0x7f9fbc0d1840 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 -- 172.21.15.187:0/547392240 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fbc0d1b20 con 0x7f9fbc0d1060 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fc0b9b700 1 --2- 172.21.15.187:0/547392240 >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.231+0000 7f9fbbfff700 1 --2- 172.21.15.187:0/547392240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 0x7f9fbc0b4950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009840 tx=0x7f9fa8009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=badf0fe2a99e8d7e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fbb7fe700 1 -- 172.21.15.187:0/547392240 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8011830 con 0x7f9fbc0d1060 2023-08-10T10:30:08.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fbb7fe700 1 -- 172.21.15.187:0/547392240 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa8011990 con 0x7f9fbc0d1060 2023-08-10T10:30:08.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fbb7fe700 1 -- 172.21.15.187:0/547392240 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa8011d20 con 0x7f9fbc0d1060 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 -- 172.21.15.187:0/547392240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 msgr2=0x7f9fbc0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/547392240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 0x7f9fbc0b4950 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f9fa8009840 tx=0x7f9fa8009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 -- 172.21.15.187:0/547392240 shutdown_connections 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/547392240 >> v2:172.21.15.187:3300/0 conn(0x7f9fbc15d1e0 0x7f9fbc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/547392240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc0d1060 0x7f9fbc0b4950 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 -- 172.21.15.187:0/547392240 >> 172.21.15.187:0/547392240 conn(0x7f9fbc0cf950 msgr2=0x7f9fbc0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.235 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 -- 172.21.15.187:0/547392240 shutdown_connections 2023-08-10T10:30:08.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.232+0000 7f9fc2dff700 1 -- 172.21.15.187:0/547392240 wait complete. 2023-08-10T10:30:08.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.234+0000 7f9fc2dff700 1 Processor -- start 2023-08-10T10:30:08.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.234+0000 7f9fc2dff700 1 -- start start 2023-08-10T10:30:08.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 0x7f9fbc15a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc15d1e0 0x7f9fbc0b6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc155f00 con 0x7f9fbc0d1060 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc15a9b0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc2dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fbc0c9910 con 0x7f9fbc15d1e0 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc0b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc0b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35222/0 (socket says 172.21.15.187:35222) 2023-08-10T10:30:08.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc0b9b700 1 -- 172.21.15.187:0/2874683950 learned_addr learned my addr 172.21.15.187:0/2874683950 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.235+0000 7f9fc139c700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc15d1e0 0x7f9fbc0b6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fbbfff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 0x7f9fbc15a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 -- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc15d1e0 msgr2=0x7f9fbc0b6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc15d1e0 0x7f9fbc0b6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 -- 172.21.15.187:0/2874683950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 msgr2=0x7f9fbc15a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 0x7f9fbc15a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 -- 172.21.15.187:0/2874683950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb00094a0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fbbfff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 0x7f9fbc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc0b9b700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ebe0 tx=0x7f9fb000eef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb0009800 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fb000c910 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb000cc80 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fa80094a0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.236+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fbc159990 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.240 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.237+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9fb0005d20 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.237+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9fb00068e0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.237+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fbc15a2c0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.242+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f9fb0021060 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.329 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.328+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "04a2dbd5-759e-4973-a6de-958b30cee796", "id": 2} v 0) v1 -- 0x7f9fbc0d1db0 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.336+0000 7f9fb97fa700 1 -- 172.21.15.187:0/2874683950 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "04a2dbd5-759e-4973-a6de-958b30cee796", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9fb0029020 con 0x7f9fbc0b4e90 2023-08-10T10:30:08.336 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-08-10T10:30:08.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 msgr2=0x7f9fbc0cc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.337 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9fb000ebe0 tx=0x7f9fb000eef0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 shutdown_connections 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fbc15d1e0 0x7f9fbc0b6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fbc0b4e90 0x7f9fbc0cc3e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 --2- 172.21.15.187:0/2874683950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fbc0d1060 0x7f9fbc15a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 >> 172.21.15.187:0/2874683950 conn(0x7f9fbc0cf950 msgr2=0x7f9fbc15d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 shutdown_connections 2023-08-10T10:30:08.338 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.337+0000 7f9fc2dff700 1 -- 172.21.15.187:0/2874683950 wait complete. 2023-08-10T10:30:08.354 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 5e28043c-0ae3-4a88-9742-8b34fd49f16e 3 2023-08-10T10:30:08.526 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:08.525+0000 7f9bf50da200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:30:08.548 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.548+0000 7f3cae3ff700 1 Processor -- start 2023-08-10T10:30:08.549 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.548+0000 7f3cae3ff700 1 -- start start 2023-08-10T10:30:08.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.549+0000 7f3cae3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ca815d1e0 0x7f3ca80d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.549+0000 7f3cae3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.550 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cae3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ca80b4e90 0x7f3ca80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cae3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca815d5c0 con 0x7f3ca815d1e0 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cae3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ca80b5300 con 0x7f3ca80b4e90 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cae3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80d1840 con 0x7f3ca80d1060 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ca80b4e90 0x7f3ca80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ca80b4e90 0x7f3ca80b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35230/0 (socket says 172.21.15.187:35230) 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3ca77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56390/0 (socket says 172.21.15.187:56390) 2023-08-10T10:30:08.551 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 -- 172.21.15.187:0/2070152102 learned_addr learned my addr 172.21.15.187:0/2070152102 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:08.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3ca7fff700 1 --2- 172.21.15.187:0/2070152102 >> v2:172.21.15.88:3300/0 conn(0x7f3ca815d1e0 0x7f3ca80d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 -- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 msgr2=0x7f3ca80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 -- 172.21.15.187:0/2070152102 >> v2:172.21.15.88:3300/0 conn(0x7f3ca815d1e0 msgr2=0x7f3ca80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.553 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 --2- 172.21.15.187:0/2070152102 >> v2:172.21.15.88:3300/0 conn(0x7f3ca815d1e0 0x7f3ca80d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3cac99c700 1 -- 172.21.15.187:0/2070152102 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80d1b20 con 0x7f3ca80b4e90 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.550+0000 7f3ca77fe700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.551+0000 7f3cac99c700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80b4e90 0x7f3ca80b1940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80b5a70 tx=0x7f3ca000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7db22c6282390526 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.551+0000 7f3ca6ffd700 1 -- 172.21.15.187:0/2070152102 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000e070 con 0x7f3ca80b4e90 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.551+0000 7f3ca6ffd700 1 -- 172.21.15.187:0/2070152102 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ca000b910 con 0x7f3ca80b4e90 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.551+0000 7f3ca6ffd700 1 -- 172.21.15.187:0/2070152102 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca000bcc0 con 0x7f3ca80b4e90 2023-08-10T10:30:08.554 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 -- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80b4e90 msgr2=0x7f3ca80b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80b4e90 0x7f3ca80b1940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80b5a70 tx=0x7f3ca000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 -- 172.21.15.187:0/2070152102 shutdown_connections 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80b4e90 0x7f3ca80b1940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/2070152102 >> v2:172.21.15.88:3300/0 conn(0x7f3ca815d1e0 0x7f3ca80d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/2070152102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80d1060 0x7f3ca80b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 -- 172.21.15.187:0/2070152102 >> 172.21.15.187:0/2070152102 conn(0x7f3ca80cf950 msgr2=0x7f3ca80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 -- 172.21.15.187:0/2070152102 shutdown_connections 2023-08-10T10:30:08.556 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.552+0000 7f3cae3ff700 1 -- 172.21.15.187:0/2070152102 wait complete. 2023-08-10T10:30:08.557 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.554+0000 7f3cae3ff700 1 Processor -- start 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.554+0000 7f3cae3ff700 1 -- start start 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80d1060 0x7f3ca8158380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 0x7f3ca81588c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca80cb6b0 con 0x7f3ca815d1e0 2023-08-10T10:30:08.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca81f4350 con 0x7f3ca80d1060 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cae3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca8158e00 con 0x7f3ca80b4e90 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56392/0 (socket says 172.21.15.187:56392) 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 -- 172.21.15.187:0/1102141537 learned_addr learned my addr 172.21.15.187:0/1102141537 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca77fe700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80d1060 0x7f3ca8158380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cac99c700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 0x7f3ca81588c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 -- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80d1060 msgr2=0x7f3ca8158380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80d1060 0x7f3ca8158380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 -- 172.21.15.187:0/1102141537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 msgr2=0x7f3ca81588c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 0x7f3ca81588c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3ca7fff700 1 -- 172.21.15.187:0/1102141537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c9c0094a0 con 0x7f3ca80b4e90 2023-08-10T10:30:08.561 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.555+0000 7f3cac99c700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 0x7f3ca81588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.561 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca7fff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800e9b0 tx=0x7f3c9800ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.561 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c98009710 con 0x7f3ca80b4e90 2023-08-10T10:30:08.561 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c9800ee50 con 0x7f3ca80b4e90 2023-08-10T10:30:08.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c9800ca50 con 0x7f3ca80b4e90 2023-08-10T10:30:08.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ca0009b30 con 0x7f3ca80b4e90 2023-08-10T10:30:08.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ca8159390 con 0x7f3ca80b4e90 2023-08-10T10:30:08.562 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c98013470 con 0x7f3ca80b4e90 2023-08-10T10:30:08.563 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.556+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f3c98013bb0 con 0x7f3ca80b4e90 2023-08-10T10:30:08.563 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.557+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ca815ca40 con 0x7f3ca80b4e90 2023-08-10T10:30:08.564 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.560+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f3c98021060 con 0x7f3ca80b4e90 2023-08-10T10:30:08.643 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.643+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5e28043c-0ae3-4a88-9742-8b34fd49f16e", "id": 3} v 0) v1 -- 0x7f3ca80cf250 con 0x7f3ca80b4e90 2023-08-10T10:30:08.645 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:08.645+0000 7f7802afc200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-10T10:30:08.650 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.650+0000 7f3ca4ff9700 1 -- 172.21.15.187:0/1102141537 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5e28043c-0ae3-4a88-9742-8b34fd49f16e", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c9802a020 con 0x7f3ca80b4e90 2023-08-10T10:30:08.651 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-08-10T10:30:08.652 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 msgr2=0x7f3ca81563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f3c9800e9b0 tx=0x7f3c9800ecc0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 shutdown_connections 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ca815d1e0 0x7f3ca81588c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ca80b4e90 0x7f3ca81563e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 --2- 172.21.15.187:0/1102141537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ca80d1060 0x7f3ca8158380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 >> 172.21.15.187:0/1102141537 conn(0x7f3ca80cf950 msgr2=0x7f3ca815dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 shutdown_connections 2023-08-10T10:30:08.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.652+0000 7f3cae3ff700 1 -- 172.21.15.187:0/1102141537 wait complete. 2023-08-10T10:30:08.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 2c3b68f9-e144-42d5-b97b-6ae32791a1de 4 2023-08-10T10:30:08.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.867+0000 7f896adff700 1 Processor -- start 2023-08-10T10:30:08.867 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.867+0000 7f896adff700 1 -- start start 2023-08-10T10:30:08.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896adff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89640d27a0 0x7f89640b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896adff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89640d1840 con 0x7f896415d1e0 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896adff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89640d2c50 con 0x7f89640d27a0 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89640b5320 con 0x7f89640b4e90 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89640d27a0 0x7f89640b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896939c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f89640d27a0 0x7f89640b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.187:54986/0 (socket says 172.21.15.187:54986) 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 -- 172.21.15.187:0/3060963062 learned_addr learned my addr 172.21.15.187:0/3060963062 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8968b9b700 1 --1- 172.21.15.187:0/3060963062 >> v1:172.21.15.88:6789/0 conn(0x7f896415d1e0 0x7f89640d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.187:50344/0 (socket says 172.21.15.187:50344) 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 -- 172.21.15.187:0/3060963062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 msgr2=0x7f89640b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 -- 172.21.15.187:0/3060963062 >> v1:172.21.15.88:6789/0 conn(0x7f896415d1e0 legacy=0x7f89640d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f8963fff700 1 -- 172.21.15.187:0/3060963062 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89640d1b20 con 0x7f89640d27a0 2023-08-10T10:30:08.871 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.869+0000 7f896939c700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.872 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f8963fff700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89640d27a0 0x7f89640b4950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f89500098f0 tx=0x7f8950009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb6808b7e88b7a9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f89637fe700 1 -- 172.21.15.187:0/3060963062 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011830 con 0x7f89640d27a0 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f89637fe700 1 -- 172.21.15.187:0/3060963062 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8950011990 con 0x7f89640d27a0 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f89637fe700 1 -- 172.21.15.187:0/3060963062 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8950011d20 con 0x7f89640d27a0 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f896adff700 1 -- 172.21.15.187:0/3060963062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89640d27a0 msgr2=0x7f89640b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.870+0000 7f896adff700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89640d27a0 0x7f89640b4950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f89500098f0 tx=0x7f8950009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 -- 172.21.15.187:0/3060963062 shutdown_connections 2023-08-10T10:30:08.873 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 --2- 172.21.15.187:0/3060963062 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f89640d27a0 0x7f89640b4950 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 -- 172.21.15.187:0/3060963062 >> 172.21.15.187:0/3060963062 conn(0x7f89640cf950 msgr2=0x7f89640cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 -- 172.21.15.187:0/3060963062 shutdown_connections 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.871+0000 7f896adff700 1 -- 172.21.15.187:0/3060963062 wait complete. 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.872+0000 7f896adff700 1 Processor -- start 2023-08-10T10:30:08.874 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.872+0000 7f896adff700 1 -- start start 2023-08-10T10:30:08.876 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.876 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 0x7f8964146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.876 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 0x7f896415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8964157ca0 con 0x7f896415d1e0 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89640c6870 con 0x7f89640d27a0 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.873+0000 7f896adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8964147000 con 0x7f89640b4e90 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8968b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 0x7f8964146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8968b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56416/0 (socket says 172.21.15.187:56416) 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f896939c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 0x7f896415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:08.877 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8968b9b700 1 -- 172.21.15.187:0/1384617767 learned_addr learned my addr 172.21.15.187:0/1384617767 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 -- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 msgr2=0x7f89640c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 -- 172.21.15.187:0/1384617767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 msgr2=0x7f896415eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 0x7f896415eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 -- 172.21.15.187:0/1384617767 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895c009a70 con 0x7f89640d27a0 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8968b9b700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.878 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f896939c700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 0x7f896415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.874+0000 7f8963fff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 0x7f8964146ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8950016000 tx=0x7f8950004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500043c0 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895001f070 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8950009550 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500036a0 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8964157300 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8950021030 con 0x7f89640d27a0 2023-08-10T10:30:08.879 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.875+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f895001ad20 con 0x7f89640d27a0 2023-08-10T10:30:08.880 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.876+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89640743a0 con 0x7f89640d27a0 2023-08-10T10:30:08.880 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.878+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f8950015020 con 0x7f89640d27a0 2023-08-10T10:30:08.965 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.965+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2c3b68f9-e144-42d5-b97b-6ae32791a1de", "id": 4} v 0) v1 -- 0x7f89640cd500 con 0x7f89640d27a0 2023-08-10T10:30:08.971 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.971+0000 7f89617fa700 1 -- 172.21.15.187:0/1384617767 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2c3b68f9-e144-42d5-b97b-6ae32791a1de", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8950003b00 con 0x7f89640d27a0 2023-08-10T10:30:08.971 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-08-10T10:30:08.972 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 msgr2=0x7f8964146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:08.972 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 0x7f8964146ac0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8950016000 tx=0x7f8950004750 comp rx=0 tx=0).stop 2023-08-10T10:30:08.972 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 shutdown_connections 2023-08-10T10:30:08.972 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f896415d1e0 0x7f896415eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.973 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89640b4e90 0x7f89640c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.973 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 --2- 172.21.15.187:0/1384617767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89640d27a0 0x7f8964146ac0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:08.973 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 >> 172.21.15.187:0/1384617767 conn(0x7f89640cf950 msgr2=0x7f896415dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:08.973 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 shutdown_connections 2023-08-10T10:30:08.973 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:08.972+0000 7f896adff700 1 -- 172.21.15.187:0/1384617767 wait complete. 2023-08-10T10:30:08.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 8f487dd6-001e-47ba-a16d-3b80c61b7b29 5 2023-08-10T10:30:09.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.179+0000 7f04e77ff700 1 Processor -- start 2023-08-10T10:30:09.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.179+0000 7f04e77ff700 1 -- start start 2023-08-10T10:30:09.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e77ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04e015d1e0 0x7f04e00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e77ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00d1840 con 0x7f04e00b5060 2023-08-10T10:30:09.181 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e77ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e00d1b20 con 0x7f04e00d1060 2023-08-10T10:30:09.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e77ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e015d5c0 con 0x7f04e015d1e0 2023-08-10T10:30:09.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e4d9a700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f04e00d1060 0x7f04e00b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35952/0 (socket says 172.21.15.187:35952) 2023-08-10T10:30:09.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e4d9a700 1 -- 172.21.15.187:0/3915810890 learned_addr learned my addr 172.21.15.187:0/3915810890 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:09.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04e559b700 1 --2- 172.21.15.187:0/3915810890 >> v2:172.21.15.88:3300/0 conn(0x7f04e015d1e0 0x7f04e00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057191577 0 0) 0x7f04e00d1b20 con 0x7f04e00d1060 2023-08-10T10:30:09.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.181+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04cc0035b0 con 0x7f04e00d1060 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04e559b700 1 -- 172.21.15.187:0/3915810890 >> v1:172.21.15.187:6789/0 conn(0x7f04e00d1060 legacy=0x7f04e00b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04e559b700 1 -- 172.21.15.187:0/3915810890 >> v1:172.21.15.88:6789/0 conn(0x7f04e00b5060 legacy=0x7f04e00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477892753 0 0) 0x7f04e00d1840 con 0x7f04e00b5060 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04e559b700 1 -- 172.21.15.187:0/3915810890 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e00d1e00 con 0x7f04e015d1e0 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04e559b700 1 --2- 172.21.15.187:0/3915810890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e015d1e0 0x7f04e00d27a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009840 tx=0x7f04dc009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d2f161ce825305 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc011830 con 0x7f04e015d1e0 2023-08-10T10:30:09.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc011990 con 0x7f04e015d1e0 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.182+0000 7f04d7fff700 1 -- 172.21.15.187:0/3915810890 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc011d20 con 0x7f04e015d1e0 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 -- 172.21.15.187:0/3915810890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e015d1e0 msgr2=0x7f04e00d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 --2- 172.21.15.187:0/3915810890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e015d1e0 0x7f04e00d27a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f04dc009840 tx=0x7f04dc009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 -- 172.21.15.187:0/3915810890 shutdown_connections 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 --2- 172.21.15.187:0/3915810890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e015d1e0 0x7f04e00d27a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 -- 172.21.15.187:0/3915810890 >> 172.21.15.187:0/3915810890 conn(0x7f04e00cf950 msgr2=0x7f04e00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 -- 172.21.15.187:0/3915810890 shutdown_connections 2023-08-10T10:30:09.186 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.183+0000 7f04e77ff700 1 -- 172.21.15.187:0/3915810890 wait complete. 2023-08-10T10:30:09.187 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.185+0000 7f04e77ff700 1 Processor -- start 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.185+0000 7f04e77ff700 1 -- start start 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 0x7f04e00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 0x7f04e00c7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00caf20 con 0x7f04e00d1060 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00ca960 con 0x7f04e00b5060 2023-08-10T10:30:09.188 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e77ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e00cac40 con 0x7f04e015d1e0 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e5d9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 0x7f04e00c7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:35264/0 (socket says 172.21.15.187:35264) 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 -- 172.21.15.187:0/2466228714 learned_addr learned my addr 172.21.15.187:0/2466228714 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e4d9a700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 0x7f04e00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 -- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 msgr2=0x7f04e00c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 0x7f04e00c7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.189 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 -- 172.21.15.187:0/2466228714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 msgr2=0x7f04e00c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 0x7f04e00c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e559b700 1 -- 172.21.15.187:0/2466228714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04dc0094a0 con 0x7f04e00b5060 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e5d9c700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 0x7f04e00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.186+0000 7f04e4d9a700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 0x7f04e00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04e559b700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0090b0 tx=0x7f04dc004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc01a7e0 con 0x7f04e00b5060 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc01a940 con 0x7f04e00b5060 2023-08-10T10:30:09.190 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc01acd0 con 0x7f04e00b5060 2023-08-10T10:30:09.191 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e00c7400 con 0x7f04e00b5060 2023-08-10T10:30:09.191 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e01f2a80 con 0x7f04e00b5060 2023-08-10T10:30:09.191 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.187+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04dc022070 con 0x7f04e00b5060 2023-08-10T10:30:09.191 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.188+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f04dc01ae30 con 0x7f04e00b5060 2023-08-10T10:30:09.192 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.188+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e00c7920 con 0x7f04e00b5060 2023-08-10T10:30:09.192 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.190+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f04e00c7920 con 0x7f04e00b5060 2023-08-10T10:30:09.276 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.276+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8f487dd6-001e-47ba-a16d-3b80c61b7b29", "id": 5} v 0) v1 -- 0x7f04e01f2c40 con 0x7f04e00b5060 2023-08-10T10:30:09.284 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.283+0000 7f04d5ffb700 1 -- 172.21.15.187:0/2466228714 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8f487dd6-001e-47ba-a16d-3b80c61b7b29", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04dc029070 con 0x7f04e00b5060 2023-08-10T10:30:09.284 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-08-10T10:30:09.285 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 msgr2=0x7f04e00cca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.285 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0090b0 tx=0x7f04dc004750 comp rx=0 tx=0).stop 2023-08-10T10:30:09.285 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 shutdown_connections 2023-08-10T10:30:09.285 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04e015d1e0 0x7f04e00c7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.286 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04e00b5060 0x7f04e00cca30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.286 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 --2- 172.21.15.187:0/2466228714 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04e00d1060 0x7f04e00c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.286 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 >> 172.21.15.187:0/2466228714 conn(0x7f04e00cf950 msgr2=0x7f04e015d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.286 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 shutdown_connections 2023-08-10T10:30:09.286 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.285+0000 7f04e77ff700 1 -- 172.21.15.187:0/2466228714 wait complete. 2023-08-10T10:30:09.303 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d6f6d892-7d5c-463c-8b02-6936d28b9667 6 2023-08-10T10:30:09.322 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:09.321+0000 7f9bf50da200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:30:09.413 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:09.412+0000 7f9bf50da200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:30:09.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.497+0000 7f4c36dff700 1 Processor -- start 2023-08-10T10:30:09.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.497+0000 7f4c36dff700 1 -- start start 2023-08-10T10:30:09.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.498+0000 7f4c36dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c3015d1e0 0x7f4c300d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.498+0000 7f4c36dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 0x7f4c300b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.498+0000 7f4c36dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c300d1840 con 0x7f4c300b4e90 2023-08-10T10:30:09.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.498+0000 7f4c36dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c3015d5c0 con 0x7f4c3015d1e0 2023-08-10T10:30:09.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.498+0000 7f4c36dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300b5300 con 0x7f4c300d1060 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 0x7f4c300b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c3539c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4c300b4e90 0x7f4c300b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35954/0 (socket says 172.21.15.187:35954) 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c3539c700 1 -- 172.21.15.187:0/2114308908 learned_addr learned my addr 172.21.15.187:0/2114308908 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c34b9b700 1 --2- 172.21.15.187:0/2114308908 >> v2:172.21.15.88:3300/0 conn(0x7f4c3015d1e0 0x7f4c300d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2f7fe700 1 -- 172.21.15.187:0/2114308908 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273368923 0 0) 0x7f4c300d1840 con 0x7f4c300b4e90 2023-08-10T10:30:09.501 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2f7fe700 1 -- 172.21.15.187:0/2114308908 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c200035b0 con 0x7f4c300b4e90 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 -- 172.21.15.187:0/2114308908 >> v2:172.21.15.88:3300/0 conn(0x7f4c3015d1e0 msgr2=0x7f4c300d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 --2- 172.21.15.187:0/2114308908 >> v2:172.21.15.88:3300/0 conn(0x7f4c3015d1e0 0x7f4c300d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 -- 172.21.15.187:0/2114308908 >> v1:172.21.15.187:6789/0 conn(0x7f4c300b4e90 legacy=0x7f4c300b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 -- 172.21.15.187:0/2114308908 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300d1b20 con 0x7f4c300d1060 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.499+0000 7f4c2ffff700 1 --2- 172.21.15.187:0/2114308908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 0x7f4c300b4950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009840 tx=0x7f4c1c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eccefdf6dfce9371 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c2f7fe700 1 -- 172.21.15.187:0/2114308908 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c011830 con 0x7f4c300d1060 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c2f7fe700 1 -- 172.21.15.187:0/2114308908 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1c011990 con 0x7f4c300d1060 2023-08-10T10:30:09.502 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c2f7fe700 1 -- 172.21.15.187:0/2114308908 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c011d20 con 0x7f4c300d1060 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 -- 172.21.15.187:0/2114308908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 msgr2=0x7f4c300b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 --2- 172.21.15.187:0/2114308908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 0x7f4c300b4950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c009840 tx=0x7f4c1c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 -- 172.21.15.187:0/2114308908 shutdown_connections 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 --2- 172.21.15.187:0/2114308908 >> v2:172.21.15.88:3300/0 conn(0x7f4c3015d1e0 0x7f4c300d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 --2- 172.21.15.187:0/2114308908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300d1060 0x7f4c300b4950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 -- 172.21.15.187:0/2114308908 >> 172.21.15.187:0/2114308908 conn(0x7f4c300cf950 msgr2=0x7f4c300cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.503 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 -- 172.21.15.187:0/2114308908 shutdown_connections 2023-08-10T10:30:09.504 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.500+0000 7f4c36dff700 1 -- 172.21.15.187:0/2114308908 wait complete. 2023-08-10T10:30:09.505 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.502+0000 7f4c36dff700 1 Processor -- start 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.502+0000 7f4c36dff700 1 -- start start 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 0x7f4c300b68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 0x7f4c300b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300b7660 con 0x7f4c300d1060 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300b7940 con 0x7f4c3015d1e0 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c36dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c300b7c20 con 0x7f4c300b4e90 2023-08-10T10:30:09.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c34b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c3539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 0x7f4c300b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c34b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:56432/0 (socket says 172.21.15.187:56432) 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.503+0000 7f4c34b9b700 1 -- 172.21.15.187:0/1620269607 learned_addr learned my addr 172.21.15.187:0/1620269607 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c2ffff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 0x7f4c300b68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 -- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 msgr2=0x7f4c301f5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 -- 172.21.15.187:0/1620269607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 msgr2=0x7f4c300b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 0x7f4c300b68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 -- 172.21.15.187:0/1620269607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0094a0 con 0x7f4c3015d1e0 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c34b9b700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c2ffff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 0x7f4c300b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c3539c700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 0x7f4c300b6e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800caa0 tx=0x7f4c2800cdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2800a9e0 con 0x7f4c3015d1e0 2023-08-10T10:30:09.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c2800ab40 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.504+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c300b7f00 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.505+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28012400 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.505+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c300b7360 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.505+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4c28012560 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.505+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f4c28012e00 con 0x7f4c3015d1e0 2023-08-10T10:30:09.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.506+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c300c7980 con 0x7f4c3015d1e0 2023-08-10T10:30:09.510 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:09.508+0000 7f7802afc200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-10T10:30:09.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.508+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f4c300c7980 con 0x7f4c3015d1e0 2023-08-10T10:30:09.582 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:09.581+0000 7f9bf50da200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:30:09.593 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.593+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d6f6d892-7d5c-463c-8b02-6936d28b9667", "id": 6} v 0) v1 -- 0x7f4c300743a0 con 0x7f4c3015d1e0 2023-08-10T10:30:09.597 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.597+0000 7f4c2d7fa700 1 -- 172.21.15.187:0/1620269607 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d6f6d892-7d5c-463c-8b02-6936d28b9667", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c28021060 con 0x7f4c3015d1e0 2023-08-10T10:30:09.598 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 msgr2=0x7f4c300b6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 0x7f4c300b6e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800caa0 tx=0x7f4c2800cdb0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 shutdown_connections 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3015d1e0 0x7f4c300b6e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c300b4e90 0x7f4c301f5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.599 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 --2- 172.21.15.187:0/1620269607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c300d1060 0x7f4c300b68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 >> 172.21.15.187:0/1620269607 conn(0x7f4c300cf950 msgr2=0x7f4c3006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.598+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 shutdown_connections 2023-08-10T10:30:09.600 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.599+0000 7f4c36dff700 1 -- 172.21.15.187:0/1620269607 wait complete. 2023-08-10T10:30:09.602 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:09.602+0000 7f7802afc200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-10T10:30:09.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new cb83ac31-09eb-406e-893f-560f89303076 7 2023-08-10T10:30:09.673 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:09.672+0000 7f9bf50da200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:30:09.786 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:09.785+0000 7f7802afc200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-10T10:30:09.815 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.814+0000 7f6a279ff700 1 Processor -- start 2023-08-10T10:30:09.815 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.814+0000 7f6a279ff700 1 -- start start 2023-08-10T10:30:09.818 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a279ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6a200b5060 0x7f6a200b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a279ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200d1840 con 0x7f6a200d27a0 2023-08-10T10:30:09.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a279ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a200d1b20 con 0x7f6a2015d1e0 2023-08-10T10:30:09.819 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a279ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a200d2c50 con 0x7f6a200b5060 2023-08-10T10:30:09.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a2579b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f6a2015d1e0 0x7f6a200d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:35962/0 (socket says 172.21.15.187:35962) 2023-08-10T10:30:09.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a2579b700 1 -- 172.21.15.187:0/3604164316 learned_addr learned my addr 172.21.15.187:0/3604164316 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-08-10T10:30:09.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a25f9c700 1 --2- 172.21.15.187:0/3604164316 >> v2:172.21.15.187:3300/0 conn(0x7f6a200b5060 0x7f6a200b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.820 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 482351432 0 0) 0x7f6a200d1b20 con 0x7f6a2015d1e0 2023-08-10T10:30:09.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a0c0035b0 con 0x7f6a2015d1e0 2023-08-10T10:30:09.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851557136 0 0) 0x7f6a200d1840 con 0x7f6a200d27a0 2023-08-10T10:30:09.821 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a200d1b20 con 0x7f6a200d27a0 2023-08-10T10:30:09.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a25f9c700 1 -- 172.21.15.187:0/3604164316 >> v1:172.21.15.187:6789/0 conn(0x7f6a2015d1e0 legacy=0x7f6a200d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a25f9c700 1 -- 172.21.15.187:0/3604164316 >> v1:172.21.15.88:6789/0 conn(0x7f6a200d27a0 legacy=0x7f6a200b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.816+0000 7f6a25f9c700 1 -- 172.21.15.187:0/3604164316 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a200d1e00 con 0x7f6a200b5060 2023-08-10T10:30:09.822 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a25f9c700 1 --2- 172.21.15.187:0/3604164316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200b5060 0x7f6a200b1940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009d90 tx=0x7f6a1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e72f2b73f6e80d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1800e070 con 0x7f6a200b5060 2023-08-10T10:30:09.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1800bb20 con 0x7f6a200b5060 2023-08-10T10:30:09.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a17fff700 1 -- 172.21.15.187:0/3604164316 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18012430 con 0x7f6a200b5060 2023-08-10T10:30:09.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a279ff700 1 -- 172.21.15.187:0/3604164316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200b5060 msgr2=0x7f6a200b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.817+0000 7f6a279ff700 1 --2- 172.21.15.187:0/3604164316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200b5060 0x7f6a200b1940 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009d90 tx=0x7f6a1800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:09.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.818+0000 7f6a279ff700 1 -- 172.21.15.187:0/3604164316 shutdown_connections 2023-08-10T10:30:09.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.818+0000 7f6a279ff700 1 --2- 172.21.15.187:0/3604164316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200b5060 0x7f6a200b1940 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.818+0000 7f6a279ff700 1 -- 172.21.15.187:0/3604164316 >> 172.21.15.187:0/3604164316 conn(0x7f6a200cf950 msgr2=0x7f6a200cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.818+0000 7f6a279ff700 1 -- 172.21.15.187:0/3604164316 shutdown_connections 2023-08-10T10:30:09.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.818+0000 7f6a279ff700 1 -- 172.21.15.187:0/3604164316 wait complete. 2023-08-10T10:30:09.827 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.819+0000 7f6a279ff700 1 Processor -- start 2023-08-10T10:30:09.827 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.820+0000 7f6a279ff700 1 -- start start 2023-08-10T10:30:09.827 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200d27a0 0x7f6a200c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 0x7f6a2014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c82a0 con 0x7f6a200b5060 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c8580 con 0x7f6a200d27a0 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a279ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a200c8860 con 0x7f6a2015d1e0 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a2579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.828 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a24f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200d27a0 0x7f6a200c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 0x7f6a2014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a2579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.187:55028/0 (socket says 172.21.15.187:55028) 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a2579b700 1 -- 172.21.15.187:0/2604039233 learned_addr learned my addr 172.21.15.187:0/2604039233 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 -- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200d27a0 msgr2=0x7f6a200c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200d27a0 0x7f6a200c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 -- 172.21.15.187:0/2604039233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 msgr2=0x7f6a200c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.829 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a25f9c700 1 -- 172.21.15.187:0/2604039233 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a18009a70 con 0x7f6a2015d1e0 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.821+0000 7f6a2579b700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a25f9c700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 0x7f6a2014a020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a18016000 tx=0x7f6a18004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a18012430 con 0x7f6a2015d1e0 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a18020070 con 0x7f6a2015d1e0 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a200c8b40 con 0x7f6a2015d1e0 2023-08-10T10:30:09.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1801ba70 con 0x7f6a2015d1e0 2023-08-10T10:30:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a200c7fb0 con 0x7f6a2015d1e0 2023-08-10T10:30:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a18027480 con 0x7f6a2015d1e0 2023-08-10T10:30:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.822+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f6a18022070 con 0x7f6a2015d1e0 2023-08-10T10:30:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.823+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a200c9df0 con 0x7f6a2015d1e0 2023-08-10T10:30:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.828+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f6a18027730 con 0x7f6a2015d1e0 2023-08-10T10:30:09.881 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:09.881+0000 7f7802afc200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-10T10:30:09.889 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:09.888+0000 7f9bf50da200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:30:09.914 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.914+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "cb83ac31-09eb-406e-893f-560f89303076", "id": 7} v 0) v1 -- 0x7f6a20160550 con 0x7f6a2015d1e0 2023-08-10T10:30:09.920 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.920+0000 7f6a15ffb700 1 -- 172.21.15.187:0/2604039233 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb83ac31-09eb-406e-893f-560f89303076", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a180279a0 con 0x7f6a2015d1e0 2023-08-10T10:30:09.921 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.921+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 msgr2=0x7f6a2014a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.921+0000 7f6a279ff700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 0x7f6a2014a020 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a18016000 tx=0x7f6a18004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 shutdown_connections 2023-08-10T10:30:09.922 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a2015d1e0 0x7f6a2014a020 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a200b5060 0x7f6a200c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 --2- 172.21.15.187:0/2604039233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a200d27a0 0x7f6a200c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 >> 172.21.15.187:0/2604039233 conn(0x7f6a200cf950 msgr2=0x7f6a200d36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 shutdown_connections 2023-08-10T10:30:09.923 INFO:teuthology.orchestra.run.smithi187.stderr:2023-08-10T10:30:09.922+0000 7f6a279ff700 1 -- 172.21.15.187:0/2604039233 wait complete. 2023-08-10T10:30:09.939 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-10T10:30:09.939 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-10T10:30:09.943 INFO:tasks.ceph.osd.0:Started 2023-08-10T10:30:09.944 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-10T10:30:09.944 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-10T10:30:09.948 INFO:tasks.ceph.osd.1:Started 2023-08-10T10:30:09.948 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-10T10:30:09.949 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-10T10:30:09.953 INFO:tasks.ceph.osd.2:Started 2023-08-10T10:30:09.953 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-10T10:30:09.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-10T10:30:09.958 INFO:tasks.ceph.osd.3:Started 2023-08-10T10:30:09.959 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-10T10:30:09.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-10T10:30:09.963 INFO:tasks.ceph.osd.4:Started 2023-08-10T10:30:09.964 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-10T10:30:09.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-10T10:30:09.968 INFO:tasks.ceph.osd.5:Started 2023-08-10T10:30:09.969 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-10T10:30:09.969 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-10T10:30:09.974 INFO:tasks.ceph.osd.6:Started 2023-08-10T10:30:09.974 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-10T10:30:09.975 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-10T10:30:09.980 INFO:tasks.ceph.osd.7:Started 2023-08-10T10:30:09.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:10.009 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.008+0000 7f9bf50da200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:30:10.138 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.138+0000 7f7802afc200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-10T10:30:10.161 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.159+0000 7f9bf50da200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:30:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.245+0000 7f1211dff700 1 Processor -- start 2023-08-10T10:30:10.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.245+0000 7f1211dff700 1 -- start start 2023-08-10T10:30:10.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f120c15cf20 0x7f120c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f120c0b8870 0x7f120c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c0b5040 0x7f120c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c0cde30 con 0x7f120c0b8870 2023-08-10T10:30:10.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f120c0b54b0 con 0x7f120c15cf20 2023-08-10T10:30:10.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.246+0000 7f1211dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c15e590 con 0x7f120c0b5040 2023-08-10T10:30:10.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f120c0b8870 0x7f120c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f120c0b8870 0x7f120c0b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58802/0 (socket says 172.21.15.88:58802) 2023-08-10T10:30:10.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 -- 172.21.15.88:0/3032468199 learned_addr learned my addr 172.21.15.88:0/3032468199 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:10.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120bfff700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c0b5040 0x7f120c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120b7fe700 1 --2- 172.21.15.88:0/3032468199 >> v2:172.21.15.187:3300/0 conn(0x7f120c15cf20 0x7f120c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 -- 172.21.15.88:0/3032468199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c0b5040 msgr2=0x7f120c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:10.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c0b5040 0x7f120c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 -- 172.21.15.88:0/3032468199 >> v2:172.21.15.187:3300/0 conn(0x7f120c15cf20 msgr2=0x7f120c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:10.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 --2- 172.21.15.88:0/3032468199 >> v2:172.21.15.187:3300/0 conn(0x7f120c15cf20 0x7f120c15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 -- 172.21.15.88:0/3032468199 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f120c0b8e30 con 0x7f120c0b8870 2023-08-10T10:30:10.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120affd700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c0b4b00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f120c06d190 tx=0x7f1200009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccbd468a09d26464 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:10.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.247+0000 7f120a7fc700 1 -- 172.21.15.88:0/3032468199 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200011830 con 0x7f120c0b8870 2023-08-10T10:30:10.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f120a7fc700 1 -- 172.21.15.88:0/3032468199 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1200011990 con 0x7f120c0b8870 2023-08-10T10:30:10.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f120a7fc700 1 -- 172.21.15.88:0/3032468199 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200011d20 con 0x7f120c0b8870 2023-08-10T10:30:10.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 -- 172.21.15.88:0/3032468199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 msgr2=0x7f120c0b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c0b4b00 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f120c06d190 tx=0x7f1200009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:10.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 -- 172.21.15.88:0/3032468199 shutdown_connections 2023-08-10T10:30:10.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 --2- 172.21.15.88:0/3032468199 >> v2:172.21.15.187:3300/0 conn(0x7f120c15cf20 0x7f120c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c0b5040 0x7f120c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 --2- 172.21.15.88:0/3032468199 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c0b4b00 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 -- 172.21.15.88:0/3032468199 >> 172.21.15.88:0/3032468199 conn(0x7f120c0d3080 msgr2=0x7f120c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:10.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 -- 172.21.15.88:0/3032468199 shutdown_connections 2023-08-10T10:30:10.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.248+0000 7f1211dff700 1 -- 172.21.15.88:0/3032468199 wait complete. 2023-08-10T10:30:10.259 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.256+0000 7f7802afc200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-10T10:30:10.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.250+0000 7f1211dff700 1 Processor -- start 2023-08-10T10:30:10.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.250+0000 7f1211dff700 1 -- start start 2023-08-10T10:30:10.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f120c0b5040 0x7f120c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c15cf20 0x7f120c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:10.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c159980 con 0x7f120c0b8870 2023-08-10T10:30:10.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f120c1593d0 con 0x7f120c0b5040 2023-08-10T10:30:10.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f1211dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f120c1596a0 con 0x7f120c15cf20 2023-08-10T10:30:10.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f120affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f120affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58818/0 (socket says 172.21.15.88:58818) 2023-08-10T10:30:10.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f120affd700 1 -- 172.21.15.88:0/611541433 learned_addr learned my addr 172.21.15.88:0/611541433 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:10.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f120b7fe700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f120c0b5040 0x7f120c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.251+0000 7f120bfff700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c15cf20 0x7f120c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:10.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 -- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c15cf20 msgr2=0x7f120c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c15cf20 0x7f120c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 -- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f120c0b5040 msgr2=0x7f120c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f120c0b5040 0x7f120c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 -- 172.21.15.88:0/611541433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1200009550 con 0x7f120c0b8870 2023-08-10T10:30:10.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f120affd700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12000098f0 tx=0x7f1200004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:10.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1200004240 con 0x7f120c0b8870 2023-08-10T10:30:10.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f120001f070 con 0x7f120c0b8870 2023-08-10T10:30:10.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12000045c0 con 0x7f120c0b8870 2023-08-10T10:30:10.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f120c0ca1d0 con 0x7f120c0b8870 2023-08-10T10:30:10.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.252+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f120c0ca790 con 0x7f120c0b8870 2023-08-10T10:30:10.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.253+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1200021030 con 0x7f120c0b8870 2023-08-10T10:30:10.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.253+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f120001ada0 con 0x7f120c0b8870 2023-08-10T10:30:10.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.253+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f120c0ca980 con 0x7f120c0b8870 2023-08-10T10:30:10.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.256+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f1200015020 con 0x7f120c0b8870 2023-08-10T10:30:10.271 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.269+0000 7f9bf50da200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:30:10.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.328+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f120c04ecc0 con 0x7f120c0b8870 2023-08-10T10:30:10.331 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.329+0000 7f11f3fff700 1 -- 172.21.15.88:0/611541433 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f12000039a0 con 0x7f120c0b8870 2023-08-10T10:30:10.332 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:10.332 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":10,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:09.915529+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:10.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 msgr2=0x7f120c159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:10.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12000098f0 tx=0x7f1200004750 comp rx=0 tx=0).stop 2023-08-10T10:30:10.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 shutdown_connections 2023-08-10T10:30:10.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f120c15cf20 0x7f120c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f120c0b5040 0x7f120c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 --2- 172.21.15.88:0/611541433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f120c0b8870 0x7f120c159ff0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:10.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 >> 172.21.15.88:0/611541433 conn(0x7f120c0d3080 msgr2=0x7f120c0b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:10.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 shutdown_connections 2023-08-10T10:30:10.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:10.330+0000 7f1211dff700 1 -- 172.21.15.88:0/611541433 wait complete. 2023-08-10T10:30:10.354 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-10T10:30:10.355 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-10T10:30:10.356 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.355+0000 7f7802afc200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-10T10:30:10.470 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.470+0000 7f7802afc200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-10T10:30:10.507 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.506+0000 7f9bf50da200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:30:10.609 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.607+0000 7f9bf50da200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:30:10.652 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-08-10T10:30:10.652+0000 7f6c031eb640 -1 Falling back to public interface 2023-08-10T10:30:10.659 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-08-10T10:30:10.658+0000 7f113c660640 -1 Falling back to public interface 2023-08-10T10:30:10.665 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-08-10T10:30:10.663+0000 7f0daeeb8640 -1 Falling back to public interface 2023-08-10T10:30:10.679 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-08-10T10:30:10.679+0000 7fb340aa9640 -1 Falling back to public interface 2023-08-10T10:30:10.681 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-08-10T10:30:10.680+0000 7f5d1fdd5640 -1 Falling back to public interface 2023-08-10T10:30:10.689 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-08-10T10:30:10.688+0000 7faa2c452640 -1 Falling back to public interface 2023-08-10T10:30:10.698 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-08-10T10:30:10.698+0000 7fc8b4924640 -1 Falling back to public interface 2023-08-10T10:30:10.699 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.698+0000 7f7802afc200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-10T10:30:10.714 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-08-10T10:30:10.714+0000 7f6c868ea640 -1 Falling back to public interface 2023-08-10T10:30:10.802 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:10.802+0000 7f7802afc200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-10T10:30:10.969 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:10.967+0000 7f9bf50da200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:30:11.060 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:11.058+0000 7f9bf50da200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:30:11.158 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:11.158+0000 7f7802afc200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-10T10:30:11.160 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:11.250 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:11.250+0000 7f7802afc200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-10T10:30:11.337 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.335+0000 7f8297fff700 1 Processor -- start 2023-08-10T10:30:11.337 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.335+0000 7f8297fff700 1 -- start start 2023-08-10T10:30:11.338 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.336+0000 7f8297fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f82900b4840 0x7f82900b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:11.338 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.336+0000 7f8297fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82900d2300 0x7f82900d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:11.338 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.336+0000 7f8297fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82900b5160 con 0x7f829006a170 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.336+0000 7f8297fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900d11c0 con 0x7f82900d2300 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.336+0000 7f8297fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82900d14a0 con 0x7f82900b4840 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82900d2300 0x7f82900d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f82900d2300 0x7f82900d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58824/0 (socket says 172.21.15.88:58824) 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 -- 172.21.15.88:0/2477572498 learned_addr learned my addr 172.21.15.88:0/2477572498 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:11.339 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f8295d9b700 1 --2- 172.21.15.88:0/2477572498 >> v2:172.21.15.187:3300/0 conn(0x7f82900b4840 0x7f82900b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:11.340 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 -- 172.21.15.88:0/2477572498 >> v2:172.21.15.187:3300/0 conn(0x7f82900b4840 msgr2=0x7f82900b4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 --2- 172.21.15.88:0/2477572498 >> v2:172.21.15.187:3300/0 conn(0x7f82900b4840 0x7f82900b4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 -- 172.21.15.88:0/2477572498 >> v1:172.21.15.187:6789/0 conn(0x7f829006a170 legacy=0x7f829006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 -- 172.21.15.88:0/2477572498 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82900d1780 con 0x7f82900d2300 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.337+0000 7f829559a700 1 --2- 172.21.15.88:0/2477572498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900d2300 0x7f82900d2790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82900cf7a0 tx=0x7f8280009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaa00f213a04febf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8294d99700 1 -- 172.21.15.88:0/2477572498 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011830 con 0x7f82900d2300 2023-08-10T10:30:11.341 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8294d99700 1 -- 172.21.15.88:0/2477572498 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8280011990 con 0x7f82900d2300 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8294d99700 1 -- 172.21.15.88:0/2477572498 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280011d20 con 0x7f82900d2300 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 -- 172.21.15.88:0/2477572498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900d2300 msgr2=0x7f82900d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 --2- 172.21.15.88:0/2477572498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900d2300 0x7f82900d2790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f82900cf7a0 tx=0x7f8280009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 -- 172.21.15.88:0/2477572498 shutdown_connections 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 --2- 172.21.15.88:0/2477572498 >> v2:172.21.15.187:3300/0 conn(0x7f82900b4840 0x7f82900b4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 --2- 172.21.15.88:0/2477572498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900d2300 0x7f82900d2790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.342 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 -- 172.21.15.88:0/2477572498 >> 172.21.15.88:0/2477572498 conn(0x7f82900cf840 msgr2=0x7f82900cfc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:11.343 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.338+0000 7f8297fff700 1 -- 172.21.15.88:0/2477572498 shutdown_connections 2023-08-10T10:30:11.343 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.339+0000 7f8297fff700 1 -- 172.21.15.88:0/2477572498 wait complete. 2023-08-10T10:30:11.344 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.340+0000 7f8297fff700 1 Processor -- start 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.340+0000 7f8297fff700 1 -- start start 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f829006a170 0x7f82900c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82900d2300 0x7f82900cc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829015ebc0 con 0x7f82900b4840 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f829015ddb0 con 0x7f82900d2300 2023-08-10T10:30:11.345 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f8297fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f829015e090 con 0x7f829006a170 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f829559a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f829559a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58832/0 (socket says 172.21.15.88:58832) 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.341+0000 7f829559a700 1 -- 172.21.15.88:0/2269439455 learned_addr learned my addr 172.21.15.88:0/2269439455 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f8295d9b700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f829006a170 0x7f82900c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829659c700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82900d2300 0x7f82900cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 -- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f829006a170 msgr2=0x7f82900c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:11.346 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f829006a170 0x7f82900c9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 -- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82900d2300 msgr2=0x7f82900cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82900d2300 0x7f82900cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 -- 172.21.15.88:0/2269439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8280009550 con 0x7f82900b4840 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f829559a700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8280009c10 tx=0x7f8280004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8280004510 con 0x7f82900b4840 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f828001e070 con 0x7f82900b4840 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.342+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f829015e370 con 0x7f82900b4840 2023-08-10T10:30:11.347 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.343+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82800038e0 con 0x7f82900b4840 2023-08-10T10:30:11.348 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.343+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8290154ad0 con 0x7f82900b4840 2023-08-10T10:30:11.348 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.343+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8280003d40 con 0x7f82900b4840 2023-08-10T10:30:11.348 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.343+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f828001aaf0 con 0x7f82900b4840 2023-08-10T10:30:11.348 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.344+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82900c7d00 con 0x7f82900b4840 2023-08-10T10:30:11.348 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.346+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f82900c7d00 con 0x7f82900b4840 2023-08-10T10:30:11.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.418+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f829004e470 con 0x7f82900b4840 2023-08-10T10:30:11.420 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.419+0000 7f82867fc700 1 -- 172.21.15.88:0/2269439455 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f8280020070 con 0x7f82900b4840 2023-08-10T10:30:11.420 INFO:teuthology.misc.health.smithi088.stdout: 2023-08-10T10:30:11.420 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":10,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:09.915529+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:11.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 msgr2=0x7f8290154590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:11.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8280009c10 tx=0x7f8280004750 comp rx=0 tx=0).stop 2023-08-10T10:30:11.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 shutdown_connections 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82900d2300 0x7f82900cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f829006a170 0x7f82900c9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 --2- 172.21.15.88:0/2269439455 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82900b4840 0x7f8290154590 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 >> 172.21.15.88:0/2269439455 conn(0x7f82900cf840 msgr2=0x7f82900b6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 shutdown_connections 2023-08-10T10:30:11.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:11.420+0000 7f8297fff700 1 -- 172.21.15.88:0/2269439455 wait complete. 2023-08-10T10:30:11.436 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-10T10:30:11.696 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:11.695+0000 7f9bf50da200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:30:11.879 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:11.879+0000 7f7802afc200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-10T10:30:12.080 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:12.079+0000 7f9bf50da200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:30:12.262 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:12.261+0000 7f9bf50da200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:30:12.267 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:12.267+0000 7f7802afc200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-10T10:30:12.456 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:12.456+0000 7f7802afc200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:30:12.709 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:12.708+0000 7f9bf50da200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:30:12.896 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:12.895+0000 7f9bf50da200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:30:12.897 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:12.897+0000 7f7802afc200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-10T10:30:13.083 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:13.083+0000 7f7802afc200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-10T10:30:13.088 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:13.087+0000 7f9bf50da200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:30:13.320 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:13.319+0000 7f7802afc200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-10T10:30:13.508 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:13.507+0000 7f9bf50da200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:30:13.791 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-08-10T10:30:13.791+0000 7f7802afc200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-10T10:30:14.210 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-08-10T10:30:14.210+0000 7fb340aa9640 -1 osd.7 0 log_to_monitors true 2023-08-10T10:30:14.211 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-08-10T10:30:14.210+0000 7f113c660640 -1 osd.0 0 log_to_monitors true 2023-08-10T10:30:14.272 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-08-10T10:30:14.271+0000 7f5d1fdd5640 -1 osd.2 0 log_to_monitors true 2023-08-10T10:30:14.289 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-08-10T10:30:14.289+0000 7fc8b4924640 -1 osd.6 0 log_to_monitors true 2023-08-10T10:30:14.422 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-08-10T10:30:14.422+0000 7f6c031eb640 -1 osd.4 0 log_to_monitors true 2023-08-10T10:30:14.461 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-08-10T10:30:14.460+0000 7f0daeeb8640 -1 osd.1 0 log_to_monitors true 2023-08-10T10:30:14.511 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-08-10T10:30:14.510+0000 7faa2c452640 -1 osd.3 0 log_to_monitors true 2023-08-10T10:30:14.529 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:14.528+0000 7f9bae9fa700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-10T10:30:14.530 INFO:tasks.ceph.mgr.y.smithi088.stderr:2023-08-10T10:30:14.528+0000 7f9bae9fa700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-10T10:30:14.532 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-08-10T10:30:14.532+0000 7f6c868ea640 -1 osd.5 0 log_to_monitors true 2023-08-10T10:30:17.726 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-08-10T10:30:17.725+0000 7fb32f9f7700 -1 osd.7 0 waiting for initial osdmap 2023-08-10T10:30:17.732 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-08-10T10:30:17.731+0000 7f112b5f7700 -1 osd.0 0 waiting for initial osdmap 2023-08-10T10:30:17.738 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-08-10T10:30:17.738+0000 7f6bf1ff7700 -1 osd.4 0 waiting for initial osdmap 2023-08-10T10:30:17.740 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-08-10T10:30:17.739+0000 7f5d0ebf7700 -1 osd.2 0 waiting for initial osdmap 2023-08-10T10:30:17.742 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-08-10T10:30:17.742+0000 7fb3271fa700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.760 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-08-10T10:30:17.760+0000 7f6be97fa700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.765 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-08-10T10:30:17.762+0000 7f6c757f7700 -1 osd.5 0 waiting for initial osdmap 2023-08-10T10:30:17.766 INFO:tasks.ceph.osd.0.smithi088.stderr:2023-08-10T10:30:17.765+0000 7f1122dfa700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.777 INFO:tasks.ceph.osd.2.smithi088.stderr:2023-08-10T10:30:17.776+0000 7f5d063fa700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.779 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-08-10T10:30:17.777+0000 7faa1b3f7700 -1 osd.3 0 waiting for initial osdmap 2023-08-10T10:30:17.781 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-08-10T10:30:17.781+0000 7f6c6cffa700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.813 INFO:tasks.ceph.osd.3.smithi088.stderr:2023-08-10T10:30:17.812+0000 7faa12bfa700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:17.838 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-08-10T10:30:17.838+0000 7fc8a37f7700 -1 osd.6 0 waiting for initial osdmap 2023-08-10T10:30:17.853 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-08-10T10:30:17.853+0000 7fc89affa700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:18.242 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:18.274 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-08-10T10:30:18.272+0000 7f0d9ddf7700 -1 osd.1 0 waiting for initial osdmap 2023-08-10T10:30:18.287 INFO:tasks.ceph.osd.1.smithi088.stderr:2023-08-10T10:30:18.286+0000 7f0d955fa700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-10T10:30:18.417 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.416+0000 7fdbb41ff700 1 Processor -- start 2023-08-10T10:30:18.417 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.416+0000 7fdbb41ff700 1 -- start start 2023-08-10T10:30:18.418 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb41ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdbac15cf20 0x7fdbac0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb41ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb41ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac0d2120 con 0x7fdbac0d0da0 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb41ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac0b51d0 con 0x7fdbac15cf20 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb41ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0d1250 con 0x7fdbac0b4820 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb179a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdbac0d0da0 0x7fdbac0d25b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:41444/0 (socket says 172.21.15.88:41444) 2023-08-10T10:30:18.419 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.417+0000 7fdbb179a700 1 -- 172.21.15.88:0/2914171264 learned_addr learned my addr 172.21.15.88:0/2914171264 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:18.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/2914171264 >> v2:172.21.15.187:3300/0 conn(0x7fdbac15cf20 0x7fdbac0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb279c700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.421 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809502120 0 0) 0x7fdbac0d2120 con 0x7fdbac0d0da0 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb980035b0 con 0x7fdbac0d0da0 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117142339 0 0) 0x7fdb980035b0 con 0x7fdbac0d0da0 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 -- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 msgr2=0x7fdbac0b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac0b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 -- 172.21.15.88:0/2914171264 >> v1:172.21.15.88:6789/0 conn(0x7fdbac0d0da0 legacy=0x7fdbac0d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 -- 172.21.15.88:0/2914171264 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0d1510 con 0x7fdbac15cf20 2023-08-10T10:30:18.422 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.418+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac15cf20 0x7fdbac0b88e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009840 tx=0x7fdba8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8426d0020fe4260 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c001670 con 0x7fdbac15cf20 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba8004030 con 0x7fdbac15cf20 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb0f99700 1 -- 172.21.15.88:0/2914171264 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba80043c0 con 0x7fdbac15cf20 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 -- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac15cf20 msgr2=0x7fdbac0b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac15cf20 0x7fdbac0b88e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009840 tx=0x7fdba8009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 -- 172.21.15.88:0/2914171264 shutdown_connections 2023-08-10T10:30:18.423 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac0b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.424 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/2914171264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac15cf20 0x7fdbac0b88e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.424 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 -- 172.21.15.88:0/2914171264 >> 172.21.15.88:0/2914171264 conn(0x7fdbac0cf820 msgr2=0x7fdbac0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:18.424 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 -- 172.21.15.88:0/2914171264 shutdown_connections 2023-08-10T10:30:18.424 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.419+0000 7fdbb41ff700 1 -- 172.21.15.88:0/2914171264 wait complete. 2023-08-10T10:30:18.426 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.421+0000 7fdbb41ff700 1 Processor -- start 2023-08-10T10:30:18.426 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.421+0000 7fdbb41ff700 1 -- start start 2023-08-10T10:30:18.426 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.426 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac0d0da0 0x7fdbac152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.426 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac152860 con 0x7fdbac15cf20 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0c7ba0 con 0x7fdbac0d0da0 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb41ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac0c7e80 con 0x7fdbac0b4820 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb279c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb1f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb1f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:52702/0 (socket says 172.21.15.88:52702) 2023-08-10T10:30:18.427 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb279c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48572/0 (socket says 172.21.15.88:48572) 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb1f9b700 1 -- 172.21.15.88:0/714242980 learned_addr learned my addr 172.21.15.88:0/714242980 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.422+0000 7fdbb179a700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac0d0da0 0x7fdbac152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 -- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 msgr2=0x7fdbac15fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 -- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac0d0da0 msgr2=0x7fdbac152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac0d0da0 0x7fdbac152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.428 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 -- 172.21.15.88:0/714242980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba80094a0 con 0x7fdbac15cf20 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb279c700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdba400eba0 tx=0x7fdba400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba4009a80 con 0x7fdbac15cf20 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba400f040 con 0x7fdbac15cf20 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400cc40 con 0x7fdbac15cf20 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac0c8160 con 0x7fdbac15cf20 2023-08-10T10:30:18.429 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.423+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac151fa0 con 0x7fdbac15cf20 2023-08-10T10:30:18.430 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.424+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac160400 con 0x7fdbac15cf20 2023-08-10T10:30:18.430 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.425+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 4) v1 ==== 88981+0+0 (secure 0 0 0) 0x7fdba4014480 con 0x7fdbac15cf20 2023-08-10T10:30:18.430 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.426+0000 7fdba27fc700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 0x7fdb9006d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:18.431 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.426+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fdba4088e40 con 0x7fdbac15cf20 2023-08-10T10:30:18.431 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.426+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 0x7fdb9006d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:18.431 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.427+0000 7fdbb1f9b700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 0x7fdb9006d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdba8000c00 tx=0x7fdba8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:18.432 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.431+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdba4054eb0 con 0x7fdbac15cf20 2023-08-10T10:30:18.635 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.634+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbac04e470 con 0x7fdbac15cf20 2023-08-10T10:30:18.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.634+0000 7fdba27fc700 1 -- 172.21.15.88:0/714242980 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fdba4018020 con 0x7fdbac15cf20 2023-08-10T10:30:18.636 INFO:teuthology.misc.health.smithi088.stdout: 2023-08-10T10:30:18.636 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":12,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:15.589901+0000","last_up_change":"0.000000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:18.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 msgr2=0x7fdb9006d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 0x7fdb9006d110 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdba8000c00 tx=0x7fdba8008030 comp rx=0 tx=0).stop 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 msgr2=0x7fdbac15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdba400eba0 tx=0x7fdba400eeb0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 shutdown_connections 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdbac15cf20 0x7fdbac15a5e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdb9006ac50 0x7fdb9006d110 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.639 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbac0b4820 0x7fdbac15fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 --2- 172.21.15.88:0/714242980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbac0d0da0 0x7fdbac152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:18.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 >> 172.21.15.88:0/714242980 conn(0x7fdbac0cf820 msgr2=0x7fdbac0cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:18.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 shutdown_connections 2023-08-10T10:30:18.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:18.637+0000 7fdbb41ff700 1 -- 172.21.15.88:0/714242980 wait complete. 2023-08-10T10:30:18.653 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-10T10:30:25.459 DEBUG:teuthology.orchestra.run.smithi088:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:25.595 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:25.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:25.632 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.632+0000 7faea79ff700 1 Processor -- start 2023-08-10T10:30:25.632 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.632+0000 7faea79ff700 1 -- start start 2023-08-10T10:30:25.633 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea006ccb0 0x7faea015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea006a370 0x7faea006a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea79ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faea006d290 con 0x7faea00c9fa0 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faea006d570 con 0x7faea006ccb0 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea006d850 con 0x7faea006a370 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea4f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea006ccb0 0x7faea015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.634 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea4f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faea006ccb0 0x7faea015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39070/0 (socket says 172.21.15.88:39070) 2023-08-10T10:30:25.635 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea4f9a700 1 -- 172.21.15.88:0/2543609402 learned_addr learned my addr 172.21.15.88:0/2543609402 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:25.635 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.633+0000 7faea5f9c700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea006a370 0x7faea006a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7faea4f9a700 1 -- 172.21.15.88:0/2543609402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea006a370 msgr2=0x7faea006a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:25.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7faea4f9a700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea006a370 0x7faea006a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7faea4f9a700 1 -- 172.21.15.88:0/2543609402 >> v1:172.21.15.187:6789/0 conn(0x7faea00c9fa0 legacy=0x7faea00ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7faea4f9a700 1 -- 172.21.15.88:0/2543609402 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faea006db30 con 0x7faea006ccb0 2023-08-10T10:30:25.636 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7faea4f9a700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006ccb0 0x7faea015bf30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae900098f0 tx=0x7fae90009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbb74b810eb9bf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7fae97fff700 1 -- 172.21.15.88:0/2543609402 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90011830 con 0x7faea006ccb0 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7fae97fff700 1 -- 172.21.15.88:0/2543609402 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae90011990 con 0x7faea006ccb0 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.634+0000 7fae97fff700 1 -- 172.21.15.88:0/2543609402 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae90011d20 con 0x7faea006ccb0 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 -- 172.21.15.88:0/2543609402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006ccb0 msgr2=0x7faea015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006ccb0 0x7faea015bf30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fae900098f0 tx=0x7fae90009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 -- 172.21.15.88:0/2543609402 shutdown_connections 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea006a370 0x7faea006a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.637 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 --2- 172.21.15.88:0/2543609402 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006ccb0 0x7faea015bf30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 -- 172.21.15.88:0/2543609402 >> 172.21.15.88:0/2543609402 conn(0x7faea00cb4c0 msgr2=0x7faea00cb8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:25.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 -- 172.21.15.88:0/2543609402 shutdown_connections 2023-08-10T10:30:25.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.635+0000 7faea79ff700 1 -- 172.21.15.88:0/2543609402 wait complete. 2023-08-10T10:30:25.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.638+0000 7faea79ff700 1 Processor -- start 2023-08-10T10:30:25.638 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.638+0000 7faea79ff700 1 -- start start 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faea006ccb0 0x7faea00c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea00c9fa0 0x7faea013f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c36f0 con 0x7faea006a370 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c39d0 con 0x7faea006ccb0 2023-08-10T10:30:25.640 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faea00c3cb0 con 0x7faea00c9fa0 2023-08-10T10:30:25.641 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.639+0000 7faea579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.641 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39074/0 (socket says 172.21.15.88:39074) 2023-08-10T10:30:25.641 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 -- 172.21.15.88:0/3108028474 learned_addr learned my addr 172.21.15.88:0/3108028474 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:25.641 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea4f9a700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faea006ccb0 0x7faea00c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.641 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea5f9c700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea00c9fa0 0x7faea013f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.642 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 -- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea00c9fa0 msgr2=0x7faea013f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea00c9fa0 0x7faea013f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 -- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faea006ccb0 msgr2=0x7faea00c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faea006ccb0 0x7faea00c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 -- 172.21.15.88:0/3108028474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae90009550 con 0x7faea006a370 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7faea579b700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c4d0 tx=0x7fae9c00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.640+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0052d0 con 0x7faea006a370 2023-08-10T10:30:25.643 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.641+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c005430 con 0x7faea006a370 2023-08-10T10:30:25.644 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.641+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea00c3f90 con 0x7faea006a370 2023-08-10T10:30:25.644 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.641+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0038f0 con 0x7faea006a370 2023-08-10T10:30:25.644 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.641+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea01f05b0 con 0x7faea006a370 2023-08-10T10:30:25.644 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.642+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea00c9870 con 0x7faea006a370 2023-08-10T10:30:25.645 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.644+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fae9c003a50 con 0x7faea006a370 2023-08-10T10:30:25.645 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.644+0000 7fae95ffb700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 0x7fae8406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:25.645 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.645+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae9c088320 con 0x7faea006a370 2023-08-10T10:30:25.645 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.645+0000 7faea4f9a700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 0x7fae8406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:25.646 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.645+0000 7faea4f9a700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 0x7fae8406d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae90009c40 tx=0x7fae90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:25.650 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.650+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fae9c053890 con 0x7faea006a370 2023-08-10T10:30:25.850 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.850+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faea0154540 con 0x7faea006a370 2023-08-10T10:30:25.851 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.851+0000 7fae95ffb700 1 -- 172.21.15.88:0/3108028474 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fae9c056eb0 con 0x7faea006a370 2023-08-10T10:30:25.852 INFO:teuthology.misc.health.smithi088.stdout: 2023-08-10T10:30:25.852 INFO:teuthology.misc.health.smithi088.stdout:{"epoch":16,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:22.232692+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:25.854 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.853+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 msgr2=0x7fae8406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.854 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.853+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 0x7fae8406d1a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fae90009c40 tx=0x7fae90008030 comp rx=0 tx=0).stop 2023-08-10T10:30:25.854 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.853+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 msgr2=0x7faea01f0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.853+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fae9c00c4d0 tx=0x7fae9c00c7e0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 shutdown_connections 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8406ace0 0x7fae8406d1a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faea00c9fa0 0x7faea013f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faea006a370 0x7faea01f0070 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 --2- 172.21.15.88:0/3108028474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faea006ccb0 0x7faea00c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 >> 172.21.15.88:0/3108028474 conn(0x7faea00cb4c0 msgr2=0x7faea00b41d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:25.855 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 shutdown_connections 2023-08-10T10:30:25.856 INFO:teuthology.misc.health.smithi088.stderr:2023-08-10T10:30:25.854+0000 7faea79ff700 1 -- 172.21.15.88:0/3108028474 wait complete. 2023-08-10T10:30:25.869 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-10T10:30:25.870 INFO:tasks.ceph:Creating RBD pool 2023-08-10T10:30:25.870 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-10T10:30:26.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.059+0000 7fe78d3ff700 1 Processor -- start 2023-08-10T10:30:26.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.060+0000 7fe78d3ff700 1 -- start start 2023-08-10T10:30:26.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe78815d1e0 0x7fe7880d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 0x7fe7880b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7880b4e90 0x7fe7880b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78815d5c0 con 0x7fe78815d1e0 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7880b52e0 con 0x7fe7880d1060 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe78d3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880d1840 con 0x7fe7880b4e90 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe786ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe78815d1e0 0x7fe7880d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe786ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe78815d1e0 0x7fe7880d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39090/0 (socket says 172.21.15.88:39090) 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.061+0000 7fe786ffd700 1 -- 172.21.15.88:0/4139280539 learned_addr learned my addr 172.21.15.88:0/4139280539 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe7877fe700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7880b4e90 0x7fe7880b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe7867fc700 1 --2- 172.21.15.88:0/4139280539 >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 0x7fe7880b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 -- 172.21.15.88:0/4139280539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7880b4e90 msgr2=0x7fe7880b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7880b4e90 0x7fe7880b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 -- 172.21.15.88:0/4139280539 >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 msgr2=0x7fe7880b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 --2- 172.21.15.88:0/4139280539 >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 0x7fe7880b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 -- 172.21.15.88:0/4139280539 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7880d1b20 con 0x7fe78815d1e0 2023-08-10T10:30:26.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe7867fc700 1 --2- 172.21.15.88:0/4139280539 >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 0x7fe7880b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe786ffd700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe78815d1e0 0x7fe7880d27a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b8fc0 tx=0x7fe778009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c349da373e0691b4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe785ffb700 1 -- 172.21.15.88:0/4139280539 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011830 con 0x7fe78815d1e0 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe785ffb700 1 -- 172.21.15.88:0/4139280539 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe778011990 con 0x7fe78815d1e0 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.062+0000 7fe785ffb700 1 -- 172.21.15.88:0/4139280539 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe778011d20 con 0x7fe78815d1e0 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 -- 172.21.15.88:0/4139280539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe78815d1e0 msgr2=0x7fe7880d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe78815d1e0 0x7fe7880d27a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe7880b8fc0 tx=0x7fe778009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 -- 172.21.15.88:0/4139280539 shutdown_connections 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7880b4e90 0x7fe7880b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/4139280539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe78815d1e0 0x7fe7880d27a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/4139280539 >> v2:172.21.15.187:3300/0 conn(0x7fe7880d1060 0x7fe7880b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 -- 172.21.15.88:0/4139280539 >> 172.21.15.88:0/4139280539 conn(0x7fe7880cf950 msgr2=0x7fe7880cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 -- 172.21.15.88:0/4139280539 shutdown_connections 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.063+0000 7fe78d3ff700 1 -- 172.21.15.88:0/4139280539 wait complete. 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.065+0000 7fe78d3ff700 1 Processor -- start 2023-08-10T10:30:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.065+0000 7fe78d3ff700 1 -- start start 2023-08-10T10:30:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7880b4e90 0x7fe788159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78815d1e0 0x7fe78815f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c92f0 con 0x7fe7880d1060 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c86e0 con 0x7fe7880b4e90 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe78d3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880c89c0 con 0x7fe78815d1e0 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7867fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7867fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39100/0 (socket says 172.21.15.88:39100) 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7867fc700 1 -- 172.21.15.88:0/1711138329 learned_addr learned my addr 172.21.15.88:0/1711138329 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe786ffd700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7880b4e90 0x7fe788159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7877fe700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78815d1e0 0x7fe78815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7867fc700 1 -- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78815d1e0 msgr2=0x7fe78815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.066+0000 7fe7867fc700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78815d1e0 0x7fe78815f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe7867fc700 1 -- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7880b4e90 msgr2=0x7fe788159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe7867fc700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7880b4e90 0x7fe788159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe7867fc700 1 -- 172.21.15.88:0/1711138329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe778009550 con 0x7fe7880d1060 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe7867fc700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e760 tx=0x7fe77c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c00c070 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c013610 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c0139c0 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880c8ca0 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.067+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe788159650 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.068+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7880c94a0 con 0x7fe7880d1060 2023-08-10T10:30:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.069+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe77c013b20 con 0x7fe7880d1060 2023-08-10T10:30:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.070+0000 7fe76f7fe700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 0x7fe77406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.070+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe77c088c60 con 0x7fe7880d1060 2023-08-10T10:30:26.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.071+0000 7fe786ffd700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 0x7fe77406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:26.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.071+0000 7fe786ffd700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 0x7fe77406d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe778009c10 tx=0x7fe778008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.075+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe7880c94a0 con 0x7fe7880d1060 2023-08-10T10:30:26.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:26.273+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fe7880743a0 con 0x7fe7880d1060 2023-08-10T10:30:27.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.274+0000 7fe76f7fe700 1 -- 172.21.15.88:0/1711138329 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fe77c057bb0 con 0x7fe7880d1060 2023-08-10T10:30:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 msgr2=0x7fe77406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 0x7fe77406d1a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe778009c10 tx=0x7fe778008030 comp rx=0 tx=0).stop 2023-08-10T10:30:27.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 msgr2=0x7fe7880aac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe77c00e760 tx=0x7fe77c00ea70 comp rx=0 tx=0).stop 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 shutdown_connections 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe77406ace0 0x7fe77406d1a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78815d1e0 0x7fe78815f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7880b4e90 0x7fe788159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 --2- 172.21.15.88:0/1711138329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe7880d1060 0x7fe7880aac80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 >> 172.21.15.88:0/1711138329 conn(0x7fe7880cf950 msgr2=0x7fe7880b6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 shutdown_connections 2023-08-10T10:30:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.278+0000 7fe78d3ff700 1 -- 172.21.15.88:0/1711138329 wait complete. 2023-08-10T10:30:27.280 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'rbd' created 2023-08-10T10:30:27.299 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-10T10:30:27.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.494+0000 7efc08fff700 1 Processor -- start 2023-08-10T10:30:27.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.494+0000 7efc08fff700 1 -- start start 2023-08-10T10:30:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.495+0000 7efc08fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc040d27a0 0x7efc040b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.495+0000 7efc08fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc040b52e0 con 0x7efc040b4e90 2023-08-10T10:30:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc08fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc040d1840 con 0x7efc0415d1e0 2023-08-10T10:30:27.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc08fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc040d2c50 con 0x7efc040d27a0 2023-08-10T10:30:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc040d27a0 0x7efc040b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc02d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc040b4e90 0x7efc040b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47692/0 (socket says 172.21.15.88:47692) 2023-08-10T10:30:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc040d27a0 0x7efc040b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39104/0 (socket says 172.21.15.88:39104) 2023-08-10T10:30:27.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc02d9d700 1 -- 172.21.15.88:0/1460265520 learned_addr learned my addr 172.21.15.88:0/1460265520 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:27.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 -- 172.21.15.88:0/1460265520 >> v1:172.21.15.187:6789/0 conn(0x7efc0415d1e0 legacy=0x7efc040d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 -- 172.21.15.88:0/1460265520 >> v1:172.21.15.88:6789/0 conn(0x7efc040b4e90 legacy=0x7efc040b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 -- 172.21.15.88:0/1460265520 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc040d1b20 con 0x7efc040d27a0 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc0159a700 1 -- 172.21.15.88:0/1460265520 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995865289 0 0) 0x7efbfc001490 con 0x7efc040b4e90 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.496+0000 7efc01d9b700 1 --2- 172.21.15.88:0/1460265520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040d27a0 0x7efc040b4950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009840 tx=0x7efbf8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=497e3db0d93ee server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc0159a700 1 -- 172.21.15.88:0/1460265520 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf8004230 con 0x7efc040d27a0 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc0159a700 1 -- 172.21.15.88:0/1460265520 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf8004390 con 0x7efc040d27a0 2023-08-10T10:30:27.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc0159a700 1 -- 172.21.15.88:0/1460265520 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf80036a0 con 0x7efc040d27a0 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 -- 172.21.15.88:0/1460265520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040d27a0 msgr2=0x7efc040b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 --2- 172.21.15.88:0/1460265520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040d27a0 0x7efc040b4950 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efbf8009840 tx=0x7efbf8009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 -- 172.21.15.88:0/1460265520 shutdown_connections 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 --2- 172.21.15.88:0/1460265520 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040d27a0 0x7efc040b4950 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 -- 172.21.15.88:0/1460265520 >> 172.21.15.88:0/1460265520 conn(0x7efc040cf950 msgr2=0x7efc040cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 -- 172.21.15.88:0/1460265520 shutdown_connections 2023-08-10T10:30:27.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.497+0000 7efc08fff700 1 -- 172.21.15.88:0/1460265520 wait complete. 2023-08-10T10:30:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.499+0000 7efc08fff700 1 Processor -- start 2023-08-10T10:30:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.499+0000 7efc08fff700 1 -- start start 2023-08-10T10:30:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc040d27a0 0x7efc041f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:27.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc0415d1e0 0x7efc04156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04156df0 con 0x7efc040b4e90 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc04156870 con 0x7efc040d27a0 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc08fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc041f76f0 con 0x7efc0415d1e0 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc0259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc0259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39118/0 (socket says 172.21.15.88:39118) 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.500+0000 7efc0259c700 1 -- 172.21.15.88:0/2964264094 learned_addr learned my addr 172.21.15.88:0/2964264094 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:27.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 -- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc0415d1e0 msgr2=0x7efc04156330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc0415d1e0 0x7efc04156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 -- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc040d27a0 msgr2=0x7efc041f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc040d27a0 0x7efc041f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 -- 172.21.15.88:0/2964264094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efbf80094a0 con 0x7efc040b4e90 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc0259c700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b4d0 tx=0x7efbf400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4011830 con 0x7efc040b4e90 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efbf4011990 con 0x7efc040b4e90 2023-08-10T10:30:27.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc041f6e50 con 0x7efc040b4e90 2023-08-10T10:30:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efbf4011d40 con 0x7efc040b4e90 2023-08-10T10:30:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.501+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc041f7410 con 0x7efc040b4e90 2023-08-10T10:30:27.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.503+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc0406b5e0 con 0x7efc040b4e90 2023-08-10T10:30:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.504+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efbf401a400 con 0x7efc040b4e90 2023-08-10T10:30:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.505+0000 7efbf2ffd700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 0x7efbe406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.505+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7efbf4088e80 con 0x7efc040b4e90 2023-08-10T10:30:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.505+0000 7efc01d9b700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 0x7efbe406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:27.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.505+0000 7efc01d9b700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 0x7efbe406d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc040c89f0 tx=0x7efbf8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:27.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.509+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efbf4054280 con 0x7efc040b4e90 2023-08-10T10:30:27.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:27.706+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7efc040d20e0 con 0x7efc040b4e90 2023-08-10T10:30:28.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.279+0000 7efbf2ffd700 1 -- 172.21.15.88:0/2964264094 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7efbf40150c0 con 0x7efc040b4e90 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 msgr2=0x7efbe406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 0x7efbe406d1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efc040c89f0 tx=0x7efbf8010000 comp rx=0 tx=0).stop 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 msgr2=0x7efc040c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efbf400b4d0 tx=0x7efbf400b890 comp rx=0 tx=0).stop 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 shutdown_connections 2023-08-10T10:30:28.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efbe406ace0 0x7efbe406d1a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc0415d1e0 0x7efc04156330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc040b4e90 0x7efc040c9440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 --2- 172.21.15.88:0/2964264094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc040d27a0 0x7efc041f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 >> 172.21.15.88:0/2964264094 conn(0x7efc040cf950 msgr2=0x7efc040b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 shutdown_connections 2023-08-10T10:30:28.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.283+0000 7efc08fff700 1 -- 172.21.15.88:0/2964264094 wait complete. 2023-08-10T10:30:28.286 INFO:teuthology.orchestra.run.smithi088.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-10T10:30:28.304 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-10T10:30:28.304 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-10T10:30:28.305 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-10T10:30:28.309 INFO:tasks.ceph.mds.a:Started 2023-08-10T10:30:28.309 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-10T10:30:28.309 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-10T10:30:28.313 INFO:tasks.ceph.mds.c:Started 2023-08-10T10:30:28.314 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-10T10:30:28.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-10T10:30:28.319 INFO:tasks.ceph.mds.b:Started 2023-08-10T10:30:28.319 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-10T10:30:28.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-10T10:30:28.323 INFO:tasks.ceph.mds.d:Started 2023-08-10T10:30:28.323 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-10T10:30:28.324 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:28.459 INFO:tasks.ceph.mds.a.smithi088.stdout:starting mds.a at 2023-08-10T10:30:28.461 INFO:tasks.ceph.mds.c.smithi088.stdout:starting mds.c at 2023-08-10T10:30:28.474 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-08-10T10:30:28.475 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-08-10T10:30:28.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.535+0000 7f9fbb5ff700 1 Processor -- start 2023-08-10T10:30:28.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.536+0000 7f9fbb5ff700 1 -- start start 2023-08-10T10:30:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fbb5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fbb5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 0x7f9fb40d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fbb5ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fb40b5480 con 0x7f9fb415cf20 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fbb5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fb40cde30 con 0x7f9fb40b5040 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fbb5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb40b8e30 con 0x7f9fb40b8870 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb9b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 0x7f9fb40d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb9b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 0x7f9fb40d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39158/0 (socket says 172.21.15.88:39158) 2023-08-10T10:30:28.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:53634/0 (socket says 172.21.15.88:53634) 2023-08-10T10:30:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb9b9c700 1 -- 172.21.15.88:0/4127212863 learned_addr learned my addr 172.21.15.88:0/4127212863 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:28.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb939b700 1 --1- 172.21.15.88:0/4127212863 >> v1:172.21.15.187:6789/0 conn(0x7f9fb415cf20 0x7f9fb415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:52026/0 (socket says 172.21.15.88:52026) 2023-08-10T10:30:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 -- 172.21.15.88:0/4127212863 >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 msgr2=0x7f9fb40d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 --2- 172.21.15.88:0/4127212863 >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 0x7f9fb40d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 -- 172.21.15.88:0/4127212863 >> v1:172.21.15.187:6789/0 conn(0x7f9fb415cf20 legacy=0x7f9fb415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fb8b9a700 1 -- 172.21.15.88:0/4127212863 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40ce010 con 0x7f9fb40b8870 2023-08-10T10:30:28.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.537+0000 7f9fabfff700 1 -- 172.21.15.88:0/4127212863 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063051027 0 0) 0x7f9fb40b5480 con 0x7f9fb415cf20 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fb8b9a700 1 --2- 172.21.15.88:0/4127212863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009840 tx=0x7f9fa4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72ebdb77e9b1a58 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fabfff700 1 -- 172.21.15.88:0/4127212863 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4011830 con 0x7f9fb40b8870 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fabfff700 1 -- 172.21.15.88:0/4127212863 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fa4011990 con 0x7f9fb40b8870 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fabfff700 1 -- 172.21.15.88:0/4127212863 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fa4011d20 con 0x7f9fb40b8870 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/4127212863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 msgr2=0x7f9fb40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/4127212863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9fa4009840 tx=0x7f9fa4009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/4127212863 shutdown_connections 2023-08-10T10:30:28.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.538+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/4127212863 >> v2:172.21.15.88:3300/0 conn(0x7f9fb40b5040 0x7f9fb40d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.539+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/4127212863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b8870 0x7f9fb40b4b00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.539+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/4127212863 >> 172.21.15.88:0/4127212863 conn(0x7f9fb40d3080 msgr2=0x7f9fb40d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.539+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/4127212863 shutdown_connections 2023-08-10T10:30:28.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.539+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/4127212863 wait complete. 2023-08-10T10:30:28.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.541+0000 7f9fbb5ff700 1 Processor -- start 2023-08-10T10:30:28.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.541+0000 7f9fbb5ff700 1 -- start start 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b5040 0x7f9fb415fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 0x7f9fb41f5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb4160140 con 0x7f9fb415cf20 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb414e2a0 con 0x7f9fb40b8870 2023-08-10T10:30:28.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.542+0000 7f9fbb5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fb415ed10 con 0x7f9fb40b5040 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39164/0 (socket says 172.21.15.88:39164) 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 -- 172.21.15.88:0/101654716 learned_addr learned my addr 172.21.15.88:0/101654716 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb939b700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b5040 0x7f9fb415fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb8b9a700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 0x7f9fb41f5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 -- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b5040 msgr2=0x7f9fb415fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b5040 0x7f9fb415fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 -- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 msgr2=0x7f9fb41f5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 0x7f9fb41f5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 -- 172.21.15.88:0/101654716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fa40094a0 con 0x7f9fb415cf20 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb8b9a700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 0x7f9fb41f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fb9b9c700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00efc0 tx=0x7f9fac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac003c20 con 0x7f9fb415cf20 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fac00f040 con 0x7f9fb415cf20 2023-08-10T10:30:28.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fb415eff0 con 0x7f9fb415cf20 2023-08-10T10:30:28.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.543+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fac009e80 con 0x7f9fb415cf20 2023-08-10T10:30:28.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.544+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fb415f5b0 con 0x7f9fb415cf20 2023-08-10T10:30:28.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.545+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb404ecc0 con 0x7f9fb415cf20 2023-08-10T10:30:28.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.546+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fac00c930 con 0x7f9fb415cf20 2023-08-10T10:30:28.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.547+0000 7f9fa9ffb700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 0x7f9f9806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.547+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9fac089560 con 0x7f9fb415cf20 2023-08-10T10:30:28.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.547+0000 7f9fb939b700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 0x7f9f9806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.548+0000 7f9fb939b700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 0x7f9f9806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0000f60 tx=0x7f9fb0007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.551+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fac0548c0 con 0x7f9fb415cf20 2023-08-10T10:30:28.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.748+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb40b3750 con 0x7f9fb415cf20 2023-08-10T10:30:28.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.749+0000 7f9fa9ffb700 1 -- 172.21.15.88:0/101654716 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14613 (secure 0 0 0) 0x7f9fac057ee0 con 0x7f9fb415cf20 2023-08-10T10:30:28.750 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:28.750 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":18,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:28.273462+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 msgr2=0x7f9f9806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 0x7f9f9806d1a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9fb0000f60 tx=0x7f9fb0007c90 comp rx=0 tx=0).stop 2023-08-10T10:30:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 msgr2=0x7f9fb41f1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00efc0 tx=0x7f9fac00c3a0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 shutdown_connections 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fb415cf20 0x7f9fb41f1920 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9f9806ace0 0x7f9f9806d1a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fb40b5040 0x7f9fb415fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 --2- 172.21.15.88:0/101654716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fb40b8870 0x7f9fb41f5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 >> 172.21.15.88:0/101654716 conn(0x7f9fb40d3080 msgr2=0x7f9fb40b2c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:28.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 shutdown_connections 2023-08-10T10:30:28.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.751+0000 7f9fbb5ff700 1 -- 172.21.15.88:0/101654716 wait complete. 2023-08-10T10:30:28.769 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:30:28.770 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:30:28.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.966+0000 7ff4bddff700 1 Processor -- start 2023-08-10T10:30:28.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.966+0000 7ff4bddff700 1 -- start start 2023-08-10T10:30:28.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.967+0000 7ff4bddff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff4b80d27a0 0x7ff4b80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.967+0000 7ff4bddff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4b80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4bddff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b80d1840 con 0x7ff4b815d1e0 2023-08-10T10:30:28.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4bddff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80d2c50 con 0x7ff4b80d27a0 2023-08-10T10:30:28.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4bddff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b5320 con 0x7ff4b80b4e90 2023-08-10T10:30:28.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff4b815d1e0 0x7ff4b80d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47706/0 (socket says 172.21.15.88:47706) 2023-08-10T10:30:28.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b77fe700 1 -- 172.21.15.88:0/2046051593 learned_addr learned my addr 172.21.15.88:0/2046051593 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:28.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4b80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4affff700 1 --2- 172.21.15.88:0/2046051593 >> v2:172.21.15.187:3300/0 conn(0x7ff4b80d27a0 0x7ff4b80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 573947878 0 0) 0x7ff4b80d1840 con 0x7ff4b815d1e0 2023-08-10T10:30:28.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4a40035b0 con 0x7ff4b815d1e0 2023-08-10T10:30:28.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2768462018 0 0) 0x7ff4a40035b0 con 0x7ff4b815d1e0 2023-08-10T10:30:28.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 msgr2=0x7ff4b80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:28.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4b80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 >> v2:172.21.15.187:3300/0 conn(0x7ff4b80d27a0 msgr2=0x7ff4b80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 --2- 172.21.15.88:0/2046051593 >> v2:172.21.15.187:3300/0 conn(0x7ff4b80d27a0 0x7ff4b80b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80d1b20 con 0x7ff4b815d1e0 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7ff4a8001670 con 0x7ff4b815d1e0 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.968+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4b80b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 >> v1:172.21.15.88:6789/0 conn(0x7ff4b815d1e0 legacy=0x7ff4b80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4a4003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4a4003f40 0x7ff4a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4a4004d90 0x7ff4a4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80d2c50 con 0x7ff4a4003f40 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b80b5320 con 0x7ff4a4004d90 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a400ba10 con 0x7ff4b80b4e90 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4a4003f40 0x7ff4a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b77fe700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4a4003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4a4004d90 0x7ff4a4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 -- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 msgr2=0x7ff4a4003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4b80b4e90 0x7ff4a4003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 -- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4a4004d90 msgr2=0x7ff4a4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4a4004d90 0x7ff4a4005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 -- 172.21.15.88:0/2046051593 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b0009a70 con 0x7ff4a4003f40 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.969+0000 7ff4affff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4a4003f40 0x7ff4a4004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009b90 tx=0x7ff4a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d64f8d7ea8738b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000e6c0 con 0x7ff4a4003f40 2023-08-10T10:30:28.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a000e820 con 0x7ff4a4003f40 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4b6ffd700 1 -- 172.21.15.88:0/2046051593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4a000eb90 con 0x7ff4a4003f40 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 -- 172.21.15.88:0/2046051593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4a4003f40 msgr2=0x7ff4a4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 --2- 172.21.15.88:0/2046051593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4a4003f40 0x7ff4a4004850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a0009b90 tx=0x7ff4a4005880 comp rx=0 tx=0).stop 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4b7fff700 1 -- 172.21.15.88:0/2046051593 reap_dead start 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 -- 172.21.15.88:0/2046051593 shutdown_connections 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 -- 172.21.15.88:0/2046051593 >> 172.21.15.88:0/2046051593 conn(0x7ff4b80cf950 msgr2=0x7ff4b80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:28.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 -- 172.21.15.88:0/2046051593 shutdown_connections 2023-08-10T10:30:28.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.970+0000 7ff4bddff700 1 -- 172.21.15.88:0/2046051593 wait complete. 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.972+0000 7ff4bddff700 1 Processor -- start 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.972+0000 7ff4bddff700 1 -- start start 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 0x7ff4b8158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4b815fa20 0x7ff4b81564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b815f2e0 con 0x7ff4b815e910 2023-08-10T10:30:28.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8157950 con 0x7ff4b815fa20 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4bddff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8159600 con 0x7ff4a4003f40 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4b7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39178/0 (socket says 172.21.15.88:39178) 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4b77fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 0x7ff4b8158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4b7fff700 1 -- 172.21.15.88:0/1385589409 learned_addr learned my addr 172.21.15.88:0/1385589409 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.973+0000 7ff4affff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4b815fa20 0x7ff4b81564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 -- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 msgr2=0x7ff4b8158d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 0x7ff4b8158d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 -- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4b815fa20 msgr2=0x7ff4b81564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4b815fa20 0x7ff4b81564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 -- 172.21.15.88:0/1385589409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b81598e0 con 0x7ff4b815e910 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b77fe700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 0x7ff4b8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b7fff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80d3f70 tx=0x7ff4b000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b000e040 con 0x7ff4b815e910 2023-08-10T10:30:28.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b000f040 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b8159bc0 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b0003a20 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.974+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b8159280 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.975+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b80743a0 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.976+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff4b0015430 con 0x7ff4b815e910 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.977+0000 7ff4b4ff9700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 0x7ff49806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:28.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.977+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7ff4b00896e0 con 0x7ff4b815e910 2023-08-10T10:30:28.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.977+0000 7ff4b77fe700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 0x7ff49806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:28.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.978+0000 7ff4b77fe700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 0x7ff49806d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8001820 tx=0x7ff4a8007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:28.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:28.981+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff4b0054ad0 con 0x7ff4b815e910 2023-08-10T10:30:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.175+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4b80ceda0 con 0x7ff4b815e910 2023-08-10T10:30:29.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.176+0000 7ff4b4ff9700 1 -- 172.21.15.88:0/1385589409 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4b00580f0 con 0x7ff4b815e910 2023-08-10T10:30:29.176 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 msgr2=0x7ff49806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 0x7ff49806d1a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8001820 tx=0x7ff4a8007980 comp rx=0 tx=0).stop 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 msgr2=0x7ff4b815eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff4b80d3f70 tx=0x7ff4b000f490 comp rx=0 tx=0).stop 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 shutdown_connections 2023-08-10T10:30:29.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff4b815e910 0x7ff4b815eda0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff49806ace0 0x7ff49806d1a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4a4003f40 0x7ff4b8158d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 --2- 172.21.15.88:0/1385589409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4b815fa20 0x7ff4b81564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 >> 172.21.15.88:0/1385589409 conn(0x7ff4b80cf950 msgr2=0x7ff4b80cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.178+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 shutdown_connections 2023-08-10T10:30:29.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.179+0000 7ff4bddff700 1 -- 172.21.15.88:0/1385589409 wait complete. 2023-08-10T10:30:29.197 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:30:29.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.397+0000 7f6a9219d700 1 Processor -- start 2023-08-10T10:30:29.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.397+0000 7f6a9219d700 1 -- start start 2023-08-10T10:30:29.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.398+0000 7f6a9219d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c0d2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.398+0000 7f6a9219d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a8c0b82c0 0x7f6a8c0b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.398+0000 7f6a9219d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c15d210 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.398+0000 7f6a9219d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b5e90 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.398+0000 7f6a9219d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0b5240 con 0x7f6a8c15ce30 2023-08-10T10:30:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a8c0b82c0 0x7f6a8c0b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9199c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6a8c0b4d90 0x7f6a8c0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47714/0 (socket says 172.21.15.88:47714) 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9199c700 1 -- 172.21.15.88:0/3725102570 learned_addr learned my addr 172.21.15.88:0/3725102570 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9119b700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c0d2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 -- 172.21.15.88:0/3725102570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 msgr2=0x7f6a8c0d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c0d2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 -- 172.21.15.88:0/3725102570 >> v1:172.21.15.88:6789/0 conn(0x7f6a8c0b4d90 legacy=0x7f6a8c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 -- 172.21.15.88:0/3725102570 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c06a5e0 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.399+0000 7f6a9099a700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0b4850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009840 tx=0x7f6a7c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac83e91f5ea9f94 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a83fff700 1 -- 172.21.15.88:0/3725102570 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011830 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a83fff700 1 -- 172.21.15.88:0/3725102570 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c011990 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a83fff700 1 -- 172.21.15.88:0/3725102570 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011d20 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 -- 172.21.15.88:0/3725102570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b82c0 msgr2=0x7f6a8c0b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0b4850 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009840 tx=0x7f6a7c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 -- 172.21.15.88:0/3725102570 shutdown_connections 2023-08-10T10:30:29.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c0d2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 --2- 172.21.15.88:0/3725102570 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0b4850 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 -- 172.21.15.88:0/3725102570 >> 172.21.15.88:0/3725102570 conn(0x7f6a8c0cf850 msgr2=0x7f6a8c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 -- 172.21.15.88:0/3725102570 shutdown_connections 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.400+0000 7f6a9219d700 1 -- 172.21.15.88:0/3725102570 wait complete. 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.402+0000 7f6a9219d700 1 Processor -- start 2023-08-10T10:30:29.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.402+0000 7f6a9219d700 1 -- start start 2023-08-10T10:30:29.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c1f67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c1f63b0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c155110 con 0x7f6a8c0b82c0 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9219d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c154870 con 0x7f6a8c15ce30 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39204/0 (socket says 172.21.15.88:39204) 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.403+0000 7f6a9119b700 1 -- 172.21.15.88:0/650124419 learned_addr learned my addr 172.21.15.88:0/650124419 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9199c700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c1f67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 -- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 msgr2=0x7f6a8c1f67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9099a700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c1f67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 -- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 msgr2=0x7f6a8c0cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 -- 172.21.15.88:0/650124419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a7c0094a0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9099a700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9199c700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c1f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:29.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9119b700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9e0 tx=0x7f6a8800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a88009710 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8800c7f0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c154b50 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8800cb60 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.404+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c154520 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.405+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c1f64f0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.406+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a8800ccc0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.408+0000 7f6a81ffb700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 0x7f6a7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.408+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6a880891d0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.408+0000 7f6a9099a700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 0x7f6a7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.408+0000 7f6a9099a700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 0x7f6a7006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009840 tx=0x7f6a7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.412+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a880545c0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.621+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6a8c0677f0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.622+0000 7f6a81ffb700 1 -- 172.21.15.88:0/650124419 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6a88057be0 con 0x7f6a8c0b4d90 2023-08-10T10:30:29.622 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:30:29.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 msgr2=0x7f6a7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 0x7f6a7006d1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c009840 tx=0x7f6a7c008030 comp rx=0 tx=0).stop 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 msgr2=0x7f6a8c15ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800e9e0 tx=0x7f6a8800eda0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 shutdown_connections 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a7006ace0 0x7f6a7006d1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c15ce30 0x7f6a8c1f67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b4d90 0x7f6a8c15ab90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 --2- 172.21.15.88:0/650124419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0b82c0 0x7f6a8c0cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 >> 172.21.15.88:0/650124419 conn(0x7f6a8c0cf850 msgr2=0x7f6a8c0b7760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:29.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 shutdown_connections 2023-08-10T10:30:29.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.624+0000 7f6a9219d700 1 -- 172.21.15.88:0/650124419 wait complete. 2023-08-10T10:30:29.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:29.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.838+0000 7f05ebfff700 1 Processor -- start 2023-08-10T10:30:29.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.839+0000 7f05ebfff700 1 -- start start 2023-08-10T10:30:29.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ebfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05ec0b4fb0 0x7f05ec0d2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ebfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0d1e50 con 0x7f05ec15cf10 2023-08-10T10:30:29.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ebfff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05ec0b6030 con 0x7f05ec0d0e60 2023-08-10T10:30:29.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ebfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05ec0d15b0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05eaffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f05ec15cf10 0x7f05ec0b48a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47726/0 (socket says 172.21.15.88:47726) 2023-08-10T10:30:29.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05eaffd700 1 -- 172.21.15.88:0/1258424618 learned_addr learned my addr 172.21.15.88:0/1258424618 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:29.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ea7fc700 1 --2- 172.21.15.88:0/1258424618 >> v2:172.21.15.187:3300/0 conn(0x7f05ec0b4fb0 0x7f05ec0d2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05e9ffb700 1 -- 172.21.15.88:0/1258424618 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2657865169 0 0) 0x7f05ec0d1e50 con 0x7f05ec15cf10 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05e9ffb700 1 -- 172.21.15.88:0/1258424618 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05d40035b0 con 0x7f05ec15cf10 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.841+0000 7f05ea7fc700 1 -- 172.21.15.88:0/1258424618 >> v1:172.21.15.187:6789/0 conn(0x7f05ec0d0e60 legacy=0x7f05ec0b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05ea7fc700 1 -- 172.21.15.88:0/1258424618 >> v1:172.21.15.88:6789/0 conn(0x7f05ec15cf10 legacy=0x7f05ec0b48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05ea7fc700 1 -- 172.21.15.88:0/1258424618 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec0d1890 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05ea7fc700 1 --2- 172.21.15.88:0/1258424618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec0d2890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9df9d5ca82de654 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05e9ffb700 1 -- 172.21.15.88:0/1258424618 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011830 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05e9ffb700 1 -- 172.21.15.88:0/1258424618 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05e0011990 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.842+0000 7f05e9ffb700 1 -- 172.21.15.88:0/1258424618 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e0011d20 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 -- 172.21.15.88:0/1258424618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec0b4fb0 msgr2=0x7f05ec0d2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 --2- 172.21.15.88:0/1258424618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec0d2890 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f05e0009840 tx=0x7f05e0009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 -- 172.21.15.88:0/1258424618 shutdown_connections 2023-08-10T10:30:29.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 --2- 172.21.15.88:0/1258424618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec0d2890 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 -- 172.21.15.88:0/1258424618 >> 172.21.15.88:0/1258424618 conn(0x7f05ec0cf8a0 msgr2=0x7f05ec0cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 -- 172.21.15.88:0/1258424618 shutdown_connections 2023-08-10T10:30:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.843+0000 7f05ebfff700 1 -- 172.21.15.88:0/1258424618 wait complete. 2023-08-10T10:30:29.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.845+0000 7f05ebfff700 1 Processor -- start 2023-08-10T10:30:29.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.845+0000 7f05ebfff700 1 -- start start 2023-08-10T10:30:29.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.846+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05ec0d0e60 0x7f05ec15f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ebfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec15cf10 0x7f05ec153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ebfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec153540 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ebfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec158430 con 0x7f05ec15cf10 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ebfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05ec158710 con 0x7f05ec0d0e60 2023-08-10T10:30:29.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39208/0 (socket says 172.21.15.88:39208) 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 -- 172.21.15.88:0/3549391803 learned_addr learned my addr 172.21.15.88:0/3549391803 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05ea7fc700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05ec0d0e60 0x7f05ec15f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eb7fe700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec15cf10 0x7f05ec153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 -- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05ec0d0e60 msgr2=0x7f05ec15f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05ec0d0e60 0x7f05ec15f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 -- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec15cf10 msgr2=0x7f05ec153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec15cf10 0x7f05ec153000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 -- 172.21.15.88:0/3549391803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05e00094a0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.847+0000 7f05eaffd700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001eb0 tx=0x7f05dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.848+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc005d70 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.848+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05dc0070d0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.848+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05dc007460 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.848+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05ec1589f0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.848+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05ec158fb0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.849+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05ec067ca0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.850+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f05dc0075c0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.851+0000 7f05d37fe700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 0x7f05d806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.851+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f05dc0886f0 con 0x7f05ec0b4fb0 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.851+0000 7f05ea7fc700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 0x7f05d806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:29.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.852+0000 7f05ea7fc700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 0x7f05d806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:29.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:29.855+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f05dc053af0 con 0x7f05ec0b4fb0 2023-08-10T10:30:30.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.092+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05ec073380 con 0x7f05ec0b4fb0 2023-08-10T10:30:30.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.092+0000 7f05d37fe700 1 -- 172.21.15.88:0/3549391803 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7f05dc017de0 con 0x7f05ec0b4fb0 2023-08-10T10:30:30.093 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:30.093 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4293,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-08-10T10:30:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.094+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 msgr2=0x7f05d806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.094+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 0x7f05d806d1a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f05e00090b0 tx=0x7f05e0008030 comp rx=0 tx=0).stop 2023-08-10T10:30:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.094+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 msgr2=0x7f05ec157d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.094+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05dc001eb0 tx=0x7f05dc00c860 comp rx=0 tx=0).stop 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 shutdown_connections 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05ec15cf10 0x7f05ec153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05ec0b4fb0 0x7f05ec157d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f05d806ace0 0x7f05d806d1a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 --2- 172.21.15.88:0/3549391803 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05ec0d0e60 0x7f05ec15f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 >> 172.21.15.88:0/3549391803 conn(0x7f05ec0cf8a0 msgr2=0x7f05ec06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:30.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 shutdown_connections 2023-08-10T10:30:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.095+0000 7f05ebfff700 1 -- 172.21.15.88:0/3549391803 wait complete. 2023-08-10T10:30:30.097 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 3 2023-08-10T10:30:30.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:30.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.310+0000 7f6022fff700 1 Processor -- start 2023-08-10T10:30:30.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.310+0000 7f6022fff700 1 -- start start 2023-08-10T10:30:30.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6022fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f601c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6022fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c0c9890 con 0x7f601c15ad10 2023-08-10T10:30:30.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6022fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f601c15f820 con 0x7f601c0b1eb0 2023-08-10T10:30:30.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6022fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0b28a0 con 0x7f601c0710a0 2023-08-10T10:30:30.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6020d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f601c15ad10 0x7f601c06b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47732/0 (socket says 172.21.15.88:47732) 2023-08-10T10:30:30.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.311+0000 7f6020d9b700 1 -- 172.21.15.88:0/4186953670 learned_addr learned my addr 172.21.15.88:0/4186953670 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:30.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f602159c700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f601c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2508509092 0 0) 0x7f601c0c9890 con 0x7f601c15ad10 2023-08-10T10:30:30.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f600c0035b0 con 0x7f601c15ad10 2023-08-10T10:30:30.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290701832 0 0) 0x7f600c0035b0 con 0x7f601c15ad10 2023-08-10T10:30:30.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 msgr2=0x7f601c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f601c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 >> v1:172.21.15.187:6789/0 conn(0x7f601c0b1eb0 legacy=0x7f601c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c15f540 con 0x7f601c15ad10 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f6010001670 con 0x7f601c15ad10 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 >> v1:172.21.15.88:6789/0 conn(0x7f601c15ad10 legacy=0x7f601c06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f600c004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f600c004d90 0x7f600c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0b28a0 con 0x7f600c004d90 2023-08-10T10:30:30.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bac0 con 0x7f600c003a30 2023-08-10T10:30:30.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f600c00bc50 con 0x7f601c0710a0 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f602159c700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f600c004d90 0x7f600c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f6020d9b700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.312+0000 7f601bfff700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f600c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 -- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 msgr2=0x7f600c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f600c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 -- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c003a30 msgr2=0x7f600c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c003a30 0x7f600c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 -- 172.21.15.88:0/4186953670 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c0035b0 con 0x7f600c004d90 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f601bfff700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0710a0 0x7f600c004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f602159c700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f600c004d90 0x7f600c005210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6014009fc0 tx=0x7f600c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c99bcac1024fe5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400ec30 con 0x7f600c004d90 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601400f040 con 0x7f600c004d90 2023-08-10T10:30:30.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.313+0000 7f601b7fe700 1 -- 172.21.15.88:0/4186953670 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014014480 con 0x7f600c004d90 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 -- 172.21.15.88:0/4186953670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f600c004d90 msgr2=0x7f600c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 --2- 172.21.15.88:0/4186953670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f600c004d90 0x7f600c005210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6014009fc0 tx=0x7f600c005880 comp rx=0 tx=0).stop 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f602159c700 1 -- 172.21.15.88:0/4186953670 reap_dead start 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 -- 172.21.15.88:0/4186953670 shutdown_connections 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 -- 172.21.15.88:0/4186953670 >> 172.21.15.88:0/4186953670 conn(0x7f601c0ced50 msgr2=0x7f601c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 -- 172.21.15.88:0/4186953670 shutdown_connections 2023-08-10T10:30:30.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.314+0000 7f6022fff700 1 -- 172.21.15.88:0/4186953670 wait complete. 2023-08-10T10:30:30.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.316+0000 7f6022fff700 1 Processor -- start 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.316+0000 7f6022fff700 1 -- start start 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c004d90 0x7f601c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0ac630 0x7f601c0acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0aef20 con 0x7f601c0afce0 2023-08-10T10:30:30.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0af200 con 0x7f600c004d90 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6022fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f601c0af4e0 con 0x7f601c0ac630 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39224/0 (socket says 172.21.15.88:39224) 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 -- 172.21.15.88:0/3037330926 learned_addr learned my addr 172.21.15.88:0/3037330926 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f6020d9b700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c004d90 0x7f601c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f602159c700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0ac630 0x7f601c0acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 -- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0ac630 msgr2=0x7f601c0acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0ac630 0x7f601c0acbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 -- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c004d90 msgr2=0x7f601c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c004d90 0x7f601c159090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.317+0000 7f601bfff700 1 -- 172.21.15.88:0/3037330926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c0af7c0 con 0x7f601c0afce0 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f601bfff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f600800e800 tx=0x7f600800eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080052e0 con 0x7f601c0afce0 2023-08-10T10:30:30.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6008005440 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c1595d0 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60080038c0 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.318+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c1f6820 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.319+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f601c0afa00 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.320+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6008003a20 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.321+0000 7f60197fa700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 0x7f600006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.321+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6008089840 con 0x7f601c0afce0 2023-08-10T10:30:30.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.322+0000 7f6020d9b700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 0x7f600006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.322+0000 7f6020d9b700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 0x7f600006d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6010001050 tx=0x7f6010000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.327 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.324+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6008054c20 con 0x7f601c0afce0 2023-08-10T10:30:30.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.524+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f601c0af060 con 0x7f601c0afce0 2023-08-10T10:30:30.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.525+0000 7f60197fa700 1 -- 172.21.15.88:0/3037330926 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14600 (secure 0 0 0) 0x7f601c0af060 con 0x7f601c0afce0 2023-08-10T10:30:30.525 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:30.525 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:29.278239+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:30.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 msgr2=0x7f600006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 0x7f600006d1d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6010001050 tx=0x7f6010000f80 comp rx=0 tx=0).stop 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 msgr2=0x7f601c1f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f600800e800 tx=0x7f600800eb10 comp rx=0 tx=0).stop 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 shutdown_connections 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f600006ad10 0x7f600006d1d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f601c0ac630 0x7f601c0acbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600c004d90 0x7f601c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 --2- 172.21.15.88:0/3037330926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f601c0afce0 0x7f601c1f62e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 >> 172.21.15.88:0/3037330926 conn(0x7f601c0ced50 msgr2=0x7f601c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 shutdown_connections 2023-08-10T10:30:30.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.527+0000 7f6022fff700 1 -- 172.21.15.88:0/3037330926 wait complete. 2023-08-10T10:30:30.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-10T10:30:30.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:30:30.744 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.744+0000 7f6aeedff700 1 Processor -- start 2023-08-10T10:30:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.744+0000 7f6aeedff700 1 -- start start 2023-08-10T10:30:30.745 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aeedff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ae80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aeedff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80d1840 con 0x7f6ae815d1e0 2023-08-10T10:30:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aeedff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae80d1b20 con 0x7f6ae80d27a0 2023-08-10T10:30:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aeedff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80d2c50 con 0x7f6ae80b5060 2023-08-10T10:30:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aecb9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6ae815d1e0 0x7f6ae80d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47734/0 (socket says 172.21.15.88:47734) 2023-08-10T10:30:30.746 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.745+0000 7f6aecb9b700 1 -- 172.21.15.88:0/874584250 learned_addr learned my addr 172.21.15.88:0/874584250 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 309631153 0 0) 0x7f6ae80d1840 con 0x7f6ae815d1e0 2023-08-10T10:30:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6aed39c700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ae80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.748 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad80035b0 con 0x7f6ae815d1e0 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2628760825 0 0) 0x7f6ad80035b0 con 0x7f6ae815d1e0 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 msgr2=0x7f6ae80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ae80b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 >> v1:172.21.15.187:6789/0 conn(0x7f6ae80d27a0 legacy=0x7f6ae80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae80d1e00 con 0x7f6ae815d1e0 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f6adc001670 con 0x7f6ae815d1e0 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 >> v1:172.21.15.88:6789/0 conn(0x7f6ae815d1e0 legacy=0x7f6ae80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ad8003a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ad8004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ad8004d90 0x7f6ad8005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80d2c50 con 0x7f6ad8003f70 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad800ba70 con 0x7f6ad8004d90 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad800bc30 con 0x7f6ae80b5060 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.746+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ad8004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6aecb9b700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ad8003a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6aed39c700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ad8004d90 0x7f6ad8005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 -- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 msgr2=0x7f6ad8003a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80b5060 0x7f6ad8003a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 -- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ad8004d90 msgr2=0x7f6ad8005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ad8004d90 0x7f6ad8005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 -- 172.21.15.88:0/874584250 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80035b0 con 0x7f6ad8003f70 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ad8004850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4001900 tx=0x7f6ad8005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55aa4089623e62b7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4016070 con 0x7f6ad8003f70 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4001c70 con 0x7f6ad8003f70 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.747+0000 7f6ae77fe700 1 -- 172.21.15.88:0/874584250 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad40013f0 con 0x7f6ad8003f70 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 -- 172.21.15.88:0/874584250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 msgr2=0x7f6ad8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 --2- 172.21.15.88:0/874584250 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ad8004850 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4001900 tx=0x7f6ad8005880 comp rx=0 tx=0).stop 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aed39c700 1 -- 172.21.15.88:0/874584250 reap_dead start 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 -- 172.21.15.88:0/874584250 shutdown_connections 2023-08-10T10:30:30.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 -- 172.21.15.88:0/874584250 >> 172.21.15.88:0/874584250 conn(0x7f6ae80cf950 msgr2=0x7f6ae80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 -- 172.21.15.88:0/874584250 shutdown_connections 2023-08-10T10:30:30.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.748+0000 7f6aeedff700 1 -- 172.21.15.88:0/874584250 wait complete. 2023-08-10T10:30:30.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.750+0000 7f6aeedff700 1 Processor -- start 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.750+0000 7f6aeedff700 1 -- start start 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 0x7f6ae80c9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ae80b2fb0 0x7f6ae80b3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae80b39a0 con 0x7f6ad8003f70 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f2850 con 0x7f6ae80b2fb0 2023-08-10T10:30:30.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aeedff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae81f2b30 con 0x7f6ae80c69e0 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39230/0 (socket says 172.21.15.88:39230) 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 -- 172.21.15.88:0/639848412 learned_addr learned my addr 172.21.15.88:0/639848412 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 0x7f6ae80c9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aed39c700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ae80b2fb0 0x7f6ae80b3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 -- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 msgr2=0x7f6ae80c9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 0x7f6ae80c9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 -- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ae80b2fb0 msgr2=0x7f6ae80b3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ae80b2fb0 0x7f6ae80b3460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6aecb9b700 1 -- 172.21.15.88:0/639848412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae81f2e10 con 0x7f6ad8003f70 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.751+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 0x7f6ae80c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6aecb9b700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0011e0 tx=0x7f6adc007570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00f5e0 con 0x7f6ad8003f70 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6adc00f760 con 0x7f6ad8003f70 2023-08-10T10:30:30.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae81f30f0 con 0x7f6ad8003f70 2023-08-10T10:30:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6adc00fb10 con 0x7f6ad8003f70 2023-08-10T10:30:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.752+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae81f3460 con 0x7f6ad8003f70 2023-08-10T10:30:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.753+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae80743a0 con 0x7f6ad8003f70 2023-08-10T10:30:30.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.754+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6adc00fc70 con 0x7f6ad8003f70 2023-08-10T10:30:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.755+0000 7f6ae57fa700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 0x7f6acc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.755+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6adc089090 con 0x7f6ad8003f70 2023-08-10T10:30:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.755+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 0x7f6acc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.756+0000 7f6ae7fff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 0x7f6acc06d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4014040 tx=0x7f6ad400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:30.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.759+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6adc054480 con 0x7f6ad8003f70 2023-08-10T10:30:30.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.953+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ae80b47c0 con 0x7f6ad8003f70 2023-08-10T10:30:30.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.953+0000 7f6ae57fa700 1 -- 172.21.15.88:0/639848412 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6adc057aa0 con 0x7f6ad8003f70 2023-08-10T10:30:30.954 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:30:30.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 msgr2=0x7f6acc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 0x7f6acc06d1a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6ad4014040 tx=0x7f6ad400a000 comp rx=0 tx=0).stop 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 msgr2=0x7f6ae815bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0011e0 tx=0x7f6adc007570 comp rx=0 tx=0).stop 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 shutdown_connections 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ae80b2fb0 0x7f6ae80b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6ad8003f70 0x7f6ae815bd80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6acc06ace0 0x7f6acc06d1a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 --2- 172.21.15.88:0/639848412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ae80c69e0 0x7f6ae80c9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:30.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 >> 172.21.15.88:0/639848412 conn(0x7f6ae80cf950 msgr2=0x7f6ae80b8700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:30.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 shutdown_connections 2023-08-10T10:30:30.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:30.956+0000 7f6aeedff700 1 -- 172.21.15.88:0/639848412 wait complete. 2023-08-10T10:30:30.974 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:30:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.173+0000 7f98b0bff700 1 Processor -- start 2023-08-10T10:30:31.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.174+0000 7f98b0bff700 1 -- start start 2023-08-10T10:30:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98b0bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98ac0d0f90 0x7f98ac0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98b0bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac0b4e90 0x7f98ac0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98b0bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98ac15d3a0 con 0x7f98ac15cfc0 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98b0bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98ac0b52b0 con 0x7f98ac0d0f90 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98b0bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac0b5fc0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98aa59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98ac15cfc0 0x7f98ac0d26f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:47748/0 (socket says 172.21.15.88:47748) 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98aa59c700 1 -- 172.21.15.88:0/703055281 learned_addr learned my addr 172.21.15.88:0/703055281 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98a3fff700 1 --2- 172.21.15.88:0/703055281 >> v2:172.21.15.187:3300/0 conn(0x7f98ac0d0f90 0x7f98ac0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98aad9d700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac0b4e90 0x7f98ac0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98a9d9b700 1 -- 172.21.15.88:0/703055281 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261382381 0 0) 0x7f98ac15d3a0 con 0x7f98ac15cfc0 2023-08-10T10:30:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.175+0000 7f98a9d9b700 1 -- 172.21.15.88:0/703055281 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98980035b0 con 0x7f98ac15cfc0 2023-08-10T10:30:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a3fff700 1 -- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac0b4e90 msgr2=0x7f98ac0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a3fff700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac0b4e90 0x7f98ac0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a3fff700 1 -- 172.21.15.88:0/703055281 >> v1:172.21.15.88:6789/0 conn(0x7f98ac15cfc0 legacy=0x7f98ac0d26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a3fff700 1 -- 172.21.15.88:0/703055281 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98ac0d1570 con 0x7f98ac0d0f90 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a3fff700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac0b4950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9894009840 tx=0x7f9894009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbba5a1a9ffcaa8f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a9d9b700 1 -- 172.21.15.88:0/703055281 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011830 con 0x7f98ac0d0f90 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a9d9b700 1 -- 172.21.15.88:0/703055281 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9894011990 con 0x7f98ac0d0f90 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.176+0000 7f98a9d9b700 1 -- 172.21.15.88:0/703055281 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9894011d20 con 0x7f98ac0d0f90 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 -- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 msgr2=0x7f98ac0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac0b4950 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9894009840 tx=0x7f9894009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:31.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 -- 172.21.15.88:0/703055281 shutdown_connections 2023-08-10T10:30:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac0b4e90 0x7f98ac0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 --2- 172.21.15.88:0/703055281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac0b4950 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 -- 172.21.15.88:0/703055281 >> 172.21.15.88:0/703055281 conn(0x7f98ac0cf950 msgr2=0x7f98ac0cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 -- 172.21.15.88:0/703055281 shutdown_connections 2023-08-10T10:30:31.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.177+0000 7f98b0bff700 1 -- 172.21.15.88:0/703055281 wait complete. 2023-08-10T10:30:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.179+0000 7f98b0bff700 1 Processor -- start 2023-08-10T10:30:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.179+0000 7f98b0bff700 1 -- start start 2023-08-10T10:30:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.180+0000 7f98b0bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98b0bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac1e5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98b0bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac15cfc0 0x7f98ac15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98b0bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac15bdb0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98b0bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1e4f30 con 0x7f98ac0d0f90 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98b0bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98ac1e5210 con 0x7f98ac15cfc0 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39236/0 (socket says 172.21.15.88:39236) 2023-08-10T10:30:31.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 -- 172.21.15.88:0/3456834460 learned_addr learned my addr 172.21.15.88:0/3456834460 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:31.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98a3fff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac1e5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aad9d700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac15cfc0 0x7f98ac15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 -- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac15cfc0 msgr2=0x7f98ac15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac15cfc0 0x7f98ac15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 -- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 msgr2=0x7f98ac1e5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac1e5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 -- 172.21.15.88:0/3456834460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98940094a0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98a3fff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac1e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:31.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.181+0000 7f98aa59c700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c700 tx=0x7f989c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.182+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c005d70 con 0x7f98ac0b4e90 2023-08-10T10:30:31.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.182+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f989c0070d0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.182+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98ac1e54f0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.182+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989c007460 con 0x7f98ac0b4e90 2023-08-10T10:30:31.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.182+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98ac1e5ab0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.183+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98ac04ecc0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.184+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f989c0075c0 con 0x7f98ac0b4e90 2023-08-10T10:30:31.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.185+0000 7f98a2ffd700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 0x7f988c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.185+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f989c088740 con 0x7f98ac0b4e90 2023-08-10T10:30:31.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.185+0000 7f98a3fff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 0x7f988c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.185+0000 7f98a3fff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 0x7f988c06d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98940090b0 tx=0x7f9894008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.189+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f989c053b50 con 0x7f98ac0b4e90 2023-08-10T10:30:31.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.389+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f98ac0c6780 con 0x7f98ac0b4e90 2023-08-10T10:30:31.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.390+0000 7f98a2ffd700 1 -- 172.21.15.88:0/3456834460 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f989c057170 con 0x7f98ac0b4e90 2023-08-10T10:30:31.391 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 msgr2=0x7f988c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 0x7f988c06d1a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f98940090b0 tx=0x7f9894008030 comp rx=0 tx=0).stop 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 msgr2=0x7f98ac15bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f989c00c700 tx=0x7f989c00cac0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 shutdown_connections 2023-08-10T10:30:31.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f988c06ace0 0x7f988c06d1a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98ac15cfc0 0x7f98ac15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98ac0b4e90 0x7f98ac15bf10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 --2- 172.21.15.88:0/3456834460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98ac0d0f90 0x7f98ac1e5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 >> 172.21.15.88:0/3456834460 conn(0x7f98ac0cf950 msgr2=0x7f98ac0ca2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 shutdown_connections 2023-08-10T10:30:31.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.392+0000 7f98b0bff700 1 -- 172.21.15.88:0/3456834460 wait complete. 2023-08-10T10:30:31.411 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-10T10:30:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.607+0000 7f3ee9bff700 1 Processor -- start 2023-08-10T10:30:31.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.607+0000 7f3ee9bff700 1 -- start start 2023-08-10T10:30:31.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee9bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ee40716d0 0x7f3ee4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee9bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ee4071b80 0x7f3ee4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee9bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee406a170 con 0x7f3ee4159d00 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee9bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee415dfe0 con 0x7f3ee4071b80 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee9bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee40cdeb0 con 0x7f3ee40716d0 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ee4071b80 0x7f3ee4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3ee4071b80 0x7f3ee4070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39244/0 (socket says 172.21.15.88:39244) 2023-08-10T10:30:31.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.608+0000 7f3ee3fff700 1 -- 172.21.15.88:0/1742734699 learned_addr learned my addr 172.21.15.88:0/1742734699 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:31.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee3fff700 1 -- 172.21.15.88:0/1742734699 >> v2:172.21.15.187:3300/0 conn(0x7f3ee40716d0 msgr2=0x7f3ee4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee3fff700 1 --2- 172.21.15.88:0/1742734699 >> v2:172.21.15.187:3300/0 conn(0x7f3ee40716d0 0x7f3ee4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee3fff700 1 -- 172.21.15.88:0/1742734699 >> v1:172.21.15.187:6789/0 conn(0x7f3ee4159d00 legacy=0x7f3ee415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee3fff700 1 -- 172.21.15.88:0/1742734699 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee40ce190 con 0x7f3ee4071b80 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee3fff700 1 --2- 172.21.15.88:0/1742734699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee4071b80 0x7f3ee4070ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40ae660 tx=0x7f3edc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3458f850ab3cb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee2ffd700 1 -- 172.21.15.88:0/1742734699 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc003c20 con 0x7f3ee4071b80 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee2ffd700 1 -- 172.21.15.88:0/1742734699 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc003d80 con 0x7f3ee4071b80 2023-08-10T10:30:31.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.609+0000 7f3ee2ffd700 1 -- 172.21.15.88:0/1742734699 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00bbc0 con 0x7f3ee4071b80 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 -- 172.21.15.88:0/1742734699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee4071b80 msgr2=0x7f3ee4070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/1742734699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee4071b80 0x7f3ee4070ed0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3ee40ae660 tx=0x7f3edc00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 -- 172.21.15.88:0/1742734699 shutdown_connections 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/1742734699 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee4071b80 0x7f3ee4070ed0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/1742734699 >> v2:172.21.15.187:3300/0 conn(0x7f3ee40716d0 0x7f3ee4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 -- 172.21.15.88:0/1742734699 >> 172.21.15.88:0/1742734699 conn(0x7f3ee40ced50 msgr2=0x7f3ee40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 -- 172.21.15.88:0/1742734699 shutdown_connections 2023-08-10T10:30:31.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.610+0000 7f3ee9bff700 1 -- 172.21.15.88:0/1742734699 wait complete. 2023-08-10T10:30:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.611+0000 7f3ee9bff700 1 Processor -- start 2023-08-10T10:30:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.612+0000 7f3ee9bff700 1 -- start start 2023-08-10T10:30:31.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.612+0000 7f3ee9bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.612+0000 7f3ee9bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ee4071b80 0x7f3ee40b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee9bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ee4159d00 0x7f3ee40b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee9bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c6b30 con 0x7f3ee40716d0 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee9bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c5c40 con 0x7f3ee4071b80 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee9bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee40c5f20 con 0x7f3ee4159d00 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:39248/0 (socket says 172.21.15.88:39248) 2023-08-10T10:30:31.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 -- 172.21.15.88:0/3111965801 learned_addr learned my addr 172.21.15.88:0/3111965801 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3edbfff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ee4071b80 0x7f3ee40b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee3fff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ee4159d00 0x7f3ee40b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 -- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ee4159d00 msgr2=0x7f3ee40b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ee4159d00 0x7f3ee40b2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 -- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ee4071b80 msgr2=0x7f3ee40b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ee4071b80 0x7f3ee40b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.613+0000 7f3ee37fe700 1 -- 172.21.15.88:0/3111965801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009b30 con 0x7f3ee40716d0 2023-08-10T10:30:31.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee37fe700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400b470 tx=0x7f3ed400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4011830 con 0x7f3ee40716d0 2023-08-10T10:30:31.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ed40119b0 con 0x7f3ee40716d0 2023-08-10T10:30:31.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ed4011d60 con 0x7f3ee40716d0 2023-08-10T10:30:31.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee40c6200 con 0x7f3ee40716d0 2023-08-10T10:30:31.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.614+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee40c67c0 con 0x7f3ee40716d0 2023-08-10T10:30:31.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.615+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee40c6980 con 0x7f3ee40716d0 2023-08-10T10:30:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.616+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3ed401a410 con 0x7f3ee40716d0 2023-08-10T10:30:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.617+0000 7f3ee0ff9700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 0x7f3ec406d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.617+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3ed4088a80 con 0x7f3ee40716d0 2023-08-10T10:30:31.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.617+0000 7f3edbfff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 0x7f3ec406d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:31.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.617+0000 7f3edbfff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 0x7f3ec406d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ee41f6120 tx=0x7f3ecc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:31.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.621+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3ed4053e70 con 0x7f3ee40716d0 2023-08-10T10:30:31.819 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.819+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3ee40c9bb0 con 0x7f3ee40716d0 2023-08-10T10:30:31.820 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.819+0000 7f3ee0ff9700 1 -- 172.21.15.88:0/3111965801 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7f3ed4015090 con 0x7f3ee40716d0 2023-08-10T10:30:31.820 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:31.820 INFO:teuthology.orchestra.run.smithi088.stdout:[ 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 1, 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": ".mgr" 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: { 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: "poolnum": 2, 2023-08-10T10:30:31.821 INFO:teuthology.orchestra.run.smithi088.stdout: "poolname": "rbd" 2023-08-10T10:30:31.822 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-08-10T10:30:31.822 INFO:teuthology.orchestra.run.smithi088.stdout:] 2023-08-10T10:30:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.821+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 msgr2=0x7f3ec406d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.821+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 0x7f3ec406d1d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3ee41f6120 tx=0x7f3ecc009190 comp rx=0 tx=0).stop 2023-08-10T10:30:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.821+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 msgr2=0x7f3ee4155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.821+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ed400b470 tx=0x7f3ed400b780 comp rx=0 tx=0).stop 2023-08-10T10:30:31.823 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 shutdown_connections 2023-08-10T10:30:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3ec406ad10 0x7f3ec406d1d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ee4159d00 0x7f3ee40b2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3ee40716d0 0x7f3ee4155ee0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 --2- 172.21.15.88:0/3111965801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ee4071b80 0x7f3ee40b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:31.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 >> 172.21.15.88:0/3111965801 conn(0x7f3ee40ced50 msgr2=0x7f3ee406ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:31.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 shutdown_connections 2023-08-10T10:30:31.825 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:31.822+0000 7f3ee9bff700 1 -- 172.21.15.88:0/3111965801 wait complete. 2023-08-10T10:30:31.840 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-10T10:30:31.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-10T10:30:32.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.038+0000 7f3a505ff700 1 Processor -- start 2023-08-10T10:30:32.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.038+0000 7f3a505ff700 1 -- start start 2023-08-10T10:30:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.039+0000 7f3a505ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3a48143810 0x7f3a480c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.039+0000 7f3a505ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a480cc6c0 0x7f3a480cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.039+0000 7f3a505ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480c43a0 con 0x7f3a480ce3c0 2023-08-10T10:30:32.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.039+0000 7f3a505ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a480c4960 con 0x7f3a480cc6c0 2023-08-10T10:30:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a505ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4806e8c0 con 0x7f3a48143810 2023-08-10T10:30:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a480cc6c0 0x7f3a480cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3a480cc6c0 0x7f3a480cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43344/0 (socket says 172.21.15.88:43344) 2023-08-10T10:30:32.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 -- 172.21.15.88:0/3823163744 learned_addr learned my addr 172.21.15.88:0/3823163744 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:32.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4e39b700 1 --2- 172.21.15.88:0/3823163744 >> v2:172.21.15.187:3300/0 conn(0x7f3a48143810 0x7f3a480c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 -- 172.21.15.88:0/3823163744 >> v2:172.21.15.187:3300/0 conn(0x7f3a48143810 msgr2=0x7f3a480c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:32.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 --2- 172.21.15.88:0/3823163744 >> v2:172.21.15.187:3300/0 conn(0x7f3a48143810 0x7f3a480c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 -- 172.21.15.88:0/3823163744 >> v1:172.21.15.187:6789/0 conn(0x7f3a480ce3c0 legacy=0x7f3a480c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.040+0000 7f3a4db9a700 1 -- 172.21.15.88:0/3823163744 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4806eba0 con 0x7f3a480cc6c0 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a4db9a700 1 --2- 172.21.15.88:0/3823163744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a480cc6c0 0x7f3a480cde80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a48072970 tx=0x7f3a38009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c3cead135c8b8c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a4d399700 1 -- 172.21.15.88:0/3823163744 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800b870 con 0x7f3a480cc6c0 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a4d399700 1 -- 172.21.15.88:0/3823163744 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800b9d0 con 0x7f3a480cc6c0 2023-08-10T10:30:32.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a4d399700 1 -- 172.21.15.88:0/3823163744 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800bd60 con 0x7f3a480cc6c0 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 -- 172.21.15.88:0/3823163744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a480cc6c0 msgr2=0x7f3a480cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 --2- 172.21.15.88:0/3823163744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a480cc6c0 0x7f3a480cde80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a48072970 tx=0x7f3a38009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 -- 172.21.15.88:0/3823163744 shutdown_connections 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 --2- 172.21.15.88:0/3823163744 >> v2:172.21.15.187:3300/0 conn(0x7f3a48143810 0x7f3a480c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 --2- 172.21.15.88:0/3823163744 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a480cc6c0 0x7f3a480cde80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 -- 172.21.15.88:0/3823163744 >> 172.21.15.88:0/3823163744 conn(0x7f3a480cb570 msgr2=0x7f3a480cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:32.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.041+0000 7f3a505ff700 1 -- 172.21.15.88:0/3823163744 shutdown_connections 2023-08-10T10:30:32.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.042+0000 7f3a505ff700 1 -- 172.21.15.88:0/3823163744 wait complete. 2023-08-10T10:30:32.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.043+0000 7f3a505ff700 1 Processor -- start 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.043+0000 7f3a505ff700 1 -- start start 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a480cc6c0 0x7f3a48158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 0x7f3a48142530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48141c00 con 0x7f3a48143810 2023-08-10T10:30:32.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a48140ff0 con 0x7f3a480ce3c0 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.044+0000 7f3a505ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a481412d0 con 0x7f3a480cc6c0 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43348/0 (socket says 172.21.15.88:43348) 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 -- 172.21.15.88:0/548488153 learned_addr learned my addr 172.21.15.88:0/548488153 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4e39b700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a480cc6c0 0x7f3a48158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4db9a700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 0x7f3a48142530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 -- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a480cc6c0 msgr2=0x7f3a48158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a480cc6c0 0x7f3a48158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 -- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 msgr2=0x7f3a48142530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 0x7f3a48142530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 -- 172.21.15.88:0/548488153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a38009550 con 0x7f3a48143810 2023-08-10T10:30:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4db9a700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 0x7f3a48142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a4eb9c700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000cb50 tx=0x7f3a4000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a40003c00 con 0x7f3a48143810 2023-08-10T10:30:32.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a40003d60 con 0x7f3a48143810 2023-08-10T10:30:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.045+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a481415b0 con 0x7f3a48143810 2023-08-10T10:30:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.046+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4000aac0 con 0x7f3a48143810 2023-08-10T10:30:32.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.046+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a48140cc0 con 0x7f3a48143810 2023-08-10T10:30:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.047+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a480743a0 con 0x7f3a48143810 2023-08-10T10:30:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.048+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3a4000ac20 con 0x7f3a48143810 2023-08-10T10:30:32.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.048+0000 7f3a3effd700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 0x7f3a2c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.049+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f3a40089120 con 0x7f3a48143810 2023-08-10T10:30:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.049+0000 7f3a4e39b700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 0x7f3a2c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.049+0000 7f3a4e39b700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 0x7f3a2c06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006b20 tx=0x7f3a44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.053+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3a40054520 con 0x7f3a48143810 2023-08-10T10:30:32.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.247+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3a4815c270 con 0x7f3a48143810 2023-08-10T10:30:32.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.296+0000 7f3a3effd700 1 -- 172.21.15.88:0/548488153 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3a40057b40 con 0x7f3a48143810 2023-08-10T10:30:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.300+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 msgr2=0x7f3a2c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.300+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 0x7f3a2c06d1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3a44006b20 tx=0x7f3a44008040 comp rx=0 tx=0).stop 2023-08-10T10:30:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.300+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 msgr2=0x7f3a481e6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.300+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3a4000cb50 tx=0x7f3a4000ce60 comp rx=0 tx=0).stop 2023-08-10T10:30:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 shutdown_connections 2023-08-10T10:30:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3a48143810 0x7f3a481e6990 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3a2c06ace0 0x7f3a2c06d1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.302 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a480cc6c0 0x7f3a48158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 --2- 172.21.15.88:0/548488153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a480ce3c0 0x7f3a48142530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 >> 172.21.15.88:0/548488153 conn(0x7f3a480cb570 msgr2=0x7f3a480c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 shutdown_connections 2023-08-10T10:30:32.303 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.301+0000 7f3a505ff700 1 -- 172.21.15.88:0/548488153 wait complete. 2023-08-10T10:30:32.305 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' created 2023-08-10T10:30:32.322 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-10T10:30:32.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.525+0000 7f51cadff700 1 Processor -- start 2023-08-10T10:30:32.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.525+0000 7f51cadff700 1 -- start start 2023-08-10T10:30:32.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51cadff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51c40d27a0 0x7f51c40b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51cadff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40b52e0 con 0x7f51c40b4e90 2023-08-10T10:30:32.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51cadff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c40d1840 con 0x7f51c415d1e0 2023-08-10T10:30:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51cadff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c40d2c50 con 0x7f51c40d27a0 2023-08-10T10:30:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51c40d27a0 0x7f51c40b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c939c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51c40b4e90 0x7f51c40b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37736/0 (socket says 172.21.15.88:37736) 2023-08-10T10:30:32.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c939c700 1 -- 172.21.15.88:0/2559047982 learned_addr learned my addr 172.21.15.88:0/2559047982 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:32.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c3fff700 1 -- 172.21.15.88:0/2559047982 >> v1:172.21.15.187:6789/0 conn(0x7f51c415d1e0 legacy=0x7f51c40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c3fff700 1 -- 172.21.15.88:0/2559047982 >> v1:172.21.15.88:6789/0 conn(0x7f51c40b4e90 legacy=0x7f51c40b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c37fe700 1 -- 172.21.15.88:0/2559047982 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 977347151 0 0) 0x7f51bc001490 con 0x7f51c40b4e90 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.527+0000 7f51c3fff700 1 -- 172.21.15.88:0/2559047982 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c40d1b20 con 0x7f51c40d27a0 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51c3fff700 1 --2- 172.21.15.88:0/2559047982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c40d27a0 0x7f51c40b4950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009840 tx=0x7f51b0009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54dd22afb0e2cb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51c37fe700 1 -- 172.21.15.88:0/2559047982 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b0004230 con 0x7f51c40d27a0 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51c37fe700 1 -- 172.21.15.88:0/2559047982 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b0004390 con 0x7f51c40d27a0 2023-08-10T10:30:32.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51c37fe700 1 -- 172.21.15.88:0/2559047982 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b00036a0 con 0x7f51c40d27a0 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 -- 172.21.15.88:0/2559047982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c40d27a0 msgr2=0x7f51c40b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 --2- 172.21.15.88:0/2559047982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c40d27a0 0x7f51c40b4950 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f51b0009840 tx=0x7f51b0009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 -- 172.21.15.88:0/2559047982 shutdown_connections 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 --2- 172.21.15.88:0/2559047982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c40d27a0 0x7f51c40b4950 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 -- 172.21.15.88:0/2559047982 >> 172.21.15.88:0/2559047982 conn(0x7f51c40cf950 msgr2=0x7f51c40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.528+0000 7f51cadff700 1 -- 172.21.15.88:0/2559047982 shutdown_connections 2023-08-10T10:30:32.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.529+0000 7f51cadff700 1 -- 172.21.15.88:0/2559047982 wait complete. 2023-08-10T10:30:32.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.531+0000 7f51cadff700 1 Processor -- start 2023-08-10T10:30:32.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.531+0000 7f51cadff700 1 -- start start 2023-08-10T10:30:32.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51c40b4e90 0x7f51c40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51c40d27a0 0x7f51c41f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4156df0 con 0x7f51c415d1e0 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c4156870 con 0x7f51c40d27a0 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.532+0000 7f51cadff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c41f76f0 con 0x7f51c40b4e90 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43364/0 (socket says 172.21.15.88:43364) 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 -- 172.21.15.88:0/945856920 learned_addr learned my addr 172.21.15.88:0/945856920 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c8b9b700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51c40b4e90 0x7f51c40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c3fff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51c40d27a0 0x7f51c41f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 -- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51c40b4e90 msgr2=0x7f51c40c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51c40b4e90 0x7f51c40c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 -- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51c40d27a0 msgr2=0x7f51c41f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51c40d27a0 0x7f51c41f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 -- 172.21.15.88:0/945856920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51b00094a0 con 0x7f51c415d1e0 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c939c700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00ccd0 tx=0x7f51bc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.536 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00ad40 con 0x7f51c415d1e0 2023-08-10T10:30:32.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc00ce70 con 0x7f51c415d1e0 2023-08-10T10:30:32.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c41f6e50 con 0x7f51c415d1e0 2023-08-10T10:30:32.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.533+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc0072f0 con 0x7f51c415d1e0 2023-08-10T10:30:32.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.534+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c41f7410 con 0x7f51c415d1e0 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.534+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c406b5e0 con 0x7f51c415d1e0 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.536+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51bc007450 con 0x7f51c415d1e0 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.537+0000 7f51c17fa700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.537+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f51bc088cc0 con 0x7f51c415d1e0 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.537+0000 7f51c8b9b700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:32.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.537+0000 7f51c8b9b700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009870 tx=0x7f51b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:32.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.541+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51bc08f080 con 0x7f51c415d1e0 2023-08-10T10:30:32.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:32.737+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f51c40b52e0 con 0x7f51c415d1e0 2023-08-10T10:30:33.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.301+0000 7f51c17fa700 1 -- 172.21.15.88:0/945856920 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v21) v1 ==== 171+0+0 (secure 0 0 0) 0x7f51c40b52e0 con 0x7f51c415d1e0 2023-08-10T10:30:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.307+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 msgr2=0x7f51a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.307+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009870 tx=0x7f51b8008040 comp rx=0 tx=0).stop 2023-08-10T10:30:33.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.307+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 msgr2=0x7f51c4156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.307+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00ccd0 tx=0x7f51bc00a340 comp rx=0 tx=0).stop 2023-08-10T10:30:33.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 shutdown_connections 2023-08-10T10:30:33.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51c415d1e0 0x7f51c4156330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51c40b4e90 0x7f51c40c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 --2- 172.21.15.88:0/945856920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51c40d27a0 0x7f51c41f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 >> 172.21.15.88:0/945856920 conn(0x7f51c40cf950 msgr2=0x7f51c40b6f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:33.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.309+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 shutdown_connections 2023-08-10T10:30:33.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.313+0000 7f51cadff700 1 -- 172.21.15.88:0/945856920 wait complete. 2023-08-10T10:30:33.324 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' created 2023-08-10T10:30:33.339 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-10T10:30:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.538+0000 7f288e9ff700 1 Processor -- start 2023-08-10T10:30:33.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.538+0000 7f288e9ff700 1 -- start start 2023-08-10T10:30:33.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f288e9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f28880b5060 0x7f28880b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f288e9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28880d1840 con 0x7f28880d27a0 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f288e9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28880d1b20 con 0x7f288815d1e0 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f288e9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28880d2c50 con 0x7f28880b5060 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f28877fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f28880d27a0 0x7f28880b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37738/0 (socket says 172.21.15.88:37738) 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f28877fe700 1 -- 172.21.15.88:0/524953203 learned_addr learned my addr 172.21.15.88:0/524953203 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:33.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.539+0000 7f288cf9c700 1 --2- 172.21.15.88:0/524953203 >> v2:172.21.15.88:3300/0 conn(0x7f28880b5060 0x7f28880b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:33.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f2886ffd700 1 -- 172.21.15.88:0/524953203 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269916246 0 0) 0x7f28880d1840 con 0x7f28880d27a0 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f2886ffd700 1 -- 172.21.15.88:0/524953203 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28700035b0 con 0x7f28880d27a0 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f288cf9c700 1 -- 172.21.15.88:0/524953203 >> v1:172.21.15.187:6789/0 conn(0x7f288815d1e0 legacy=0x7f28880d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f288cf9c700 1 -- 172.21.15.88:0/524953203 >> v1:172.21.15.88:6789/0 conn(0x7f28880d27a0 legacy=0x7f28880b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f288cf9c700 1 -- 172.21.15.88:0/524953203 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28880d1e00 con 0x7f28880b5060 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f288cf9c700 1 --2- 172.21.15.88:0/524953203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880b5060 0x7f28880b1940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2880009d90 tx=0x7f288000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb4259f715545bd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f2886ffd700 1 -- 172.21.15.88:0/524953203 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f288000e070 con 0x7f28880b5060 2023-08-10T10:30:33.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f2886ffd700 1 -- 172.21.15.88:0/524953203 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f288000bb20 con 0x7f28880b5060 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.540+0000 7f2886ffd700 1 -- 172.21.15.88:0/524953203 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2880012430 con 0x7f28880b5060 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 -- 172.21.15.88:0/524953203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880b5060 msgr2=0x7f28880b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 --2- 172.21.15.88:0/524953203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880b5060 0x7f28880b1940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2880009d90 tx=0x7f288000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 -- 172.21.15.88:0/524953203 shutdown_connections 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 --2- 172.21.15.88:0/524953203 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880b5060 0x7f28880b1940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 -- 172.21.15.88:0/524953203 >> 172.21.15.88:0/524953203 conn(0x7f28880cf950 msgr2=0x7f28880cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:33.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 -- 172.21.15.88:0/524953203 shutdown_connections 2023-08-10T10:30:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.541+0000 7f288e9ff700 1 -- 172.21.15.88:0/524953203 wait complete. 2023-08-10T10:30:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.543+0000 7f288e9ff700 1 Processor -- start 2023-08-10T10:30:33.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.543+0000 7f288e9ff700 1 -- start start 2023-08-10T10:30:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 0x7f28880cb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:33.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288815d1e0 0x7f28881f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cc550 con 0x7f28880d27a0 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cc760 con 0x7f28880b5060 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288e9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880cca40 con 0x7f288815d1e0 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f2887fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 0x7f28880cb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:33.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43382/0 (socket says 172.21.15.88:43382) 2023-08-10T10:30:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f2887fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 0x7f28880cb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:48292/0 (socket says 172.21.15.88:48292) 2023-08-10T10:30:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 -- 172.21.15.88:0/1195069825 learned_addr learned my addr 172.21.15.88:0/1195069825 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:33.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f288cf9c700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288815d1e0 0x7f28881f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 -- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288815d1e0 msgr2=0x7f28881f6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288815d1e0 0x7f28881f6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 -- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 msgr2=0x7f28880cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:33.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 0x7f28880cb7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.545+0000 7f28877fe700 1 -- 172.21.15.88:0/1195069825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2880009a70 con 0x7f28880d27a0 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f28877fe700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c700 tx=0x7f287c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c005d70 con 0x7f28880d27a0 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0070d0 con 0x7f28880d27a0 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c007460 con 0x7f28880d27a0 2023-08-10T10:30:33.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28880ccd20 con 0x7f28880d27a0 2023-08-10T10:30:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.546+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28881f65f0 con 0x7f28880d27a0 2023-08-10T10:30:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.547+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28881f67e0 con 0x7f28880d27a0 2023-08-10T10:30:33.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.548+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f287c0075c0 con 0x7f28880d27a0 2023-08-10T10:30:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.549+0000 7f2884ff9700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 0x7f287406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.549+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f287c088940 con 0x7f28880d27a0 2023-08-10T10:30:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.549+0000 7f2887fff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 0x7f287406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:33.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.550+0000 7f2887fff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 0x7f287406d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2878000f60 tx=0x7f2878009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:33.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.554+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f287c0539b0 con 0x7f28880d27a0 2023-08-10T10:30:33.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:33.790+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f28880743a0 con 0x7f28880d27a0 2023-08-10T10:30:34.330 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.326+0000 7f2884ff9700 1 -- 172.21.15.88:0/1195069825 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f287c0170c0 con 0x7f28880d27a0 2023-08-10T10:30:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.330+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 msgr2=0x7f287406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.330+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 0x7f287406d1a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2878000f60 tx=0x7f2878009040 comp rx=0 tx=0).stop 2023-08-10T10:30:34.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.330+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 msgr2=0x7f28880cc010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.330+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f287c00c700 tx=0x7f287c00ca10 comp rx=0 tx=0).stop 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 shutdown_connections 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f287406ace0 0x7f287406d1a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288815d1e0 0x7f28881f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880b5060 0x7f28880cb7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 --2- 172.21.15.88:0/1195069825 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f28880d27a0 0x7f28880cc010 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.331+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 >> 172.21.15.88:0/1195069825 conn(0x7f28880cf950 msgr2=0x7f28880c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:34.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.333+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 shutdown_connections 2023-08-10T10:30:34.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.337+0000 7f288e9ff700 1 -- 172.21.15.88:0/1195069825 wait complete. 2023-08-10T10:30:34.346 INFO:teuthology.orchestra.run.smithi088.stderr:new fs with metadata pool 3 and data pool 4 2023-08-10T10:30:34.365 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-10T10:30:34.365 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-10T10:30:34.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.567+0000 7f364edff700 1 Processor -- start 2023-08-10T10:30:34.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.567+0000 7f364edff700 1 -- start start 2023-08-10T10:30:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364edff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f364815d1e0 0x7f36480d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f36480b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364edff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36480d1840 con 0x7f36480d1060 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364edff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364815d5c0 con 0x7f364815d1e0 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36480d1b20 con 0x7f36480b5060 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f364815d1e0 0x7f36480d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f364815d1e0 0x7f36480d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43396/0 (socket says 172.21.15.88:43396) 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 -- 172.21.15.88:0/2959738018 learned_addr learned my addr 172.21.15.88:0/2959738018 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:34.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364d39c700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f36480b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 -- 172.21.15.88:0/2959738018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 msgr2=0x7f36480b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f36480b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 -- 172.21.15.88:0/2959738018 >> v1:172.21.15.187:6789/0 conn(0x7f36480d1060 legacy=0x7f36480b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.569+0000 7f364cb9b700 1 -- 172.21.15.88:0/2959738018 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36480d1e00 con 0x7f364815d1e0 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364cb9b700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f364815d1e0 0x7f36480d27a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f363c0098f0 tx=0x7f363c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10c102fd9c52e89d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f36477fe700 1 -- 172.21.15.88:0/2959738018 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00b8a0 con 0x7f364815d1e0 2023-08-10T10:30:34.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f36477fe700 1 -- 172.21.15.88:0/2959738018 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363c00ba00 con 0x7f364815d1e0 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f36477fe700 1 -- 172.21.15.88:0/2959738018 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363c00bd90 con 0x7f364815d1e0 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 -- 172.21.15.88:0/2959738018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f364815d1e0 msgr2=0x7f36480d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f364815d1e0 0x7f36480d27a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f363c0098f0 tx=0x7f363c009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 -- 172.21.15.88:0/2959738018 shutdown_connections 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f36480b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 --2- 172.21.15.88:0/2959738018 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f364815d1e0 0x7f36480d27a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.570+0000 7f364edff700 1 -- 172.21.15.88:0/2959738018 >> 172.21.15.88:0/2959738018 conn(0x7f36480cf950 msgr2=0x7f36480cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.571+0000 7f364edff700 1 -- 172.21.15.88:0/2959738018 shutdown_connections 2023-08-10T10:30:34.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.571+0000 7f364edff700 1 -- 172.21.15.88:0/2959738018 wait complete. 2023-08-10T10:30:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.573+0000 7f364edff700 1 Processor -- start 2023-08-10T10:30:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.573+0000 7f364edff700 1 -- start start 2023-08-10T10:30:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f3648155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364815d1e0 0x7f36480c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648157080 con 0x7f36480d1060 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3648157360 con 0x7f364815d1e0 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.574+0000 7f364edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3648157640 con 0x7f36480b5060 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43404/0 (socket says 172.21.15.88:43404) 2023-08-10T10:30:34.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 -- 172.21.15.88:0/269089461 learned_addr learned my addr 172.21.15.88:0/269089461 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f364d39c700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364815d1e0 0x7f36480c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f364cb9b700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f3648155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 -- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 msgr2=0x7f3648155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f3648155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 -- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364815d1e0 msgr2=0x7f36480c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364815d1e0 0x7f36480c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:34.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 -- 172.21.15.88:0/269089461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c009550 con 0x7f36480d1060 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f364cb9b700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f3648155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f3647fff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4e0 tx=0x7f363400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340052d0 con 0x7f36480d1060 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3634005430 con 0x7f36480d1060 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3648157920 con 0x7f36480d1060 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.575+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36340038c0 con 0x7f36480d1060 2023-08-10T10:30:34.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.576+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36481f7410 con 0x7f36480d1060 2023-08-10T10:30:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.577+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3648157e40 con 0x7f36480d1060 2023-08-10T10:30:34.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.577+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3634003a20 con 0x7f36480d1060 2023-08-10T10:30:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.578+0000 7f36457fa700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 0x7f362c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.579+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3634088900 con 0x7f36480d1060 2023-08-10T10:30:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.579+0000 7f364cb9b700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 0x7f362c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:34.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.579+0000 7f364cb9b700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 0x7f362c06d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f363c009c40 tx=0x7f363c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:34.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.583+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3648157e40 con 0x7f36480d1060 2023-08-10T10:30:34.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:34.792+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3648157e40 con 0x7f36480d1060 2023-08-10T10:30:35.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.332+0000 7f36457fa700 1 -- 172.21.15.88:0/269089461 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3648157e40 con 0x7f36480d1060 2023-08-10T10:30:35.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 msgr2=0x7f362c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 0x7f362c06d1a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f363c009c40 tx=0x7f363c008030 comp rx=0 tx=0).stop 2023-08-10T10:30:35.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 msgr2=0x7f36481f6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f363400c4e0 tx=0x7f363400c7f0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 shutdown_connections 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f364815d1e0 0x7f36480c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f362c06ace0 0x7f362c06d1a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36480b5060 0x7f3648155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 --2- 172.21.15.88:0/269089461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36480d1060 0x7f36481f6ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 >> 172.21.15.88:0/269089461 conn(0x7f36480cf950 msgr2=0x7f36480d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:35.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 shutdown_connections 2023-08-10T10:30:35.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.335+0000 7f364edff700 1 -- 172.21.15.88:0/269089461 wait complete. 2023-08-10T10:30:35.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-10T10:30:35.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.561+0000 7fbbe7dff700 1 Processor -- start 2023-08-10T10:30:35.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.561+0000 7fbbe7dff700 1 -- start start 2023-08-10T10:30:35.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe7dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbe00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe7dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbe00d1060 0x7fbbe00b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe7dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe00d1840 con 0x7fbbe00b4e90 2023-08-10T10:30:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe7dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe015d5c0 con 0x7fbbe00d1060 2023-08-10T10:30:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe7dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00b5300 con 0x7fbbe015d1e0 2023-08-10T10:30:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe639c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbbe00b4e90 0x7fbbe00b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37744/0 (socket says 172.21.15.88:37744) 2023-08-10T10:30:35.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.562+0000 7fbbe639c700 1 -- 172.21.15.88:0/3830080020 learned_addr learned my addr 172.21.15.88:0/3830080020 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbe00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe539a700 1 --2- 172.21.15.88:0/3830080020 >> v2:172.21.15.187:3300/0 conn(0x7fbbe00d1060 0x7fbbe00b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600864802 0 0) 0x7fbbe00d1840 con 0x7fbbe00b4e90 2023-08-10T10:30:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbcc0035b0 con 0x7fbbe00b4e90 2023-08-10T10:30:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2171637682 0 0) 0x7fbbcc0035b0 con 0x7fbbe00b4e90 2023-08-10T10:30:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 msgr2=0x7fbbe00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbe00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 >> v2:172.21.15.187:3300/0 conn(0x7fbbe00d1060 msgr2=0x7fbbe00b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:35.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 --2- 172.21.15.88:0/3830080020 >> v2:172.21.15.187:3300/0 conn(0x7fbbe00d1060 0x7fbbe00b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00d1b20 con 0x7fbbe00b4e90 2023-08-10T10:30:35.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fbbd80019f0 con 0x7fbbe00b4e90 2023-08-10T10:30:35.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 >> v1:172.21.15.88:6789/0 conn(0x7fbbe00b4e90 legacy=0x7fbbe00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbcc003a30 0x7fbbcc003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbcc004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbcc004d90 0x7fbbcc005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe015d5c0 con 0x7fbbcc004d90 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00b5300 con 0x7fbbcc003a30 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.563+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbcc00ba10 con 0x7fbbe015d1e0 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbcc004d90 0x7fbbcc005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe539a700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbcc004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbcc003a30 0x7fbbcc003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 -- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 msgr2=0x7fbbcc004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe015d1e0 0x7fbbcc004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 -- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbcc003a30 msgr2=0x7fbbcc003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbcc003a30 0x7fbbcc003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 -- 172.21.15.88:0/3830080020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0035b0 con 0x7fbbcc004d90 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe639c700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbcc004d90 0x7fbbcc005210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a830 tx=0x7fbbcc005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9fd8944808f66a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd800a2f0 con 0x7fbbcc004d90 2023-08-10T10:30:35.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd8012620 con 0x7fbbcc004d90 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.564+0000 7fbbe4b99700 1 -- 172.21.15.88:0/3830080020 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd80129d0 con 0x7fbbcc004d90 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3830080020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbcc004d90 msgr2=0x7fbbcc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3830080020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbcc004d90 0x7fbbcc005210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbbd800a830 tx=0x7fbbcc005880 comp rx=0 tx=0).stop 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe639c700 1 -- 172.21.15.88:0/3830080020 reap_dead start 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3830080020 shutdown_connections 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3830080020 >> 172.21.15.88:0/3830080020 conn(0x7fbbe00cf950 msgr2=0x7fbbe00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:35.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3830080020 shutdown_connections 2023-08-10T10:30:35.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.565+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3830080020 wait complete. 2023-08-10T10:30:35.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.567+0000 7fbbe7dff700 1 Processor -- start 2023-08-10T10:30:35.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.567+0000 7fbbe7dff700 1 -- start start 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 0x7fbbe01f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe00cbdf0 0x7fbbe00b6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe01f3d70 con 0x7fbbe0159990 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe0159e10 con 0x7fbbe00cbdf0 2023-08-10T10:30:35.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe7dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe00c6aa0 con 0x7fbbcc004d90 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe539a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe539a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43418/0 (socket says 172.21.15.88:43418) 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe539a700 1 -- 172.21.15.88:0/3124962706 learned_addr learned my addr 172.21.15.88:0/3124962706 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 0x7fbbe01f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.568+0000 7fbbe639c700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe00cbdf0 0x7fbbe00b6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 -- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 msgr2=0x7fbbe01f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 0x7fbbe01f3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 -- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe00cbdf0 msgr2=0x7fbbe00b6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe00cbdf0 0x7fbbe00b6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 -- 172.21.15.88:0/3124962706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe00c6d80 con 0x7fbbe0159990 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 0x7fbbe01f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe539a700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0011aa0 tx=0x7fbbd0011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000f940 con 0x7fbbe0159990 2023-08-10T10:30:35.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000faa0 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe00c7060 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000fe50 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.569+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe00c7620 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.570+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe00c77b0 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.571+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbbd0014440 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.572+0000 7fbbd67fc700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 0x7fbbc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.572+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6288+0+0 (secure 0 0 0) 0x7fbbd0089e80 con 0x7fbbe0159990 2023-08-10T10:30:35.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.572+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 0x7fbbc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:35.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.573+0000 7fbbe5b9b700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 0x7fbbc406d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00cb3f0 tx=0x7fbbdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:35.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.576+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbbd0058860 con 0x7fbbe0159990 2023-08-10T10:30:35.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:35.771+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbbe00743a0 con 0x7fbbe0159990 2023-08-10T10:30:37.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.357+0000 7fbbd67fc700 1 -- 172.21.15.88:0/3124962706 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7fbbd00583f0 con 0x7fbbe0159990 2023-08-10T10:30:37.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.363+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 msgr2=0x7fbbc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.363+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 0x7fbbc406d1a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbbe00cb3f0 tx=0x7fbbdc008040 comp rx=0 tx=0).stop 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.363+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 msgr2=0x7fbbe00cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.363+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0011aa0 tx=0x7fbbd0011db0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 shutdown_connections 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe00cbdf0 0x7fbbe00b6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbbc406ace0 0x7fbbc406d1a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbcc004d90 0x7fbbe01f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 --2- 172.21.15.88:0/3124962706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbbe0159990 0x7fbbe00cb8b0 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0011aa0 tx=0x7fbbd0011db0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.364+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 >> 172.21.15.88:0/3124962706 conn(0x7fbbe00cf950 msgr2=0x7fbbe015db20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:37.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.368+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 shutdown_connections 2023-08-10T10:30:37.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.368+0000 7fbbe7dff700 1 -- 172.21.15.88:0/3124962706 wait complete. 2023-08-10T10:30:37.372 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' created 2023-08-10T10:30:37.391 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-10T10:30:37.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.595+0000 7f07b8bff700 1 Processor -- start 2023-08-10T10:30:37.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.595+0000 7f07b8bff700 1 -- start start 2023-08-10T10:30:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.596+0000 7f07b8bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07b415d240 0x7f07b40d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.596+0000 7f07b8bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b406a170 0x7f07b406bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.596+0000 7f07b8bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b406b180 con 0x7f07b40d2a40 2023-08-10T10:30:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.596+0000 7f07b8bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b406a600 con 0x7f07b415d240 2023-08-10T10:30:37.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.596+0000 7f07b8bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b406a8e0 con 0x7f07b406a170 2023-08-10T10:30:37.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b2d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f07b40d2a40 0x7f07b40d0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37756/0 (socket says 172.21.15.88:37756) 2023-08-10T10:30:37.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b2d9d700 1 -- 172.21.15.88:0/3746946813 learned_addr learned my addr 172.21.15.88:0/3746946813 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:37.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b259c700 1 --2- 172.21.15.88:0/3746946813 >> v2:172.21.15.187:3300/0 conn(0x7f07b415d240 0x7f07b40d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b1d9b700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b406a170 0x7f07b406bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3889415506 0 0) 0x7f07b406b180 con 0x7f07b40d2a40 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f079c0035b0 con 0x7f07b40d2a40 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3763116319 0 0) 0x7f079c0035b0 con 0x7f07b40d2a40 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b406a170 msgr2=0x7f07b406bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b406a170 0x7f07b406bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 >> v2:172.21.15.187:3300/0 conn(0x7f07b415d240 msgr2=0x7f07b40d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:37.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 --2- 172.21.15.88:0/3746946813 >> v2:172.21.15.187:3300/0 conn(0x7f07b415d240 0x7f07b40d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b406abc0 con 0x7f07b40d2a40 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f07ac0019f0 con 0x7f07b40d2a40 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 >> v1:172.21.15.88:6789/0 conn(0x7f07b40d2a40 legacy=0x7f07b40d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f079c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f079c004850 0x7f079c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f079c005210 0x7f079c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b406a600 con 0x7f079c003a00 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.597+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b406a8e0 con 0x7f079c004850 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079c00bf50 con 0x7f079c005210 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f079c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b1d9b700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f079c004850 0x7f079c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b2d9d700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f079c005210 0x7f079c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 -- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f079c005210 msgr2=0x7f079c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:37.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f079c005210 0x7f079c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 -- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f079c004850 msgr2=0x7f079c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:37.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f079c004850 0x7f079c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 -- 172.21.15.88:0/3746946813 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f079c0035b0 con 0x7f079c003a00 2023-08-10T10:30:37.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b259c700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f079c003e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009b60 tx=0x7f079c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca61819465b76c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:37.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e6c0 con 0x7f079c003a00 2023-08-10T10:30:37.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a400e820 con 0x7f079c003a00 2023-08-10T10:30:37.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.598+0000 7f07b159a700 1 -- 172.21.15.88:0/3746946813 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400eb90 con 0x7f079c003a00 2023-08-10T10:30:37.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 -- 172.21.15.88:0/3746946813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 msgr2=0x7f079c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 --2- 172.21.15.88:0/3746946813 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f079c003e20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f07a4009b60 tx=0x7f079c005880 comp rx=0 tx=0).stop 2023-08-10T10:30:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b2d9d700 1 -- 172.21.15.88:0/3746946813 reap_dead start 2023-08-10T10:30:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 -- 172.21.15.88:0/3746946813 shutdown_connections 2023-08-10T10:30:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 -- 172.21.15.88:0/3746946813 >> 172.21.15.88:0/3746946813 conn(0x7f07b40d2f30 msgr2=0x7f07b40d3340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 -- 172.21.15.88:0/3746946813 shutdown_connections 2023-08-10T10:30:37.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.599+0000 7f07b8bff700 1 -- 172.21.15.88:0/3746946813 wait complete. 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.601+0000 7f07b8bff700 1 Processor -- start 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.601+0000 7f07b8bff700 1 -- start start 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40ccf40 0x7f07b41f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b41f2dc0 0x7f07b41f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41f37b0 con 0x7f079c003a00 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b4154020 con 0x7f07b40ccf40 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b8bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b41579a0 con 0x7f07b41f2dc0 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43424/0 (socket says 172.21.15.88:43424) 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 -- 172.21.15.88:0/1208971388 learned_addr learned my addr 172.21.15.88:0/1208971388 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:37.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 -- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b41f2dc0 msgr2=0x7f07b41f3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b41f2dc0 0x7f07b41f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 -- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40ccf40 msgr2=0x7f07b41f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40ccf40 0x7f07b41f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 -- 172.21.15.88:0/1208971388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b415a810 con 0x7f079c003a00 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.602+0000 7f07b259c700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07a40090b0 tx=0x7f07a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.603+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a400e6c0 con 0x7f079c003a00 2023-08-10T10:30:37.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.603+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a4003ad0 con 0x7f079c003a00 2023-08-10T10:30:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.603+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a4003e80 con 0x7f079c003a00 2023-08-10T10:30:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.603+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b415aaf0 con 0x7f079c003a00 2023-08-10T10:30:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.603+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b415a4c0 con 0x7f079c003a00 2023-08-10T10:30:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.604+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b40cd380 con 0x7f079c003a00 2023-08-10T10:30:37.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.605+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f07a4013470 con 0x7f079c003a00 2023-08-10T10:30:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.606+0000 7f07a2ffd700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 0x7f079406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.606+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6781+0+0 (secure 0 0 0) 0x7f07a408af80 con 0x7f079c003a00 2023-08-10T10:30:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.606+0000 7f07b1d9b700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 0x7f079406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.607+0000 7f07b1d9b700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 0x7f079406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b7a40 tx=0x7f07a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:37.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.611+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f07a4055e70 con 0x7f079c003a00 2023-08-10T10:30:37.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:37.807+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f07b40743a0 con 0x7f079c003a00 2023-08-10T10:30:38.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.369+0000 7f07a2ffd700 1 -- 172.21.15.88:0/1208971388 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 5 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f07a4059490 con 0x7f079c003a00 2023-08-10T10:30:38.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 msgr2=0x7f079406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 0x7f079406d1a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b7a40 tx=0x7f07a8008040 comp rx=0 tx=0).stop 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 msgr2=0x7f07b4159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07a40090b0 tx=0x7f07a40047c0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 shutdown_connections 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f079406ace0 0x7f079406d1a0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f07b40b7a40 tx=0x7f07a8008040 comp rx=0 tx=0).stop 2023-08-10T10:30:38.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07b41f2dc0 0x7f07b41f3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f079c003a00 0x7f07b4159f80 secure :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f07a40090b0 tx=0x7f07a40047c0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 --2- 172.21.15.88:0/1208971388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07b40ccf40 0x7f07b41f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.374+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 >> 172.21.15.88:0/1208971388 conn(0x7f07b40d2f30 msgr2=0x7f07b415d620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:38.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.380+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 shutdown_connections 2023-08-10T10:30:38.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.382+0000 7f07b8bff700 1 -- 172.21.15.88:0/1208971388 wait complete. 2023-08-10T10:30:38.385 INFO:teuthology.orchestra.run.smithi088.stderr:set pool 5 allow_ec_overwrites to true 2023-08-10T10:30:38.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-10T10:30:38.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.613+0000 7fa47abff700 1 Processor -- start 2023-08-10T10:30:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.613+0000 7fa47abff700 1 -- start start 2023-08-10T10:30:38.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa47abff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4740d27a0 0x7fa4740b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa47abff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740b52e0 con 0x7fa4740b4e90 2023-08-10T10:30:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa47abff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4740d1840 con 0x7fa47415d1e0 2023-08-10T10:30:38.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa47abff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4740d2c50 con 0x7fa4740d27a0 2023-08-10T10:30:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa473fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4740d27a0 0x7fa4740b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:38.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.614+0000 7fa47919c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa4740b4e90 0x7fa4740b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37758/0 (socket says 172.21.15.88:37758) 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa47919c700 1 -- 172.21.15.88:0/3304900132 learned_addr learned my addr 172.21.15.88:0/3304900132 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa473fff700 1 -- 172.21.15.88:0/3304900132 >> v1:172.21.15.187:6789/0 conn(0x7fa47415d1e0 legacy=0x7fa4740d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa473fff700 1 -- 172.21.15.88:0/3304900132 >> v1:172.21.15.88:6789/0 conn(0x7fa4740b4e90 legacy=0x7fa4740b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa473fff700 1 -- 172.21.15.88:0/3304900132 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4740d1b20 con 0x7fa4740d27a0 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa4737fe700 1 -- 172.21.15.88:0/3304900132 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 939093548 0 0) 0x7fa46c001490 con 0x7fa4740b4e90 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa473fff700 1 --2- 172.21.15.88:0/3304900132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa4740b4950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa460009840 tx=0x7fa460009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431f90b78e2f06fe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:38.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa4737fe700 1 -- 172.21.15.88:0/3304900132 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460011830 con 0x7fa4740d27a0 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa4737fe700 1 -- 172.21.15.88:0/3304900132 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa460011990 con 0x7fa4740d27a0 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.615+0000 7fa4737fe700 1 -- 172.21.15.88:0/3304900132 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa460011d20 con 0x7fa4740d27a0 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 -- 172.21.15.88:0/3304900132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 msgr2=0x7fa4740b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 --2- 172.21.15.88:0/3304900132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa4740b4950 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa460009840 tx=0x7fa460009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 -- 172.21.15.88:0/3304900132 shutdown_connections 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 --2- 172.21.15.88:0/3304900132 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa4740b4950 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 -- 172.21.15.88:0/3304900132 >> 172.21.15.88:0/3304900132 conn(0x7fa4740cf950 msgr2=0x7fa4740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 -- 172.21.15.88:0/3304900132 shutdown_connections 2023-08-10T10:30:38.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.616+0000 7fa47abff700 1 -- 172.21.15.88:0/3304900132 wait complete. 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.618+0000 7fa47abff700 1 Processor -- start 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.618+0000 7fa47abff700 1 -- start start 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4740b4e90 0x7fa4741526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa47415d1e0 0x7fa474152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:38.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c88f0 con 0x7fa4740d27a0 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c7780 con 0x7fa47415d1e0 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa47abff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4740c82a0 con 0x7fa4740b4e90 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43448/0 (socket says 172.21.15.88:43448) 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 -- 172.21.15.88:0/4284238422 learned_addr learned my addr 172.21.15.88:0/4284238422 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 -- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4740b4e90 msgr2=0x7fa4741526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4740b4e90 0x7fa4741526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 -- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa47415d1e0 msgr2=0x7fa474152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa47415d1e0 0x7fa474152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.619+0000 7fa473fff700 1 -- 172.21.15.88:0/4284238422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4600094a0 con 0x7fa4740d27a0 2023-08-10T10:30:38.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa473fff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4600090b0 tx=0x7fa460004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46001a900 con 0x7fa4740d27a0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa46001aa60 con 0x7fa4740d27a0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4740c8580 con 0x7fa4740d27a0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46001add0 con 0x7fa4740d27a0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.620+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4740c7410 con 0x7fa4740d27a0 2023-08-10T10:30:38.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.621+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4740c8100 con 0x7fa4740d27a0 2023-08-10T10:30:38.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.622+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa460022070 con 0x7fa4740d27a0 2023-08-10T10:30:38.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.624+0000 7fa4717fa700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 0x7fa45806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:38.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.624+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6781+0+0 (secure 0 0 0) 0x7fa46008aaa0 con 0x7fa4740d27a0 2023-08-10T10:30:38.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.624+0000 7fa47899b700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 0x7fa45806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:38.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.625+0000 7fa47899b700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 0x7fa45806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa474160250 tx=0x7fa468007a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:38.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.628+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa4740c8100 con 0x7fa4740d27a0 2023-08-10T10:30:38.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:38.868+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fa4740c8100 con 0x7fa4740d27a0 2023-08-10T10:30:39.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.368+0000 7fa4717fa700 1 -- 172.21.15.88:0/4284238422 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 5 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7fa4740c8100 con 0x7fa4740d27a0 2023-08-10T10:30:39.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.371+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 msgr2=0x7fa45806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.371+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 0x7fa45806d1a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa474160250 tx=0x7fa468007a00 comp rx=0 tx=0).stop 2023-08-10T10:30:39.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.371+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 msgr2=0x7fa474153c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.371+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4600090b0 tx=0x7fa460004750 comp rx=0 tx=0).stop 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 shutdown_connections 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa47415d1e0 0x7fa474152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa45806ace0 0x7fa45806d1a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4740b4e90 0x7fa4741526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 --2- 172.21.15.88:0/4284238422 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4740d27a0 0x7fa474153c20 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 >> 172.21.15.88:0/4284238422 conn(0x7fa4740cf950 msgr2=0x7fa4740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:39.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 shutdown_connections 2023-08-10T10:30:39.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.372+0000 7fa47abff700 1 -- 172.21.15.88:0/4284238422 wait complete. 2023-08-10T10:30:39.374 INFO:teuthology.orchestra.run.smithi088.stderr:added data pool 5 to fsmap 2023-08-10T10:30:39.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:39.479 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-08-10T10:30:39.478+0000 7f0a0bbf1700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-10T10:30:39.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.592+0000 7f7c601ff700 1 Processor -- start 2023-08-10T10:30:39.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.592+0000 7f7c601ff700 1 -- start start 2023-08-10T10:30:39.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c5815cf20 0x7f7c5815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c580b8870 0x7f7c580b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c580b5040 0x7f7c5806a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580cde30 con 0x7f7c580b5040 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c580b5480 con 0x7f7c580b8870 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.593+0000 7f7c601ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5815e590 con 0x7f7c5815cf20 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c580b5040 0x7f7c5806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7c580b5040 0x7f7c5806a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43464/0 (socket says 172.21.15.88:43464) 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 -- 172.21.15.88:0/2020542916 learned_addr learned my addr 172.21.15.88:0/2020542916 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5df9b700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c5815cf20 0x7f7c5815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5d79a700 1 --2- 172.21.15.88:0/2020542916 >> v2:172.21.15.187:3300/0 conn(0x7f7c580b8870 0x7f7c580b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 -- 172.21.15.88:0/2020542916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c5815cf20 msgr2=0x7f7c5815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c5815cf20 0x7f7c5815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 -- 172.21.15.88:0/2020542916 >> v2:172.21.15.187:3300/0 conn(0x7f7c580b8870 msgr2=0x7f7c580b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/2020542916 >> v2:172.21.15.187:3300/0 conn(0x7f7c580b8870 0x7f7c580b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 -- 172.21.15.88:0/2020542916 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c580b8e30 con 0x7f7c580b5040 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.594+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580b5040 0x7f7c5806a170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806d1c0 tx=0x7f7c5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9439f12c7f5d1c8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:39.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c5cf99700 1 -- 172.21.15.88:0/2020542916 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000e070 con 0x7f7c580b5040 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c5cf99700 1 -- 172.21.15.88:0/2020542916 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000b910 con 0x7f7c580b5040 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c5cf99700 1 -- 172.21.15.88:0/2020542916 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5000bcc0 con 0x7f7c580b5040 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 -- 172.21.15.88:0/2020542916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580b5040 msgr2=0x7f7c5806a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580b5040 0x7f7c5806a170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c5806d1c0 tx=0x7f7c5000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 -- 172.21.15.88:0/2020542916 shutdown_connections 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c580b5040 0x7f7c5806a170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 --2- 172.21.15.88:0/2020542916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c5815cf20 0x7f7c5815e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 --2- 172.21.15.88:0/2020542916 >> v2:172.21.15.187:3300/0 conn(0x7f7c580b8870 0x7f7c580b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 -- 172.21.15.88:0/2020542916 >> 172.21.15.88:0/2020542916 conn(0x7f7c580d3080 msgr2=0x7f7c580d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:39.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 -- 172.21.15.88:0/2020542916 shutdown_connections 2023-08-10T10:30:39.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.595+0000 7f7c601ff700 1 -- 172.21.15.88:0/2020542916 wait complete. 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.597+0000 7f7c601ff700 1 Processor -- start 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.597+0000 7f7c601ff700 1 -- start start 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 0x7f7c581f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c580b8870 0x7f7c58156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c9a20 con 0x7f7c5815cf20 2023-08-10T10:30:39.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c581f6aa0 con 0x7f7c580b5040 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c601ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c580c9460 con 0x7f7c580b8870 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c5e79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c5e79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43480/0 (socket says 172.21.15.88:43480) 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.598+0000 7f7c5e79c700 1 -- 172.21.15.88:0/3787806187 learned_addr learned my addr 172.21.15.88:0/3787806187 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5d79a700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c580b8870 0x7f7c58156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5df9b700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 0x7f7c581f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 -- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c580b8870 msgr2=0x7f7c58156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c580b8870 0x7f7c58156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 -- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 msgr2=0x7f7c581f6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 0x7f7c581f6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 -- 172.21.15.88:0/3787806187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50009b30 con 0x7f7c5815cf20 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5df9b700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 0x7f7c581f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c5e79c700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c580b5970 tx=0x7f7c50004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500092e0 con 0x7f7c5815cf20 2023-08-10T10:30:39.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5000ce80 con 0x7f7c5815cf20 2023-08-10T10:30:39.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c500044b0 con 0x7f7c5815cf20 2023-08-10T10:30:39.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c601ff700 1 -- 172.21.15.88:0/3787806187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c580c9740 con 0x7f7c5815cf20 2023-08-10T10:30:39.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.599+0000 7f7c601ff700 1 -- 172.21.15.88:0/3787806187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c581f6040 con 0x7f7c5815cf20 2023-08-10T10:30:39.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.601+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c340052f0 con 0x7f7c5815cf20 2023-08-10T10:30:39.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.601+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7c50004610 con 0x7f7c5815cf20 2023-08-10T10:30:39.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.602+0000 7f7c4e7fc700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 0x7f7c3c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:39.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.602+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7c5008ab70 con 0x7f7c5815cf20 2023-08-10T10:30:39.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.603+0000 7f7c5df9b700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 0x7f7c3c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:39.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.603+0000 7f7c5df9b700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 0x7f7c3c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b90 tx=0x7f7c54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:39.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.607+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7c50059320 con 0x7f7c5815cf20 2023-08-10T10:30:39.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.843+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7c34005b20 con 0x7f7c5815cf20 2023-08-10T10:30:39.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.844+0000 7f7c4e7fc700 1 -- 172.21.15.88:0/3787806187 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f7c5001c440 con 0x7f7c5815cf20 2023-08-10T10:30:39.845 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:39.845 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:39.364311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-10T10:30:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 msgr2=0x7f7c3c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 0x7f7c3c06d1a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009b90 tx=0x7f7c54008040 comp rx=0 tx=0).stop 2023-08-10T10:30:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 msgr2=0x7f7c580c8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c580b5970 tx=0x7f7c50004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 shutdown_connections 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7c5815cf20 0x7f7c580c8a10 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c580b5040 0x7f7c581f6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7c3c06ace0 0x7f7c3c06d1a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 --2- 172.21.15.88:0/3787806187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c580b8870 0x7f7c58156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.846+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 >> 172.21.15.88:0/3787806187 conn(0x7f7c580d3080 msgr2=0x7f7c580d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.847+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 shutdown_connections 2023-08-10T10:30:39.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:39.847+0000 7f7c3bfff700 1 -- 172.21.15.88:0/3787806187 wait complete. 2023-08-10T10:30:39.849 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-08-10T10:30:39.865 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:40.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.064+0000 7fc5e95ff700 1 Processor -- start 2023-08-10T10:30:40.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.064+0000 7fc5e95ff700 1 -- start start 2023-08-10T10:30:40.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e95ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 0x7fc5e40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e95ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5e40b5040 0x7fc5e40d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e95ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e40b8e30 con 0x7fc5e415cf20 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e95ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40cde30 con 0x7fc5e40b5040 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e95ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e40b54b0 con 0x7fc5e40b8870 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5e40b5040 0x7fc5e40d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc5e40b5040 0x7fc5e40d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43486/0 (socket says 172.21.15.88:43486) 2023-08-10T10:30:40.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 -- 172.21.15.88:0/2309801079 learned_addr learned my addr 172.21.15.88:0/2309801079 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/2309801079 >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 0x7fc5e40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 -- 172.21.15.88:0/2309801079 >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 msgr2=0x7fc5e40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 --2- 172.21.15.88:0/2309801079 >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 0x7fc5e40b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 -- 172.21.15.88:0/2309801079 >> v1:172.21.15.187:6789/0 conn(0x7fc5e415cf20 legacy=0x7fc5e415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e37fe700 1 -- 172.21.15.88:0/2309801079 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e40ce010 con 0x7fc5e40b5040 2023-08-10T10:30:40.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.066+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/2309801079 >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 0x7fc5e40b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:40.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e37fe700 1 --2- 172.21.15.88:0/2309801079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e40d1350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40d2950 tx=0x7fc5dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a842cfc9d3a6e687 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e1ffb700 1 -- 172.21.15.88:0/2309801079 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00e070 con 0x7fc5e40b5040 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e1ffb700 1 -- 172.21.15.88:0/2309801079 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5dc00b980 con 0x7fc5e40b5040 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e1ffb700 1 -- 172.21.15.88:0/2309801079 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5dc00bd30 con 0x7fc5e40b5040 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 -- 172.21.15.88:0/2309801079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 msgr2=0x7fc5e40d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/2309801079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e40d1350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40d2950 tx=0x7fc5dc00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 -- 172.21.15.88:0/2309801079 shutdown_connections 2023-08-10T10:30:40.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/2309801079 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e40d1350 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/2309801079 >> v2:172.21.15.187:3300/0 conn(0x7fc5e40b8870 0x7fc5e40b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.067+0000 7fc5e95ff700 1 -- 172.21.15.88:0/2309801079 >> 172.21.15.88:0/2309801079 conn(0x7fc5e40d3080 msgr2=0x7fc5e40d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.068+0000 7fc5e95ff700 1 -- 172.21.15.88:0/2309801079 shutdown_connections 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.068+0000 7fc5e95ff700 1 -- 172.21.15.88:0/2309801079 wait complete. 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.069+0000 7fc5e95ff700 1 Processor -- start 2023-08-10T10:30:40.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.069+0000 7fc5e95ff700 1 -- start start 2023-08-10T10:30:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 0x7fc5e4158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 0x7fc5e4159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41f6140 con 0x7fc5e40b5040 2023-08-10T10:30:40.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41f5df0 con 0x7fc5e415cf20 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e95ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e41f3000 con 0x7fc5e40b8870 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.070+0000 7fc5e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43490/0 (socket says 172.21.15.88:43490) 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 -- 172.21.15.88:0/413544917 learned_addr learned my addr 172.21.15.88:0/413544917 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e37fe700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 0x7fc5e4159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 0x7fc5e4158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 -- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 msgr2=0x7fc5e4158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 0x7fc5e4158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 -- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 msgr2=0x7fc5e4159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 0x7fc5e4159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 -- 172.21.15.88:0/413544917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5dc009b30 con 0x7fc5e40b5040 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 0x7fc5e4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e37fe700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 0x7fc5e4159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e2ffd700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c450 tx=0x7fc5d400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40052d0 con 0x7fc5e40b5040 2023-08-10T10:30:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d4005430 con 0x7fc5e40b5040 2023-08-10T10:30:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40038c0 con 0x7fc5e40b5040 2023-08-10T10:30:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.071+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e41f32e0 con 0x7fc5e40b5040 2023-08-10T10:30:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.072+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e41f6aa0 con 0x7fc5e40b5040 2023-08-10T10:30:40.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.073+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e40b4b30 con 0x7fc5e40b5040 2023-08-10T10:30:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.074+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc5d4003a20 con 0x7fc5e40b5040 2023-08-10T10:30:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.074+0000 7fc5cb7fe700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 0x7fc5d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.075+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc5d4088a80 con 0x7fc5e40b5040 2023-08-10T10:30:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.075+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 0x7fc5d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.075+0000 7fc5e27fc700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 0x7fc5d006d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40b8490 tx=0x7fc5d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.079+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc5d40538d0 con 0x7fc5e40b5040 2023-08-10T10:30:40.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.274+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc5e404ecc0 con 0x7fc5e40b5040 2023-08-10T10:30:40.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.276+0000 7fc5cb7fe700 1 -- 172.21.15.88:0/413544917 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fc5d4056ef0 con 0x7fc5e40b5040 2023-08-10T10:30:40.277 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:40.277 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:40.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 msgr2=0x7fc5d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 0x7fc5d006d1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40b8490 tx=0x7fc5d8008040 comp rx=0 tx=0).stop 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 msgr2=0x7fc5e41f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc5d400c450 tx=0x7fc5d400c810 comp rx=0 tx=0).stop 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 shutdown_connections 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e415cf20 0x7fc5e4159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc5e40b5040 0x7fc5e41f6560 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc5d006ace0 0x7fc5d006d1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 --2- 172.21.15.88:0/413544917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e40b8870 0x7fc5e4158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 >> 172.21.15.88:0/413544917 conn(0x7fc5e40d3080 msgr2=0x7fc5e41600d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:40.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 shutdown_connections 2023-08-10T10:30:40.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.278+0000 7fc5e95ff700 1 -- 172.21.15.88:0/413544917 wait complete. 2023-08-10T10:30:40.298 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:40.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.495+0000 7fb7795ff700 1 Processor -- start 2023-08-10T10:30:40.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.495+0000 7fb7795ff700 1 -- start start 2023-08-10T10:30:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.496+0000 7fb7795ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7740b8870 0x7fb7740b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.496+0000 7fb7795ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb7740b5040 0x7fb7740d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.496+0000 7fb7795ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7740b8e30 con 0x7fb77415cf20 2023-08-10T10:30:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.496+0000 7fb7795ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740cde30 con 0x7fb7740b8870 2023-08-10T10:30:40.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.496+0000 7fb7795ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7740b54b0 con 0x7fb7740b5040 2023-08-10T10:30:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb7740b8870 0x7fb7740b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb772ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb77415cf20 0x7fb77415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:37766/0 (socket says 172.21.15.88:37766) 2023-08-10T10:30:40.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb772ffd700 1 -- 172.21.15.88:0/2580305721 learned_addr learned my addr 172.21.15.88:0/2580305721 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 -- 172.21.15.88:0/2580305721 >> v2:172.21.15.187:3300/0 conn(0x7fb7740b5040 msgr2=0x7fb7740d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 --2- 172.21.15.88:0/2580305721 >> v2:172.21.15.187:3300/0 conn(0x7fb7740b5040 0x7fb7740d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 -- 172.21.15.88:0/2580305721 >> v1:172.21.15.88:6789/0 conn(0x7fb77415cf20 legacy=0x7fb77415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 -- 172.21.15.88:0/2580305721 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7740ce010 con 0x7fb7740b8870 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb7727fc700 1 -- 172.21.15.88:0/2580305721 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793859406 0 0) 0x7fb7740b8e30 con 0x7fb77415cf20 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.497+0000 7fb76bfff700 1 --2- 172.21.15.88:0/2580305721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb7740b4b00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cd840 tx=0x7fb75c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b5d22ea51d8b08 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7727fc700 1 -- 172.21.15.88:0/2580305721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011830 con 0x7fb7740b8870 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7727fc700 1 -- 172.21.15.88:0/2580305721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c011990 con 0x7fb7740b8870 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7727fc700 1 -- 172.21.15.88:0/2580305721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c011d20 con 0x7fb7740b8870 2023-08-10T10:30:40.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 -- 172.21.15.88:0/2580305721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 msgr2=0x7fb7740b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 --2- 172.21.15.88:0/2580305721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb7740b4b00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb7740cd840 tx=0x7fb75c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 -- 172.21.15.88:0/2580305721 shutdown_connections 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 --2- 172.21.15.88:0/2580305721 >> v2:172.21.15.187:3300/0 conn(0x7fb7740b5040 0x7fb7740d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 --2- 172.21.15.88:0/2580305721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb7740b4b00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 -- 172.21.15.88:0/2580305721 >> 172.21.15.88:0/2580305721 conn(0x7fb7740d3080 msgr2=0x7fb7740d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 -- 172.21.15.88:0/2580305721 shutdown_connections 2023-08-10T10:30:40.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.498+0000 7fb7795ff700 1 -- 172.21.15.88:0/2580305721 wait complete. 2023-08-10T10:30:40.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.500+0000 7fb7795ff700 1 Processor -- start 2023-08-10T10:30:40.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.500+0000 7fb7795ff700 1 -- start start 2023-08-10T10:30:40.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7740b5040 0x7fb7741f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb77415cf20 0x7fb7740cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7741f6ca0 con 0x7fb7740b8870 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c6ec0 con 0x7fb77415cf20 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7795ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7740c71a0 con 0x7fb7740b5040 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb76bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb76bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43504/0 (socket says 172.21.15.88:43504) 2023-08-10T10:30:40.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb76bfff700 1 -- 172.21.15.88:0/834630827 learned_addr learned my addr 172.21.15.88:0/834630827 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb7737fe700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb77415cf20 0x7fb7740cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.501+0000 7fb772ffd700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7740b5040 0x7fb7741f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 -- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7740b5040 msgr2=0x7fb7741f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7740b5040 0x7fb7741f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 -- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb77415cf20 msgr2=0x7fb7740cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb77415cf20 0x7fb7740cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 -- 172.21.15.88:0/834630827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb75c0094a0 con 0x7fb7740b8870 2023-08-10T10:30:40.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76bfff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0097c0 tx=0x7fb75c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c0045f0 con 0x7fb7740b8870 2023-08-10T10:30:40.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb75c01f070 con 0x7fb7740b8870 2023-08-10T10:30:40.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7740c7480 con 0x7fb7740b8870 2023-08-10T10:30:40.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb75c003b00 con 0x7fb7740b8870 2023-08-10T10:30:40.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.502+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7740c7a40 con 0x7fb7740b8870 2023-08-10T10:30:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.503+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb77404e4d0 con 0x7fb7740b8870 2023-08-10T10:30:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.504+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb75c003c60 con 0x7fb7740b8870 2023-08-10T10:30:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.505+0000 7fb76b7fe700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.505+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb75c021070 con 0x7fb7740b8870 2023-08-10T10:30:40.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.505+0000 7fb772ffd700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.506+0000 7fb772ffd700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 0x7fb75406d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb764000f60 tx=0x7fb764007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.509+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb75c056050 con 0x7fb7740b8870 2023-08-10T10:30:40.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.703+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7740b5df0 con 0x7fb7740b8870 2023-08-10T10:30:40.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.705+0000 7fb76b7fe700 1 -- 172.21.15.88:0/834630827 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fb75c059670 con 0x7fb7740b8870 2023-08-10T10:30:40.705 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:40.706 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 msgr2=0x7fb75406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 0x7fb75406d1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb764000f60 tx=0x7fb764007c90 comp rx=0 tx=0).stop 2023-08-10T10:30:40.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 msgr2=0x7fb77406a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb75c0097c0 tx=0x7fb75c004750 comp rx=0 tx=0).stop 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 shutdown_connections 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb77415cf20 0x7fb7740cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb75406ace0 0x7fb75406d1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7740b5040 0x7fb7741f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 --2- 172.21.15.88:0/834630827 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb7740b8870 0x7fb77406a3e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 >> 172.21.15.88:0/834630827 conn(0x7fb7740d3080 msgr2=0x7fb7740b3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:40.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 shutdown_connections 2023-08-10T10:30:40.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.707+0000 7fb7795ff700 1 -- 172.21.15.88:0/834630827 wait complete. 2023-08-10T10:30:40.739 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:40.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.934+0000 7f13171ff700 1 Processor -- start 2023-08-10T10:30:40.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.934+0000 7f13171ff700 1 -- start start 2023-08-10T10:30:40.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f13171ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f131015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f13171ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13100b8870 0x7f13100b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f13171ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13100b5480 con 0x7f13100b5040 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f13171ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13100cde30 con 0x7f13100b8870 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f13171ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f131015e590 con 0x7f131015cf20 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f130ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13100b8870 0x7f13100b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f130ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13100b8870 0x7f13100b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43520/0 (socket says 172.21.15.88:43520) 2023-08-10T10:30:40.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f130ffff700 1 -- 172.21.15.88:0/1171375357 learned_addr learned my addr 172.21.15.88:0/1171375357 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:40.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.935+0000 7f1314f9b700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f131015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130ffff700 1 -- 172.21.15.88:0/1171375357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 msgr2=0x7f131015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:40.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130ffff700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f131015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130ffff700 1 -- 172.21.15.88:0/1171375357 >> v1:172.21.15.187:6789/0 conn(0x7f13100b5040 legacy=0x7f131006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130ffff700 1 -- 172.21.15.88:0/1171375357 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13100b8e30 con 0x7f13100b8870 2023-08-10T10:30:40.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130f7fe700 1 -- 172.21.15.88:0/1171375357 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555593255 0 0) 0x7f13100b5480 con 0x7f13100b5040 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130ffff700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100b4b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0098f0 tx=0x7f12fc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723e3cd85f221d83 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130f7fe700 1 -- 172.21.15.88:0/1171375357 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011830 con 0x7f13100b8870 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130f7fe700 1 -- 172.21.15.88:0/1171375357 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc011990 con 0x7f13100b8870 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.936+0000 7f130f7fe700 1 -- 172.21.15.88:0/1171375357 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc011d20 con 0x7f13100b8870 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 -- 172.21.15.88:0/1171375357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 msgr2=0x7f13100b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100b4b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f12fc0098f0 tx=0x7f12fc009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 -- 172.21.15.88:0/1171375357 shutdown_connections 2023-08-10T10:30:40.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f131015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 --2- 172.21.15.88:0/1171375357 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100b4b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 -- 172.21.15.88:0/1171375357 >> 172.21.15.88:0/1171375357 conn(0x7f13100d3080 msgr2=0x7f13100d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:40.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 -- 172.21.15.88:0/1171375357 shutdown_connections 2023-08-10T10:30:40.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.937+0000 7f13171ff700 1 -- 172.21.15.88:0/1171375357 wait complete. 2023-08-10T10:30:40.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.939+0000 7f13171ff700 1 Processor -- start 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.939+0000 7f13171ff700 1 -- start start 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13100b5040 0x7f13100ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f1310156b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c7d80 con 0x7f13100b8870 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c8060 con 0x7f13100b5040 2023-08-10T10:30:40.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f13171ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13100c8340 con 0x7f131015cf20 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43534/0 (socket says 172.21.15.88:43534) 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 -- 172.21.15.88:0/2607985494 learned_addr learned my addr 172.21.15.88:0/2607985494 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f1314f9b700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13100b5040 0x7f13100ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f131579c700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f1310156b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 -- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 msgr2=0x7f1310156b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f1310156b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 -- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13100b5040 msgr2=0x7f13100ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13100b5040 0x7f13100ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f130ffff700 1 -- 172.21.15.88:0/2607985494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12fc009550 con 0x7f13100b8870 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.940+0000 7f131579c700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f1310156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f130ffff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009c40 tx=0x7f12fc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc004400 con 0x7f13100b8870 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12fc01f070 con 0x7f13100b8870 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13100c8620 con 0x7f13100b8870 2023-08-10T10:30:40.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12fc0038c0 con 0x7f13100b8870 2023-08-10T10:30:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.941+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13100ca600 con 0x7f13100b8870 2023-08-10T10:30:40.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.942+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13100c8b40 con 0x7f13100b8870 2023-08-10T10:30:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.943+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f12fc021030 con 0x7f13100b8870 2023-08-10T10:30:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.944+0000 7f130d7fa700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 0x7f12f406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.944+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f12fc08abf0 con 0x7f13100b8870 2023-08-10T10:30:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.944+0000 7f1314f9b700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 0x7f12f406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:40.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.945+0000 7f1314f9b700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 0x7f12f406d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f13100cd170 tx=0x7f1304009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:40.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:40.948+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f13100c8b40 con 0x7f13100b8870 2023-08-10T10:30:41.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.184+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13100c8b40 con 0x7f13100b8870 2023-08-10T10:30:41.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.185+0000 7f130d7fa700 1 -- 172.21.15.88:0/2607985494 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f13100c8b40 con 0x7f13100b8870 2023-08-10T10:30:41.185 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:41.185 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:39.364311+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-10T10:30:41.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 msgr2=0x7f12f406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 0x7f12f406d1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f13100cd170 tx=0x7f1304009210 comp rx=0 tx=0).stop 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 msgr2=0x7f13100c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f12fc009c40 tx=0x7f12fc004750 comp rx=0 tx=0).stop 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 shutdown_connections 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f12f406ace0 0x7f12f406d1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f131015cf20 0x7f1310156b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13100b5040 0x7f13100ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 --2- 172.21.15.88:0/2607985494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13100b8870 0x7f13100c7530 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 >> 172.21.15.88:0/2607985494 conn(0x7f13100d3080 msgr2=0x7f131006aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 shutdown_connections 2023-08-10T10:30:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.187+0000 7f13171ff700 1 -- 172.21.15.88:0/2607985494 wait complete. 2023-08-10T10:30:41.189 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 7 2023-08-10T10:30:41.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:41.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.404+0000 7fbadbbff700 1 Processor -- start 2023-08-10T10:30:41.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.404+0000 7fbadbbff700 1 -- start start 2023-08-10T10:30:41.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbadbbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbad40b8870 0x7fbad40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbadbbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad40b5040 0x7fbad40d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbadbbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad40b8e30 con 0x7fbad415cf20 2023-08-10T10:30:41.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbadbbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40cde30 con 0x7fbad40b5040 2023-08-10T10:30:41.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbadbbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40b54b0 con 0x7fbad40b8870 2023-08-10T10:30:41.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad40b5040 0x7fbad40d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbad40b5040 0x7fbad40d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43550/0 (socket says 172.21.15.88:43550) 2023-08-10T10:30:41.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 -- 172.21.15.88:0/2576087822 learned_addr learned my addr 172.21.15.88:0/2576087822 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:41.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbad919a700 1 --2- 172.21.15.88:0/2576087822 >> v2:172.21.15.187:3300/0 conn(0x7fbad40b8870 0x7fbad40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 -- 172.21.15.88:0/2576087822 >> v2:172.21.15.187:3300/0 conn(0x7fbad40b8870 msgr2=0x7fbad40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 --2- 172.21.15.88:0/2576087822 >> v2:172.21.15.187:3300/0 conn(0x7fbad40b8870 0x7fbad40b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 -- 172.21.15.88:0/2576087822 >> v1:172.21.15.187:6789/0 conn(0x7fbad415cf20 legacy=0x7fbad415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.406+0000 7fbada19c700 1 -- 172.21.15.88:0/2576087822 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40ce010 con 0x7fbad40b5040 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbada19c700 1 --2- 172.21.15.88:0/2576087822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad40d1350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbad40d2950 tx=0x7fbacc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ffb3bef2e810e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbad8999700 1 -- 172.21.15.88:0/2576087822 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc00e070 con 0x7fbad40b5040 2023-08-10T10:30:41.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbad8999700 1 -- 172.21.15.88:0/2576087822 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc003a20 con 0x7fbad40b5040 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbad8999700 1 -- 172.21.15.88:0/2576087822 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc003dd0 con 0x7fbad40b5040 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 -- 172.21.15.88:0/2576087822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 msgr2=0x7fbad40d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 --2- 172.21.15.88:0/2576087822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad40d1350 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbad40d2950 tx=0x7fbacc00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 -- 172.21.15.88:0/2576087822 shutdown_connections 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 --2- 172.21.15.88:0/2576087822 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad40d1350 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 --2- 172.21.15.88:0/2576087822 >> v2:172.21.15.187:3300/0 conn(0x7fbad40b8870 0x7fbad40b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.407+0000 7fbadbbff700 1 -- 172.21.15.88:0/2576087822 >> 172.21.15.88:0/2576087822 conn(0x7fbad40d3080 msgr2=0x7fbad40d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:41.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.408+0000 7fbadbbff700 1 -- 172.21.15.88:0/2576087822 shutdown_connections 2023-08-10T10:30:41.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.408+0000 7fbadbbff700 1 -- 172.21.15.88:0/2576087822 wait complete. 2023-08-10T10:30:41.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.409+0000 7fbadbbff700 1 Processor -- start 2023-08-10T10:30:41.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.409+0000 7fbadbbff700 1 -- start start 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbad40b8870 0x7fbad40ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbad415cf20 0x7fbad40cadf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41f3820 con 0x7fbad40b5040 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad41f3540 con 0x7fbad415cf20 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.410+0000 7fbadbbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40b6640 con 0x7fbad40b8870 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:43566/0 (socket says 172.21.15.88:43566) 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 -- 172.21.15.88:0/357635260 learned_addr learned my addr 172.21.15.88:0/357635260 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbada19c700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbad415cf20 0x7fbad40cadf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad919a700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbad40b8870 0x7fbad40ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 -- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbad40b8870 msgr2=0x7fbad40ca8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbad40b8870 0x7fbad40ca8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 -- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbad415cf20 msgr2=0x7fbad40cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbad415cf20 0x7fbad40cadf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 -- 172.21.15.88:0/357635260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbacc009b30 con 0x7fbad40b5040 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbad999b700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbad000b4a0 tx=0x7fbad000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0011830 con 0x7fbad40b5040 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbad0011990 con 0x7fbad40b5040 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.411+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbad0011d40 con 0x7fbad40b5040 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.412+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad40b6920 con 0x7fbad40b5040 2023-08-10T10:30:41.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.412+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad4152de0 con 0x7fbad40b5040 2023-08-10T10:30:41.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.413+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad404ecc0 con 0x7fbad40b5040 2023-08-10T10:30:41.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.413+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbad001a400 con 0x7fbad40b5040 2023-08-10T10:30:41.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.414+0000 7fbaca7fc700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 0x7fbab806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:41.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.414+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbad0089450 con 0x7fbad40b5040 2023-08-10T10:30:41.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.415+0000 7fbad919a700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 0x7fbab806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:41.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.415+0000 7fbad919a700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 0x7fbab806d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b46d0 tx=0x7fbac4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:41.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.419+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbad00542b0 con 0x7fbad40b5040 2023-08-10T10:30:41.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.617+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbad406b180 con 0x7fbad40b5040 2023-08-10T10:30:41.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.619+0000 7fbaca7fc700 1 -- 172.21.15.88:0/357635260 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fbad00578d0 con 0x7fbad40b5040 2023-08-10T10:30:41.619 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:41.620 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:41.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 msgr2=0x7fbab806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 0x7fbab806d1a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbad40b46d0 tx=0x7fbac4008040 comp rx=0 tx=0).stop 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 msgr2=0x7fbad41528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbad000b4a0 tx=0x7fbad000b7b0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 shutdown_connections 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbad415cf20 0x7fbad40cadf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbad40b5040 0x7fbad41528a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbab806ace0 0x7fbab806d1a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 --2- 172.21.15.88:0/357635260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbad40b8870 0x7fbad40ca8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 >> 172.21.15.88:0/357635260 conn(0x7fbad40d3080 msgr2=0x7fbad415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 shutdown_connections 2023-08-10T10:30:41.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:41.621+0000 7fbadbbff700 1 -- 172.21.15.88:0/357635260 wait complete. 2023-08-10T10:30:42.041 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:30:33.791781+0000', 'modified': '2023-08-10T10:30:39.364311+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6834/2975223265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6832', 'nonce': 2975223265}, {'type': 'v1', 'addr': '172.21.15.187:6834', 'nonce': 2975223265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-10T10:30:42.042 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:30:42.042 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-10T10:30:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.239+0000 7f02381ff700 1 Processor -- start 2023-08-10T10:30:42.240 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.240+0000 7f02381ff700 1 -- start start 2023-08-10T10:30:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f02381ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f023015cf20 0x7f023015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f02381ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f023015e590 con 0x7f02300b5210 2023-08-10T10:30:42.241 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f02381ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02300b8e30 con 0x7f02300b8870 2023-08-10T10:30:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f02381ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02300cde30 con 0x7f023015cf20 2023-08-10T10:30:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f023679c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f02300b5210 0x7f02300d1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34850/0 (socket says 172.21.15.88:34850) 2023-08-10T10:30:42.242 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f023679c700 1 -- 172.21.15.88:0/2522285977 learned_addr learned my addr 172.21.15.88:0/2522285977 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2522285977 >> v2:172.21.15.187:3300/0 conn(0x7f023015cf20 0x7f023015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699650629 0 0) 0x7f023015e590 con 0x7f02300b5210 2023-08-10T10:30:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.241+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f021c0035b0 con 0x7f02300b5210 2023-08-10T10:30:42.244 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2710353122 0 0) 0x7f021c0035b0 con 0x7f02300b5210 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 >> v2:172.21.15.187:3300/0 conn(0x7f023015cf20 msgr2=0x7f023015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 --2- 172.21.15.88:0/2522285977 >> v2:172.21.15.187:3300/0 conn(0x7f023015cf20 0x7f023015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 >> v1:172.21.15.187:6789/0 conn(0x7f02300b8870 legacy=0x7f02300b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300ce010 con 0x7f02300b5210 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f02280019f0 con 0x7f02300b5210 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 >> v1:172.21.15.88:6789/0 conn(0x7f02300b5210 legacy=0x7f02300d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f021c003a50 0x7f021c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f021c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021c005260 0x7f021c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300cde30 con 0x7f021c004850 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c00c1b0 con 0x7f021c003a50 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c00c370 con 0x7f021c005260 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023579a700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f021c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f021c003a50 0x7f021c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023679c700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021c005260 0x7f021c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023579a700 1 -- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021c005260 msgr2=0x7f021c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023579a700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f021c005260 0x7f021c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023579a700 1 -- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f021c003a50 msgr2=0x7f021c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.242+0000 7f023579a700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f021c003a50 0x7f021c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f023579a700 1 -- 172.21.15.88:0/2522285977 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0035b0 con 0x7f021c004850 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f023679c700 1 -- 172.21.15.88:0/2522285977 reap_dead start 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f023579a700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f021c004cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0220007fd0 tx=0x7f021c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4a94090b511efa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200052d0 con 0x7f021c004850 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220005450 con 0x7f021c004850 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f0234f99700 1 -- 172.21.15.88:0/2522285977 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200038c0 con 0x7f021c004850 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f02381ff700 1 -- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 msgr2=0x7f021c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.243+0000 7f02381ff700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f021c004cd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0220007fd0 tx=0x7f021c005880 comp rx=0 tx=0).stop 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.244+0000 7f02381ff700 1 -- 172.21.15.88:0/2522285977 shutdown_connections 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.244+0000 7f02381ff700 1 --2- 172.21.15.88:0/2522285977 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f021c004cd0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.244+0000 7f02381ff700 1 -- 172.21.15.88:0/2522285977 >> 172.21.15.88:0/2522285977 conn(0x7f02300d3080 msgr2=0x7f02300d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.244+0000 7f02381ff700 1 -- 172.21.15.88:0/2522285977 shutdown_connections 2023-08-10T10:30:42.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.244+0000 7f02381ff700 1 -- 172.21.15.88:0/2522285977 wait complete. 2023-08-10T10:30:42.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.245+0000 7f02381ff700 1 Processor -- start 2023-08-10T10:30:42.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.245+0000 7f02381ff700 1 -- start start 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02300cc3e0 0x7f02300cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02300ca280 0x7f02300ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f023015e880 con 0x7f021c004850 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02300ccda0 con 0x7f02300cc3e0 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f02381ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02300cb850 con 0x7f02300ca280 2023-08-10T10:30:42.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.246+0000 7f0235f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44030/0 (socket says 172.21.15.88:44030) 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 -- 172.21.15.88:0/2211611619 learned_addr learned my addr 172.21.15.88:0/2211611619 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f023579a700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02300cc3e0 0x7f02300cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f023679c700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02300ca280 0x7f02300ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 -- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02300ca280 msgr2=0x7f02300ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02300ca280 0x7f02300ca700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 -- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02300cc3e0 msgr2=0x7f02300cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02300cc3e0 0x7f02300cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 -- 172.21.15.88:0/2211611619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02300cafb0 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f022c011ad0 tx=0x7f022c011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f02267fc700 1 -- 172.21.15.88:0/2211611619 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c00fa60 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f02267fc700 1 -- 172.21.15.88:0/2211611619 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f022c00fbc0 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02300cb290 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f02267fc700 1 -- 172.21.15.88:0/2211611619 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022c014440 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.247+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02300c6cc0 con 0x7f021c004850 2023-08-10T10:30:42.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.250+0000 7f02267fc700 1 -- 172.21.15.88:0/2211611619 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f022c0145a0 con 0x7f021c004850 2023-08-10T10:30:42.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.250+0000 7f02267fc700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.251+0000 7f02267fc700 1 -- 172.21.15.88:0/2211611619 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f022c089ff0 con 0x7f021c004850 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.251+0000 7f023579a700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.251+0000 7f023579a700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 0x7f021406d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0220005040 tx=0x7f0220009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.252+0000 7f024bad9b80 1 Processor -- start 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.252+0000 7f024bad9b80 1 -- start start 2023-08-10T10:30:42.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efdc230 0x55d31efdc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f006ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31ef50ab0 con 0x55d31efd9920 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31ef35440 con 0x55d31efdc230 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.253+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d31ef32ba0 con 0x55d31f006660 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44044/0 (socket says 172.21.15.88:44044) 2023-08-10T10:30:42.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 -- 172.21.15.88:0/2672739336 learned_addr learned my addr 172.21.15.88:0/2672739336 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f0235f9b700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efdc230 0x55d31efdc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023679c700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f006ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 -- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 msgr2=0x55d31f006ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f006ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 -- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efdc230 msgr2=0x55d31efdc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efdc230 0x55d31efdc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 -- 172.21.15.88:0/2672739336 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d31ed21790 con 0x55d31efd9920 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023679c700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f006ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f023579a700 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c180 tx=0x7f0220011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec0ac593be775d2 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f02137fe700 1 -- 172.21.15.88:0/2672739336 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220003680 con 0x55d31efd9920 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f02137fe700 1 -- 172.21.15.88:0/2672739336 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200037e0 con 0x55d31efd9920 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.254+0000 7f02137fe700 1 -- 172.21.15.88:0/2672739336 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220003b70 con 0x55d31efd9920 2023-08-10T10:30:42.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 -- 172.21.15.88:0/2672739336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 msgr2=0x55d31f002b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f021c00c180 tx=0x7f0220011000 comp rx=0 tx=0).stop 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 -- 172.21.15.88:0/2672739336 shutdown_connections 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f006ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efdc230 0x55d31efdc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 --2- 172.21.15.88:0/2672739336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efd9920 0x55d31f002b00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 -- 172.21.15.88:0/2672739336 >> 172.21.15.88:0/2672739336 conn(0x55d31ef3c3a0 msgr2=0x55d31f021380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 -- 172.21.15.88:0/2672739336 shutdown_connections 2023-08-10T10:30:42.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.255+0000 7f024bad9b80 1 -- 172.21.15.88:0/2672739336 wait complete. 2023-08-10T10:30:42.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.256+0000 7f024bad9b80 1 -- start start 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.256+0000 7f024bad9b80 1 Processor -- start 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efd9920 0x55d31effc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f009c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31ef2e490 con 0x55d31efdc230 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31eeeb5b0 con 0x55d31efd9920 2023-08-10T10:30:42.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d31eed1910 con 0x55d31f006660 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f024bad9b80 10 client.0 _ll_register_callbacks cb 0x55d31ed2aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44046/0 (socket says 172.21.15.88:44046) 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.257+0000 7f023579a700 1 -- 172.21.15.88:0/1214543639 learned_addr learned my addr 172.21.15.88:0/1214543639 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023679c700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f009c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f0235f9b700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efd9920 0x55d31effc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 -- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 msgr2=0x55d31f009c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f009c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 -- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efd9920 msgr2=0x55d31effc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efd9920 0x55d31effc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 -- 172.21.15.88:0/1214543639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c0035b0 con 0x55d31efdc230 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f023579a700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0220001d80 tx=0x7f0220001190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf515a5deec50a9b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f0210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220039070 con 0x55d31efdc230 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f022003cdd0 con 0x55d31efdc230 2023-08-10T10:30:42.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.258+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d31efcecc0 con 0x55d31efdc230 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0220003b60 con 0x55d31efdc230 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 10 client.4440 fetch_fsmap learned FSMap version 7 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d31ee0e0a0 con 0x55d31efdc230 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d31efcecc0 con 0x55d31efdc230 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0220003cc0 con 0x55d31efdc230 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 10 client.4440 fetch_fsmap finished waiting for FSMap version 7 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 10 client.4440 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:30:42.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 20 client.4440 populate_metadata read hostname 'smithi088' 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f00a3a0 0x55d31f004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 4 client.4440 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 --> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d31efaba90 con 0x55d31f00a3a0 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.259+0000 7f0235f9b700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f00a3a0 0x55d31f004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.260+0000 7f0210ff9700 10 client.4440 ms_handle_connect on v2:172.21.15.187:6832/2975223265 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.260+0000 7f0235f9b700 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f00a3a0 0x55d31f004fb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=732ac731ae4da72f server_cookie=86e77f47751147a in_seq=0 out_seq=0 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.261+0000 7f0210ff9700 1 -- 172.21.15.88:0/1214543639 <== mds.0 v2:172.21.15.187:6832/2975223265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d31efaba90 con 0x55d31f00a3a0 2023-08-10T10:30:42.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.261+0000 7f0210ff9700 10 client.4440 handle_command_reply: tid=0 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.261+0000 7f024bad9b80 1 client.4440 shutdown 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 msgr2=0x55d31f008320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0220001d80 tx=0x7f0220001190 comp rx=0 tx=0).stop 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 shutdown_connections 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f00a3a0 0x55d31f004fb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31f006660 0x55d31f009c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31efd9920 0x55d31effc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 --2- 172.21.15.88:0/1214543639 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f008320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 >> 172.21.15.88:0/1214543639 conn(0x55d31ef3c3a0 msgr2=0x55d31f024900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f0210ff9700 0 client.4440 ms_handle_reset on v2:172.21.15.187:6832/2975223265 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 shutdown_connections 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 1 -- 172.21.15.88:0/1214543639 wait complete. 2023-08-10T10:30:42.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.262+0000 7f024bad9b80 20 client.4440 trim_cache size 0 max 16384 2023-08-10T10:30:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.280+0000 7f024bad9b80 1 Processor -- start 2023-08-10T10:30:42.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.280+0000 7f024bad9b80 1 -- start start 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f024810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31ed22390 con 0x55d31efdc230 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31efd2e40 con 0x55d31f006660 2023-08-10T10:30:42.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d31f0086a0 con 0x55d31efd9920 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44052/0 (socket says 172.21.15.88:44052) 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f023579a700 1 -- 172.21.15.88:0/189082957 learned_addr learned my addr 172.21.15.88:0/189082957 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f023679c700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.281+0000 7f0235f9b700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f024810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 -- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 msgr2=0x55d31f024810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f024810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 -- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 msgr2=0x55d31f032c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 -- 172.21.15.88:0/189082957 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d31eef3b10 con 0x55d31efdc230 2023-08-10T10:30:42.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023679c700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f023579a700 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f02200011d0 tx=0x7f0220039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb61b25d0890e9c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f0213fff700 1 -- 172.21.15.88:0/189082957 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02200077f0 con 0x55d31efdc230 2023-08-10T10:30:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f0213fff700 1 -- 172.21.15.88:0/189082957 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0220003b60 con 0x55d31efdc230 2023-08-10T10:30:42.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.282+0000 7f0213fff700 1 -- 172.21.15.88:0/189082957 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022002b450 con 0x55d31efdc230 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- 172.21.15.88:0/189082957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 msgr2=0x55d31f024d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f02200011d0 tx=0x7f0220039000 comp rx=0 tx=0).stop 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- 172.21.15.88:0/189082957 shutdown_connections 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f024810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 --2- 172.21.15.88:0/189082957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f024d50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- 172.21.15.88:0/189082957 >> 172.21.15.88:0/189082957 conn(0x55d31ef3c3a0 msgr2=0x55d31efdc610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- 172.21.15.88:0/189082957 shutdown_connections 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- 172.21.15.88:0/189082957 wait complete. 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.283+0000 7f024bad9b80 1 -- start start 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.284+0000 7f024bad9b80 1 Processor -- start 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.284+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f03a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.284+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.284+0000 7f024bad9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f024bad9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31f031cd0 con 0x55d31efdc230 2023-08-10T10:30:42.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d31f08a4a0 con 0x55d31f006660 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f024bad9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d31f022210 con 0x55d31efd9920 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f024bad9b80 10 client.0 _ll_register_callbacks cb 0x55d31ed2aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44064/0 (socket says 172.21.15.88:44064) 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 -- 172.21.15.88:0/4058678158 learned_addr learned my addr 172.21.15.88:0/4058678158 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023679c700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f0235f9b700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f03a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 -- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 msgr2=0x55d31f03a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f03a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 -- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 msgr2=0x55d31f032660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 -- 172.21.15.88:0/4058678158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d31ee0e0a0 con 0x55d31efdc230 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f023579a700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0220001050 tx=0x7f022000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cc6f622a1a61a5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.285+0000 7f0210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-08-10T10:30:42.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220039070 con 0x55d31efdc230 2023-08-10T10:30:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f02200037e0 con 0x55d31efdc230 2023-08-10T10:30:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0220007770 con 0x55d31efdc230 2023-08-10T10:30:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0220034450 con 0x55d31efdc230 2023-08-10T10:30:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 10 client.4446 fetch_fsmap learned FSMap version 7 2023-08-10T10:30:42.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55d31ed821d0 con 0x55d31efdc230 2023-08-10T10:30:42.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02200037e0 con 0x55d31efdc230 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 7) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f02200345b0 con 0x55d31efdc230 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 10 client.4446 fetch_fsmap finished waiting for FSMap version 7 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 10 client.4446 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 20 client.4446 populate_metadata read hostname 'smithi088' 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f06f470 0x55d31f024810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 4 client.4446 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-08-10T10:30:42.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.286+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 --> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d31ef275d0 con 0x55d31f06f470 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0235f9b700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f06f470 0x55d31f024810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0235f9b700 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f06f470 0x55d31f024810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d254af3c223488d server_cookie=44be3df4b8b35349 in_seq=0 out_seq=0 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0210ff9700 10 client.4446 ms_handle_connect on v2:172.21.15.187:6832/2975223265 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0210ff9700 1 -- 172.21.15.88:0/4058678158 <== mds.0 v2:172.21.15.187:6832/2975223265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d31ef275d0 con 0x55d31f06f470 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0210ff9700 10 client.4446 handle_command_reply: tid=0 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 client.4446 shutdown 2023-08-10T10:30:42.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 msgr2=0x55d31f032120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0220001050 tx=0x7f022000a000 comp rx=0 tx=0).stop 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 shutdown_connections 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d31f06f470 0x55d31f024810 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d31f006660 0x55d31f032660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d31efd9920 0x55d31f03a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f0210ff9700 0 client.4446 ms_handle_reset on v2:172.21.15.187:6832/2975223265 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 --2- 172.21.15.88:0/4058678158 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d31efdc230 0x55d31f032120 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.287+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 >> 172.21.15.88:0/4058678158 conn(0x55d31ef3c3a0 msgr2=0x55d31f025680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 shutdown_connections 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f024bad9b80 1 -- 172.21.15.88:0/4058678158 wait complete. 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f024bad9b80 20 client.4446 trim_cache size 0 max 16384 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c", 2023-08-10T10:30:42.296 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4293, 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 7.9658315479999997, 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 7, 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 27, 2023-08-10T10:30:42.297 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 26, 2023-08-10T10:30:42.298 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 13.810019467 2023-08-10T10:30:42.298 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 msgr2=0x7f021406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 0x7f021406d1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0220005040 tx=0x7f0220009030 comp rx=0 tx=0).stop 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 msgr2=0x7f02301f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f022c011ad0 tx=0x7f022c011e90 comp rx=0 tx=0).stop 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 shutdown_connections 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f021406ace0 0x7f021406d1a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.299 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02300ca280 0x7f02300ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f021c004850 0x7f02301f2100 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 --2- 172.21.15.88:0/2211611619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02300cc3e0 0x7f02300cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.288+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 >> 172.21.15.88:0/2211611619 conn(0x7f02300d3080 msgr2=0x7f02300b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.289+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 shutdown_connections 2023-08-10T10:30:42.300 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.289+0000 7f02381ff700 1 -- 172.21.15.88:0/2211611619 wait complete. 2023-08-10T10:30:42.306 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:30:42.307 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:42.307 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:30:42.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.506+0000 7f5f8ddff700 1 Processor -- start 2023-08-10T10:30:42.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.506+0000 7f5f8ddff700 1 -- start start 2023-08-10T10:30:42.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f8ddff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5f880cf730 0x7f5f8806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f8ddff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f880b05c0 con 0x7f5f880afd50 2023-08-10T10:30:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f8ddff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f8806c2d0 con 0x7f5f880b0130 2023-08-10T10:30:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f8ddff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f8815ee50 con 0x7f5f880cf730 2023-08-10T10:30:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f877fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5f880afd50 0x7f5f8815e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34852/0 (socket says 172.21.15.88:34852) 2023-08-10T10:30:42.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.507+0000 7f5f877fe700 1 -- 172.21.15.88:0/2678228657 learned_addr learned my addr 172.21.15.88:0/2678228657 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:42.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f87fff700 1 --2- 172.21.15.88:0/2678228657 >> v2:172.21.15.187:3300/0 conn(0x7f5f880cf730 0x7f5f8806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560041018 0 0) 0x7f5f880b05c0 con 0x7f5f880afd50 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f700035b0 con 0x7f5f880afd50 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299183228 0 0) 0x7f5f8806c2d0 con 0x7f5f880b0130 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f880b05c0 con 0x7f5f880b0130 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2170794652 0 0) 0x7f5f700035b0 con 0x7f5f880afd50 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 >> v2:172.21.15.187:3300/0 conn(0x7f5f880cf730 msgr2=0x7f5f8806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 --2- 172.21.15.88:0/2678228657 >> v2:172.21.15.187:3300/0 conn(0x7f5f880cf730 0x7f5f8806d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 >> v1:172.21.15.187:6789/0 conn(0x7f5f880b0130 legacy=0x7f5f880cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8806c5b0 con 0x7f5f880afd50 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f5f78001670 con 0x7f5f880afd50 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 >> v1:172.21.15.88:6789/0 conn(0x7f5f880afd50 legacy=0x7f5f8815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f70003b90 0x7f5f70003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 0x7f5f70004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70005210 0x7f5f7000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f8815ee50 con 0x7f5f70004850 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7000c140 con 0x7f5f70003b90 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7000c300 con 0x7f5f70005210 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.508+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 0x7f5f70004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f877fe700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f70003b90 0x7f5f70003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f87fff700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70005210 0x7f5f7000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 -- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70005210 msgr2=0x7f5f7000ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70005210 0x7f5f7000ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 -- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f70003b90 msgr2=0x7f5f70003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f70003b90 0x7f5f70003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 -- 172.21.15.88:0/2678228657 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f700035b0 con 0x7f5f70004850 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f87fff700 1 -- 172.21.15.88:0/2678228657 reap_dead start 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 0x7f5f70004cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001940 tx=0x7f5f70005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c4b53f339eaa7f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c001430 con 0x7f5f70004850 2023-08-10T10:30:42.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c001d70 con 0x7f5f70004850 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.509+0000 7f5f867fc700 1 -- 172.21.15.88:0/2678228657 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c005510 con 0x7f5f70004850 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 -- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 msgr2=0x7f5f70004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 0x7f5f70004cd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c001940 tx=0x7f5f70005880 comp rx=0 tx=0).stop 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 -- 172.21.15.88:0/2678228657 shutdown_connections 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/2678228657 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f70004850 0x7f5f70004cd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 -- 172.21.15.88:0/2678228657 >> 172.21.15.88:0/2678228657 conn(0x7f5f8806f200 msgr2=0x7f5f8806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 -- 172.21.15.88:0/2678228657 shutdown_connections 2023-08-10T10:30:42.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.510+0000 7f5f8ddff700 1 -- 172.21.15.88:0/2678228657 wait complete. 2023-08-10T10:30:42.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.512+0000 7f5f8ddff700 1 Processor -- start 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.512+0000 7f5f8ddff700 1 -- start start 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70004850 0x7f5f880c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f881f6360 0x7f5f88157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f881f6810 con 0x7f5f880caaa0 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880c8420 con 0x7f5f881f6360 2023-08-10T10:30:42.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f8ddff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f880caf20 con 0x7f5f70004850 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44078/0 (socket says 172.21.15.88:44078) 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 -- 172.21.15.88:0/1324836741 learned_addr learned my addr 172.21.15.88:0/1324836741 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f877fe700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70004850 0x7f5f880c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f87fff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f881f6360 0x7f5f88157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 -- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70004850 msgr2=0x7f5f880c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70004850 0x7f5f880c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 -- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f881f6360 msgr2=0x7f5f88157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f881f6360 0x7f5f88157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 -- 172.21.15.88:0/1324836741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f880c8610 con 0x7f5f880caaa0 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.513+0000 7f5f86ffd700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c00 tx=0x7f5f7c0012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.514+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c006a70 con 0x7f5f880caaa0 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.514+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f7c006bf0 con 0x7f5f880caaa0 2023-08-10T10:30:42.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.514+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f880c88f0 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.514+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c007040 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.514+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f880c8eb0 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.515+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8804ecc0 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.516+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f7c0071a0 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.517+0000 7f5f6ffff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 0x7f5f7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.517+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f7c08a1a0 con 0x7f5f880caaa0 2023-08-10T10:30:42.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.517+0000 7f5f877fe700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 0x7f5f7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:42.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.517+0000 7f5f877fe700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 0x7f5f7406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f8804fe10 tx=0x7f5f78001e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:42.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.521+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f7c054ed0 con 0x7f5f880caaa0 2023-08-10T10:30:42.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.758+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5f8806bbe0 con 0x7f5f880caaa0 2023-08-10T10:30:42.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.758+0000 7f5f6ffff700 1 -- 172.21.15.88:0/1324836741 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5f7c0584f0 con 0x7f5f880caaa0 2023-08-10T10:30:42.759 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:30:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 msgr2=0x7f5f7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 0x7f5f7406d1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f5f8804fe10 tx=0x7f5f78001e00 comp rx=0 tx=0).stop 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 msgr2=0x7f5f881f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c000c00 tx=0x7f5f7c0012d0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 shutdown_connections 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f881f6360 0x7f5f88157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f7406ace0 0x7f5f7406d1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f70004850 0x7f5f880c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 --2- 172.21.15.88:0/1324836741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f880caaa0 0x7f5f881f5e20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 >> 172.21.15.88:0/1324836741 conn(0x7f5f8806f200 msgr2=0x7f5f880c7500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 shutdown_connections 2023-08-10T10:30:42.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:42.761+0000 7f5f8ddff700 1 -- 172.21.15.88:0/1324836741 wait complete. 2023-08-10T10:30:42.779 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-10T10:30:42.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:30:42.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-08-10T10:30:42.780 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-10T10:30:42.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:42.780 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-10T10:30:42.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:30:42.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:30:42.781 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-10T10:30:42.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:42.782 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-08-10T10:30:42.828 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:30:42.829 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 41885sec preferred_lft 41885sec 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-08-10T10:30:42.830 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:30:42.831 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:30:42.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:42.832 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:30:42.832 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:30:42.832 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:30:42.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-08-10T10:30:42.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-08-10T10:30:42.833 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:30:42.834 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:30:43.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:43.313 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:30:43.386 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-08-10T10:30:43.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:43.389 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-08-10T10:30:43.462 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-08-10T10:30:43.462 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:30:43.463 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:30:43.463 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:30:43.463 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:30:43.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:43.464 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:30:43.465 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:30:43.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:30:43.465 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:30:43.466 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:30:43.466 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:30:44.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:44.185 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:30:44.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:44.234 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-08-10T10:30:44.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:44.283 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:30:44.284 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:30:44.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-10T10:30:44.284 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-10T10:30:44.285 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:30:44.467 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-10T10:30:44.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:44.468 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:30:44.469 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:30:44.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-10T10:30:44.469 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:30:44.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-10T10:30:44.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-10T10:30:44.470 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-10T10:30:44.471 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:30:44.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:44.740 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:30:44.740 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:30:44.740 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-08-10T10:30:44.741 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:30:44.741 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:30:44.913 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-10T10:30:44.913 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:30:44.914 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:44.959 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-10T10:30:44.960 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:30:44.960 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:45.045 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-08-10T10:30:45.155 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:30:45.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:30:45.225 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:30:45.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:30:45.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:45.229 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-08-10T10:30:45.274 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-10T10:30:45.275 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-10T10:30:45.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo modprobe fuse 2023-08-10T10:30:45.389 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-10T10:30:45.389 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-10T10:30:45.458 INFO:teuthology.orchestra.run.smithi088.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-10T10:30:45.461 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-10T10:30:45.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:45.462 DEBUG:teuthology.orchestra.run.smithi088:> ls /sys/fs/fuse/connections 2023-08-10T10:30:45.488 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:2023-08-10T10:30:45.488+0000 7fbcdfa9f5c0 -1 init, newargv = 0x55f422d20380 newargc=15 2023-08-10T10:30:45.489 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[121529]: starting ceph client 2023-08-10T10:30:45.499 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[121529]: starting fuse 2023-08-10T10:30:45.512 INFO:teuthology.orchestra.run.smithi088.stdout:43 2023-08-10T10:30:45.512 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-08-10T10:30:45.513 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-08-10T10:30:45.513 DEBUG:teuthology.orchestra.run.smithi088:> import glob 2023-08-10T10:30:45.514 DEBUG:teuthology.orchestra.run.smithi088:> import re 2023-08-10T10:30:45.514 DEBUG:teuthology.orchestra.run.smithi088:> import os 2023-08-10T10:30:45.514 DEBUG:teuthology.orchestra.run.smithi088:> import subprocess 2023-08-10T10:30:45.514 DEBUG:teuthology.orchestra.run.smithi088:> 2023-08-10T10:30:45.515 DEBUG:teuthology.orchestra.run.smithi088:> def _find_admin_socket(client_name): 2023-08-10T10:30:45.515 DEBUG:teuthology.orchestra.run.smithi088:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-10T10:30:45.515 DEBUG:teuthology.orchestra.run.smithi088:> files = glob.glob(asok_path) 2023-08-10T10:30:45.516 DEBUG:teuthology.orchestra.run.smithi088:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-10T10:30:45.516 DEBUG:teuthology.orchestra.run.smithi088:> 2023-08-10T10:30:45.516 DEBUG:teuthology.orchestra.run.smithi088:> # Given a non-glob path, it better be there 2023-08-10T10:30:45.517 DEBUG:teuthology.orchestra.run.smithi088:> if "*" not in asok_path: 2023-08-10T10:30:45.517 DEBUG:teuthology.orchestra.run.smithi088:> assert(len(files) == 1) 2023-08-10T10:30:45.517 DEBUG:teuthology.orchestra.run.smithi088:> return files[0] 2023-08-10T10:30:45.517 DEBUG:teuthology.orchestra.run.smithi088:> 2023-08-10T10:30:45.518 DEBUG:teuthology.orchestra.run.smithi088:> for f in files: 2023-08-10T10:30:45.518 DEBUG:teuthology.orchestra.run.smithi088:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-10T10:30:45.518 DEBUG:teuthology.orchestra.run.smithi088:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-10T10:30:45.518 DEBUG:teuthology.orchestra.run.smithi088:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-10T10:30:45.519 DEBUG:teuthology.orchestra.run.smithi088:> contents = proc_f.read() 2023-08-10T10:30:45.519 DEBUG:teuthology.orchestra.run.smithi088:> if mountpoint in contents: 2023-08-10T10:30:45.519 DEBUG:teuthology.orchestra.run.smithi088:> return f 2023-08-10T10:30:45.520 DEBUG:teuthology.orchestra.run.smithi088:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-10T10:30:45.520 DEBUG:teuthology.orchestra.run.smithi088:> 2023-08-10T10:30:45.520 DEBUG:teuthology.orchestra.run.smithi088:> print(_find_admin_socket("client.admin")) 2023-08-10T10:30:45.520 DEBUG:teuthology.orchestra.run.smithi088:> ' 2023-08-10T10:30:45.695 INFO:teuthology.orchestra.run.smithi088.stdout:/var/run/ceph/ceph-client.admin.121529.asok 2023-08-10T10:30:45.873 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.121529.asok 2023-08-10T10:30:45.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:45.874 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.121529.asok status 2023-08-10T10:30:46.097 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:30:46.097 INFO:teuthology.orchestra.run.smithi088.stdout: "metadata": { 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_sha1": "a8bf445f2d27d8e12e060dff0fd151d481b5290b", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 18.0.0-5118-ga8bf445f (a8bf445f2d27d8e12e060dff0fd151d481b5290b) reef (dev)", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "entity_id": "admin", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "hostname": "smithi088", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "pid": "121529", 2023-08-10T10:30:46.098 INFO:teuthology.orchestra.run.smithi088.stdout: "root": "/" 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_count": 0, 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "dentry_pinned_count": 0, 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4458, 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "inst": { 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "name": { 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "client", 2023-08-10T10:30:46.099 INFO:teuthology.orchestra.run.smithi088.stdout: "num": 4458 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1813452938 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: } 2023-08-10T10:30:46.100 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": { 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "type": "v1", 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr": "192.168.0.1:0", 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "nonce": 1813452938 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "inst_str": "client.4458 192.168.0.1:0/1813452938", 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "addr_str": "192.168.0.1:0/1813452938", 2023-08-10T10:30:46.101 INFO:teuthology.orchestra.run.smithi088.stdout: "inode_count": 1, 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "mds_epoch": 7, 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch": 27, 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "osd_epoch_barrier": 0, 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "blocklisted": false, 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs" 2023-08-10T10:30:46.102 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:30:46.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:46.112 DEBUG:teuthology.orchestra.run.smithi088:> stat --file-system '--printf=%T 2023-08-10T10:30:46.112 DEBUG:teuthology.orchestra.run.smithi088:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:46.158 INFO:teuthology.orchestra.run.smithi088.stdout:fuseblk 2023-08-10T10:30:46.159 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:46.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:46.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:46.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:46.230 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-10T10:30:46.370 INFO:teuthology.orchestra.run.smithi088.stdout:# file: . 2023-08-10T10:30:46.370 INFO:teuthology.orchestra.run.smithi088.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-10T10:30:46.370 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:46.371 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:46.372 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:30:46.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.616+0000 7fbb92fff700 1 Processor -- start 2023-08-10T10:30:46.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.616+0000 7fbb92fff700 1 -- start start 2023-08-10T10:30:46.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb92fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb8c159d00 0x7fbb8c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb92fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbb8c0710a0 0x7fbb8c06a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb92fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8c06a170 con 0x7fbb8c0716d0 2023-08-10T10:30:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb92fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0cdeb0 con 0x7fbb8c0710a0 2023-08-10T10:30:46.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb92fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb8c0ce190 con 0x7fbb8c159d00 2023-08-10T10:30:46.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb8bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fbb8c0716d0 0x7fbb8c070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34862/0 (socket says 172.21.15.88:34862) 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb8bfff700 1 -- 172.21.15.88:0/1986880998 learned_addr learned my addr 172.21.15.88:0/1986880998 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.617+0000 7fbb9159c700 1 --2- 172.21.15.88:0/1986880998 >> v2:172.21.15.88:3300/0 conn(0x7fbb8c0710a0 0x7fbb8c06a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb90d9b700 1 --2- 172.21.15.88:0/1986880998 >> v2:172.21.15.187:3300/0 conn(0x7fbb8c159d00 0x7fbb8c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb8b7fe700 1 -- 172.21.15.88:0/1986880998 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396544293 0 0) 0x7fbb8c06a170 con 0x7fbb8c0716d0 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb8b7fe700 1 -- 172.21.15.88:0/1986880998 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb7c0035b0 con 0x7fbb8c0716d0 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb9159c700 1 -- 172.21.15.88:0/1986880998 >> v2:172.21.15.187:3300/0 conn(0x7fbb8c159d00 msgr2=0x7fbb8c15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:46.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb9159c700 1 --2- 172.21.15.88:0/1986880998 >> v2:172.21.15.187:3300/0 conn(0x7fbb8c159d00 0x7fbb8c15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb9159c700 1 -- 172.21.15.88:0/1986880998 >> v1:172.21.15.88:6789/0 conn(0x7fbb8c0716d0 legacy=0x7fbb8c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb9159c700 1 -- 172.21.15.88:0/1986880998 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb8c0ce470 con 0x7fbb8c0710a0 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb9159c700 1 --2- 172.21.15.88:0/1986880998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0710a0 0x7fbb8c06a600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c06e0a0 tx=0x7fbb8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52e63f1bc8dbf46 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.618+0000 7fbb8b7fe700 1 -- 172.21.15.88:0/1986880998 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8400e070 con 0x7fbb8c0710a0 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb8b7fe700 1 -- 172.21.15.88:0/1986880998 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8400bb20 con 0x7fbb8c0710a0 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb8b7fe700 1 -- 172.21.15.88:0/1986880998 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb84012430 con 0x7fbb8c0710a0 2023-08-10T10:30:46.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 -- 172.21.15.88:0/1986880998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0710a0 msgr2=0x7fbb8c06a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 --2- 172.21.15.88:0/1986880998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0710a0 0x7fbb8c06a600 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c06e0a0 tx=0x7fbb8400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 -- 172.21.15.88:0/1986880998 shutdown_connections 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 --2- 172.21.15.88:0/1986880998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0710a0 0x7fbb8c06a600 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 --2- 172.21.15.88:0/1986880998 >> v2:172.21.15.187:3300/0 conn(0x7fbb8c159d00 0x7fbb8c15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 -- 172.21.15.88:0/1986880998 >> 172.21.15.88:0/1986880998 conn(0x7fbb8c0ced50 msgr2=0x7fbb8c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 -- 172.21.15.88:0/1986880998 shutdown_connections 2023-08-10T10:30:46.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.619+0000 7fbb92fff700 1 -- 172.21.15.88:0/1986880998 wait complete. 2023-08-10T10:30:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.622+0000 7fbb92fff700 1 Processor -- start 2023-08-10T10:30:46.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.622+0000 7fbb92fff700 1 -- start start 2023-08-10T10:30:46.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 0x7fbb8c0aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 0x7fbb8c150240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0c8d10 con 0x7fbb8c0716d0 2023-08-10T10:30:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c150780 con 0x7fbb8c159d00 2023-08-10T10:30:46.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb92fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb8c0aba80 con 0x7fbb8c0710a0 2023-08-10T10:30:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb8bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb8bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44108/0 (socket says 172.21.15.88:44108) 2023-08-10T10:30:46.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.623+0000 7fbb8bfff700 1 -- 172.21.15.88:0/2364220483 learned_addr learned my addr 172.21.15.88:0/2364220483 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb9159c700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 0x7fbb8c150240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb90d9b700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 0x7fbb8c0aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 -- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 msgr2=0x7fbb8c0aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 0x7fbb8c0aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 -- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 msgr2=0x7fbb8c150240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 0x7fbb8c150240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 -- 172.21.15.88:0/2364220483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb84009a70 con 0x7fbb8c0716d0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb9159c700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 0x7fbb8c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb90d9b700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 0x7fbb8c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb8bfff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c700 tx=0x7fbb7800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78005d70 con 0x7fbb8c0716d0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb780070d0 con 0x7fbb8c0716d0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78007460 con 0x7fbb8c0716d0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb8c0abd60 con 0x7fbb8c0716d0 2023-08-10T10:30:46.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.624+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb8c0ac320 con 0x7fbb8c0716d0 2023-08-10T10:30:46.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.625+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8c0ac4b0 con 0x7fbb8c0716d0 2023-08-10T10:30:46.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.626+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fbb780075c0 con 0x7fbb8c0716d0 2023-08-10T10:30:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.627+0000 7fbb897fa700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 0x7fbb7006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.628+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fbb78088e20 con 0x7fbb8c0716d0 2023-08-10T10:30:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.628+0000 7fbb90d9b700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 0x7fbb7006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:46.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.628+0000 7fbb90d9b700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 0x7fbb7006d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009b60 tx=0x7fbb80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:46.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.632+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fbb78053b50 con 0x7fbb8c0716d0 2023-08-10T10:30:46.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.826+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb8c04ecc0 con 0x7fbb8c0716d0 2023-08-10T10:30:46.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.827+0000 7fbb897fa700 1 -- 172.21.15.88:0/2364220483 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7fbb78057170 con 0x7fbb8c0716d0 2023-08-10T10:30:46.828 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:46.828 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:46.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.829+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 msgr2=0x7fbb7006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.829+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 0x7fbb7006d1a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009b60 tx=0x7fbb80008040 comp rx=0 tx=0).stop 2023-08-10T10:30:46.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.829+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 msgr2=0x7fbb8c14fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:46.830 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.829+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c700 tx=0x7fbb7800cac0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 shutdown_connections 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb8c159d00 0x7fbb8c150240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fbb7006ace0 0x7fbb7006d1a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb8c0710a0 0x7fbb8c0aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 --2- 172.21.15.88:0/2364220483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbb8c0716d0 0x7fbb8c14fd00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 >> 172.21.15.88:0/2364220483 conn(0x7fbb8c0ced50 msgr2=0x7fbb8c0cd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:46.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 shutdown_connections 2023-08-10T10:30:46.832 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:46.830+0000 7fbb92fff700 1 -- 172.21.15.88:0/2364220483 wait complete. 2023-08-10T10:30:46.848 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:30:46.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:30:47.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.047+0000 7f38529ff700 1 Processor -- start 2023-08-10T10:30:47.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.047+0000 7f38529ff700 1 -- start start 2023-08-10T10:30:47.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f38529ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f384c0ccf90 0x7f384c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f38529ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c06ad80 con 0x7f384c0cb0e0 2023-08-10T10:30:47.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f38529ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c06b060 con 0x7f384c0cd370 2023-08-10T10:30:47.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f38529ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c15b600 con 0x7f384c0ccf90 2023-08-10T10:30:47.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f384bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f384c0ccf90 0x7f384c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.048+0000 7f3850f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f384c0cb0e0 0x7f384c06d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34878/0 (socket says 172.21.15.88:34878) 2023-08-10T10:30:47.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f3850f9c700 1 -- 172.21.15.88:0/1255454995 learned_addr learned my addr 172.21.15.88:0/1255454995 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:47.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384bfff700 1 -- 172.21.15.88:0/1255454995 >> v1:172.21.15.187:6789/0 conn(0x7f384c0cd370 legacy=0x7f384c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:47.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384bfff700 1 -- 172.21.15.88:0/1255454995 >> v1:172.21.15.88:6789/0 conn(0x7f384c0cb0e0 legacy=0x7f384c06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384bfff700 1 -- 172.21.15.88:0/1255454995 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c06b340 con 0x7f384c0ccf90 2023-08-10T10:30:47.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384bfff700 1 --2- 172.21.15.88:0/1255454995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c06a170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f383c009840 tx=0x7f383c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acbe0a772e700d5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384affd700 1 -- 172.21.15.88:0/1255454995 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c004230 con 0x7f384c0ccf90 2023-08-10T10:30:47.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384affd700 1 -- 172.21.15.88:0/1255454995 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f383c004390 con 0x7f384c0ccf90 2023-08-10T10:30:47.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.049+0000 7f384affd700 1 -- 172.21.15.88:0/1255454995 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f383c0036a0 con 0x7f384c0ccf90 2023-08-10T10:30:47.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 -- 172.21.15.88:0/1255454995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 msgr2=0x7f384c06a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 --2- 172.21.15.88:0/1255454995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c06a170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f383c009840 tx=0x7f383c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:47.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 -- 172.21.15.88:0/1255454995 shutdown_connections 2023-08-10T10:30:47.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 --2- 172.21.15.88:0/1255454995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c06a170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 -- 172.21.15.88:0/1255454995 >> 172.21.15.88:0/1255454995 conn(0x7f384c0cb570 msgr2=0x7f384c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:47.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 -- 172.21.15.88:0/1255454995 shutdown_connections 2023-08-10T10:30:47.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.050+0000 7f38529ff700 1 -- 172.21.15.88:0/1255454995 wait complete. 2023-08-10T10:30:47.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.052+0000 7f38529ff700 1 Processor -- start 2023-08-10T10:30:47.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.052+0000 7f38529ff700 1 -- start start 2023-08-10T10:30:47.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 0x7f384c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f384c0cd370 0x7f384c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c156aa0 con 0x7f384c0ccf90 2023-08-10T10:30:47.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1536e0 con 0x7f384c0cd370 2023-08-10T10:30:47.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f38529ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c1539c0 con 0x7f384c0cb0e0 2023-08-10T10:30:47.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44128/0 (socket says 172.21.15.88:44128) 2023-08-10T10:30:47.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 -- 172.21.15.88:0/4213939808 learned_addr learned my addr 172.21.15.88:0/4213939808 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:47.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384bfff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 0x7f384c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f3850f9c700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f384c0cd370 0x7f384c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 -- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 msgr2=0x7f384c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 0x7f384c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 -- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f384c0cd370 msgr2=0x7f384c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f384c0cd370 0x7f384c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384b7fe700 1 -- 172.21.15.88:0/4213939808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0094a0 con 0x7f384c0ccf90 2023-08-10T10:30:47.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.053+0000 7f384bfff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 0x7f384c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:47.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f384b7fe700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f384000b450 tx=0x7f384000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011830 con 0x7f384c0ccf90 2023-08-10T10:30:47.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3840011990 con 0x7f384c0ccf90 2023-08-10T10:30:47.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c153ca0 con 0x7f384c0ccf90 2023-08-10T10:30:47.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3840011d40 con 0x7f384c0ccf90 2023-08-10T10:30:47.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.054+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c1531d0 con 0x7f384c0ccf90 2023-08-10T10:30:47.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.055+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c153ee0 con 0x7f384c0ccf90 2023-08-10T10:30:47.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.056+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f384001a400 con 0x7f384c0ccf90 2023-08-10T10:30:47.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.057+0000 7f3848ff9700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 0x7f383806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.058+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f38400893f0 con 0x7f384c0ccf90 2023-08-10T10:30:47.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.058+0000 7f384bfff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 0x7f383806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.058+0000 7f384bfff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 0x7f383806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c51d0 tx=0x7f383c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.062+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f384c153ee0 con 0x7f384c0ccf90 2023-08-10T10:30:47.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.257+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f384c153ee0 con 0x7f384c0ccf90 2023-08-10T10:30:47.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.257+0000 7f3848ff9700 1 -- 172.21.15.88:0/4213939808 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f384c153ee0 con 0x7f384c0ccf90 2023-08-10T10:30:47.258 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:30:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 msgr2=0x7f383806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 0x7f383806d1a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f384c0c51d0 tx=0x7f383c01c040 comp rx=0 tx=0).stop 2023-08-10T10:30:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 msgr2=0x7f384c152c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f384000b450 tx=0x7f384000b810 comp rx=0 tx=0).stop 2023-08-10T10:30:47.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 shutdown_connections 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f384c0cd370 0x7f384c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f383806ace0 0x7f383806d1a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f384c0cb0e0 0x7f384c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 --2- 172.21.15.88:0/4213939808 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f384c0ccf90 0x7f384c152c90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.259+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 >> 172.21.15.88:0/4213939808 conn(0x7f384c0cb570 msgr2=0x7f384c06d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.260+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 shutdown_connections 2023-08-10T10:30:47.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.260+0000 7f38529ff700 1 -- 172.21.15.88:0/4213939808 wait complete. 2023-08-10T10:30:47.278 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:30:47.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.477+0000 7f6c81dff700 1 Processor -- start 2023-08-10T10:30:47.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.477+0000 7f6c81dff700 1 -- start start 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c81dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 0x7f6c7c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c81dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c7c0b5060 0x7f6c7c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c81dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7c0d1840 con 0x7f6c7c0d1060 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c81dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c15d5c0 con 0x7f6c7c0b5060 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c81dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7c0d1b20 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.478+0000 7f6c7bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c7c0b5060 0x7f6c7c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6c7c0b5060 0x7f6c7c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44134/0 (socket says 172.21.15.88:44134) 2023-08-10T10:30:47.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 -- 172.21.15.88:0/4207755329 learned_addr learned my addr 172.21.15.88:0/4207755329 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:47.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7b7fe700 1 --2- 172.21.15.88:0/4207755329 >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 0x7f6c7c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 -- 172.21.15.88:0/4207755329 >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 msgr2=0x7f6c7c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:47.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 --2- 172.21.15.88:0/4207755329 >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 0x7f6c7c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 -- 172.21.15.88:0/4207755329 >> v1:172.21.15.187:6789/0 conn(0x7f6c7c0d1060 legacy=0x7f6c7c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 -- 172.21.15.88:0/4207755329 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7c0d1e00 con 0x7f6c7c0b5060 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7b7fe700 1 --2- 172.21.15.88:0/4207755329 >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 0x7f6c7c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7bfff700 1 --2- 172.21.15.88:0/4207755329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c0b5060 0x7f6c7c0b1940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0b5ac0 tx=0x7f6c7400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=780fca37c90cdf96 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7a7fc700 1 -- 172.21.15.88:0/4207755329 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7400e070 con 0x7f6c7c0b5060 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7a7fc700 1 -- 172.21.15.88:0/4207755329 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74003a20 con 0x7f6c7c0b5060 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.479+0000 7f6c7a7fc700 1 -- 172.21.15.88:0/4207755329 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74003dd0 con 0x7f6c7c0b5060 2023-08-10T10:30:47.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 -- 172.21.15.88:0/4207755329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c0b5060 msgr2=0x7f6c7c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 --2- 172.21.15.88:0/4207755329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c0b5060 0x7f6c7c0b1940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c0b5ac0 tx=0x7f6c7400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 -- 172.21.15.88:0/4207755329 shutdown_connections 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 --2- 172.21.15.88:0/4207755329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c0b5060 0x7f6c7c0b1940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 --2- 172.21.15.88:0/4207755329 >> v2:172.21.15.187:3300/0 conn(0x7f6c7c15d1e0 0x7f6c7c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 -- 172.21.15.88:0/4207755329 >> 172.21.15.88:0/4207755329 conn(0x7f6c7c0cf950 msgr2=0x7f6c7c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 -- 172.21.15.88:0/4207755329 shutdown_connections 2023-08-10T10:30:47.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.480+0000 7f6c81dff700 1 -- 172.21.15.88:0/4207755329 wait complete. 2023-08-10T10:30:47.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.482+0000 7f6c81dff700 1 Processor -- start 2023-08-10T10:30:47.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.483+0000 7f6c81dff700 1 -- start start 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c7c0b5060 0x7f6c7c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c7c0d1060 0x7f6c7c0ab150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c78c0 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c7ba0 con 0x7f6c7c0d1060 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c81dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7c0c7e80 con 0x7f6c7c0b5060 2023-08-10T10:30:47.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c7bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c7bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44144/0 (socket says 172.21.15.88:44144) 2023-08-10T10:30:47.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.484+0000 7f6c7bfff700 1 -- 172.21.15.88:0/1664846353 learned_addr learned my addr 172.21.15.88:0/1664846353 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 -- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c7c0b5060 msgr2=0x7f6c7c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c7c0b5060 0x7f6c7c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 -- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c7c0d1060 msgr2=0x7f6c7c0ab150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c7c0d1060 0x7f6c7c0ab150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 -- 172.21.15.88:0/1664846353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74009b30 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c7bfff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b370 tx=0x7f6c74004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74004500 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c74004680 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7c0c8160 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c74012430 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.485+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7c151890 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.486+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7c0d14f0 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.487+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6c74019030 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.488+0000 7f6c63fff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 0x7f6c6806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.488+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6c7408ab60 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.488+0000 7f6c7b7fe700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 0x7f6c6806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.489+0000 7f6c7b7fe700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 0x7f6c6806d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c15b640 tx=0x7f6c6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.492+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6c7c0d14f0 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.689+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6c7c0d14f0 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.690+0000 7f6c63fff700 1 -- 172.21.15.88:0/1664846353 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6c7c0d14f0 con 0x7f6c7c15d1e0 2023-08-10T10:30:47.691 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 msgr2=0x7f6c6806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 0x7f6c6806d1a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c15b640 tx=0x7f6c6c008040 comp rx=0 tx=0).stop 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 msgr2=0x7f6c7c0ab690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c7400b370 tx=0x7f6c74004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 shutdown_connections 2023-08-10T10:30:47.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6c7c15d1e0 0x7f6c7c0ab690 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6c6806ace0 0x7f6c6806d1a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c7c0b5060 0x7f6c7c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 --2- 172.21.15.88:0/1664846353 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c7c0d1060 0x7f6c7c0ab150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 >> 172.21.15.88:0/1664846353 conn(0x7f6c7c0cf950 msgr2=0x7f6c7c15e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 shutdown_connections 2023-08-10T10:30:47.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.692+0000 7f6c81dff700 1 -- 172.21.15.88:0/1664846353 wait complete. 2023-08-10T10:30:47.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:30:47.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.909+0000 7fa671dff700 1 Processor -- start 2023-08-10T10:30:47.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.909+0000 7fa671dff700 1 -- start start 2023-08-10T10:30:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa671dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa66c0cb0e0 0x7fa66c165b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa671dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06ad80 con 0x7fa66c0ccf90 2023-08-10T10:30:47.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa671dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66c06b060 con 0x7fa66c06a880 2023-08-10T10:30:47.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa671dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66c15b600 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa66b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa66c0ccf90 0x7fa66c06a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34880/0 (socket says 172.21.15.88:34880) 2023-08-10T10:30:47.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa66b7fe700 1 -- 172.21.15.88:0/3644439600 learned_addr learned my addr 172.21.15.88:0/3644439600 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:47.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa66bfff700 1 --2- 172.21.15.88:0/3644439600 >> v2:172.21.15.187:3300/0 conn(0x7fa66c0cb0e0 0x7fa66c165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa66affd700 1 -- 172.21.15.88:0/3644439600 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 712054014 0 0) 0x7fa66c06ad80 con 0x7fa66c0ccf90 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.911+0000 7fa66affd700 1 -- 172.21.15.88:0/3644439600 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa6580035b0 con 0x7fa66c0ccf90 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66bfff700 1 -- 172.21.15.88:0/3644439600 >> v1:172.21.15.187:6789/0 conn(0x7fa66c06a880 legacy=0x7fa66c0ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66bfff700 1 -- 172.21.15.88:0/3644439600 >> v1:172.21.15.88:6789/0 conn(0x7fa66c0ccf90 legacy=0x7fa66c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66bfff700 1 -- 172.21.15.88:0/3644439600 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66c06b340 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66bfff700 1 --2- 172.21.15.88:0/3644439600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c165b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d90 tx=0x7fa66400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=530d31a542396621 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66affd700 1 -- 172.21.15.88:0/3644439600 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400e070 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66affd700 1 -- 172.21.15.88:0/3644439600 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa66400bb20 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.912+0000 7fa66affd700 1 -- 172.21.15.88:0/3644439600 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa66400be90 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 -- 172.21.15.88:0/3644439600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 msgr2=0x7fa66c165b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 --2- 172.21.15.88:0/3644439600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c165b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d90 tx=0x7fa66400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 -- 172.21.15.88:0/3644439600 shutdown_connections 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 --2- 172.21.15.88:0/3644439600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c165b60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 -- 172.21.15.88:0/3644439600 >> 172.21.15.88:0/3644439600 conn(0x7fa66c0cb570 msgr2=0x7fa66c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 -- 172.21.15.88:0/3644439600 shutdown_connections 2023-08-10T10:30:47.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.913+0000 7fa671dff700 1 -- 172.21.15.88:0/3644439600 wait complete. 2023-08-10T10:30:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.914+0000 7fa671dff700 1 Processor -- start 2023-08-10T10:30:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.915+0000 7fa671dff700 1 -- start start 2023-08-10T10:30:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66c06a880 0x7fa66c154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0c3e20 con 0x7fa66c0ccf90 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0c4100 con 0x7fa66c0cb0e0 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa671dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66c0c43e0 con 0x7fa66c06a880 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44156/0 (socket says 172.21.15.88:44156) 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 -- 172.21.15.88:0/1861179997 learned_addr learned my addr 172.21.15.88:0/1861179997 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:47.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66b7fe700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66c06a880 0x7fa66c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa663fff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 -- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66c06a880 msgr2=0x7fa66c154980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66c06a880 0x7fa66c154980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 -- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 msgr2=0x7fa66c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.916+0000 7fa66bfff700 1 -- 172.21.15.88:0/1861179997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009a70 con 0x7fa66c0ccf90 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa66bfff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b370 tx=0x7fa664004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa664004800 con 0x7fa66c0ccf90 2023-08-10T10:30:47.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa664020070 con 0x7fa66c0ccf90 2023-08-10T10:30:47.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66c0c46c0 con 0x7fa66c0ccf90 2023-08-10T10:30:47.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640276c0 con 0x7fa66c0ccf90 2023-08-10T10:30:47.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.917+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66c0c3990 con 0x7fa66c0ccf90 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.918+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66c0c4be0 con 0x7fa66c0ccf90 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.919+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa664012430 con 0x7fa66c0ccf90 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.920+0000 7fa668ff9700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 0x7fa64c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.920+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa664022070 con 0x7fa66c0ccf90 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.920+0000 7fa66b7fe700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 0x7fa64c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:47.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.921+0000 7fa66b7fe700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 0x7fa64c06d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007fd0 tx=0x7fa65c007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:47.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:47.924+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa66c0c4be0 con 0x7fa66c0ccf90 2023-08-10T10:30:48.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.118+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa66c0c4be0 con 0x7fa66c0ccf90 2023-08-10T10:30:48.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.118+0000 7fa668ff9700 1 -- 172.21.15.88:0/1861179997 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa66c0c4be0 con 0x7fa66c0ccf90 2023-08-10T10:30:48.119 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:30:48.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 msgr2=0x7fa64c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 0x7fa64c06d1a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa65c007fd0 tx=0x7fa65c007dc0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 msgr2=0x7fa66c1e1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa66400b370 tx=0x7fa664004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 shutdown_connections 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa66c0ccf90 0x7fa66c1e1c30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa64c06ace0 0x7fa64c06d1a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66c06a880 0x7fa66c154980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 --2- 172.21.15.88:0/1861179997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa66c0cb0e0 0x7fa66c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 >> 172.21.15.88:0/1861179997 conn(0x7fa66c0cb570 msgr2=0x7fa66c158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 shutdown_connections 2023-08-10T10:30:48.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.121+0000 7fa671dff700 1 -- 172.21.15.88:0/1861179997 wait complete. 2023-08-10T10:30:48.139 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:30:48.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.336+0000 7f7f215ff700 1 Processor -- start 2023-08-10T10:30:48.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.337+0000 7f7f215ff700 1 -- start start 2023-08-10T10:30:48.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f215ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c0c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f215ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 0x7f7f1c0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f215ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c0c43a0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f215ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c0c4960 con 0x7f7f1c0cc6c0 2023-08-10T10:30:48.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f215ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c06e8c0 con 0x7f7f1c143810 2023-08-10T10:30:48.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f1b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f1c0ce3c0 0x7f7f1c0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34894/0 (socket says 172.21.15.88:34894) 2023-08-10T10:30:48.339 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f1b7fe700 1 -- 172.21.15.88:0/2429770103 learned_addr learned my addr 172.21.15.88:0/2429770103 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2429770103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c0c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.338+0000 7f7f1a7fc700 1 --2- 172.21.15.88:0/2429770103 >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 0x7f7f1c0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f19ffb700 1 -- 172.21.15.88:0/2429770103 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579049093 0 0) 0x7f7f1c0c43a0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f19ffb700 1 -- 172.21.15.88:0/2429770103 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f040057c0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1affd700 1 -- 172.21.15.88:0/2429770103 >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 msgr2=0x7f7f1c0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2429770103 >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 0x7f7f1c0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1affd700 1 -- 172.21.15.88:0/2429770103 >> v1:172.21.15.88:6789/0 conn(0x7f7f1c0ce3c0 legacy=0x7f7f1c0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1affd700 1 -- 172.21.15.88:0/2429770103 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c06eba0 con 0x7f7f1c143810 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1a7fc700 1 --2- 172.21.15.88:0/2429770103 >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 0x7f7f1c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2429770103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c0c4df0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009840 tx=0x7f7f0c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31762a5043d022ce server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f19ffb700 1 -- 172.21.15.88:0/2429770103 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011830 con 0x7f7f1c143810 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.339+0000 7f7f19ffb700 1 -- 172.21.15.88:0/2429770103 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c011990 con 0x7f7f1c143810 2023-08-10T10:30:48.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f19ffb700 1 -- 172.21.15.88:0/2429770103 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c011d20 con 0x7f7f1c143810 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 -- 172.21.15.88:0/2429770103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 msgr2=0x7f7f1c0c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2429770103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c0c4df0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c009840 tx=0x7f7f0c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 -- 172.21.15.88:0/2429770103 shutdown_connections 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2429770103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c0c4df0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2429770103 >> v2:172.21.15.187:3300/0 conn(0x7f7f1c0cc6c0 0x7f7f1c0cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 -- 172.21.15.88:0/2429770103 >> 172.21.15.88:0/2429770103 conn(0x7f7f1c0cb570 msgr2=0x7f7f1c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:48.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 -- 172.21.15.88:0/2429770103 shutdown_connections 2023-08-10T10:30:48.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.340+0000 7f7f215ff700 1 -- 172.21.15.88:0/2429770103 wait complete. 2023-08-10T10:30:48.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.342+0000 7f7f215ff700 1 Processor -- start 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.342+0000 7f7f215ff700 1 -- start start 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f1c0cc6c0 0x7f7f1c0c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0b4870 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0c7b60 con 0x7f7f1c0cc6c0 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f215ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c15ac50 con 0x7f7f1c143810 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f1a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f1a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44168/0 (socket says 172.21.15.88:44168) 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f1a7fc700 1 -- 172.21.15.88:0/2728073265 learned_addr learned my addr 172.21.15.88:0/2728073265 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f1c0cc6c0 0x7f7f1c0c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.343+0000 7f7f1b7fe700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 -- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 msgr2=0x7f7f1c1f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c1f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 -- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f1c0cc6c0 msgr2=0x7f7f1c0c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f1c0cc6c0 0x7f7f1c0c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 -- 172.21.15.88:0/2728073265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f100094a0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f1a7fc700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e9b0 tx=0x7f7f1000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f10009700 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1000c850 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f0c0094a0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1000cc00 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.344+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c15a3b0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.345+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c0743a0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.346+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f10013470 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.348+0000 7f7f037fe700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 0x7f7f0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.348+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f100894f0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.348+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 0x7f7f0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.348+0000 7f7f1affd700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 0x7f7f0806d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.352+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f10057d30 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.550+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f1c15a690 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.551+0000 7f7f037fe700 1 -- 172.21.15.88:0/2728073265 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f100578c0 con 0x7f7f1c0ce3c0 2023-08-10T10:30:48.551 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:30:48.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 msgr2=0x7f7f0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 0x7f7f0806d1a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c000c00 tx=0x7f7f0c008030 comp rx=0 tx=0).stop 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 msgr2=0x7f7f1c159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000e9b0 tx=0x7f7f1000ecc0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 shutdown_connections 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0806ace0 0x7f7f0806d1a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f1c143810 0x7f7f1c1f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f1c0cc6c0 0x7f7f1c0c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 --2- 172.21.15.88:0/2728073265 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f1c0ce3c0 0x7f7f1c159270 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 >> 172.21.15.88:0/2728073265 conn(0x7f7f1c0cb570 msgr2=0x7f7f1c071170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 shutdown_connections 2023-08-10T10:30:48.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.553+0000 7f7f215ff700 1 -- 172.21.15.88:0/2728073265 wait complete. 2023-08-10T10:30:48.571 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:30:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.770+0000 7f3880fff700 1 Processor -- start 2023-08-10T10:30:48.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.770+0000 7f3880fff700 1 -- start start 2023-08-10T10:30:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.771+0000 7f3880fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c15d1e0 0x7f387c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.771+0000 7f3880fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f387c0d1060 0x7f387c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3880fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 0x7f387c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3880fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c15d5c0 con 0x7f387c0d1060 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3880fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f387c0b5300 con 0x7f387c0b4e90 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3880fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c0d1840 con 0x7f387c15d1e0 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f387c0d1060 0x7f387c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f387c0d1060 0x7f387c0b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44180/0 (socket says 172.21.15.88:44180) 2023-08-10T10:30:48.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 -- 172.21.15.88:0/2160042538 learned_addr learned my addr 172.21.15.88:0/2160042538 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:48.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f387a59c700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c15d1e0 0x7f387c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f387ad9d700 1 --2- 172.21.15.88:0/2160042538 >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 0x7f387c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 -- 172.21.15.88:0/2160042538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c15d1e0 msgr2=0x7f387c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c15d1e0 0x7f387c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 -- 172.21.15.88:0/2160042538 >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 msgr2=0x7f387c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 --2- 172.21.15.88:0/2160042538 >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 0x7f387c0b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f3873fff700 1 -- 172.21.15.88:0/2160042538 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f387c0d1b20 con 0x7f387c0d1060 2023-08-10T10:30:48.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.772+0000 7f387ad9d700 1 --2- 172.21.15.88:0/2160042538 >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 0x7f387c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3873fff700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c0d1060 0x7f387c0b4950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b5a70 tx=0x7f3864009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15242b019eabe13 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3879d9b700 1 -- 172.21.15.88:0/2160042538 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400b860 con 0x7f387c0d1060 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3879d9b700 1 -- 172.21.15.88:0/2160042538 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f386400b9c0 con 0x7f387c0d1060 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3879d9b700 1 -- 172.21.15.88:0/2160042538 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386400bd50 con 0x7f387c0d1060 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3880fff700 1 -- 172.21.15.88:0/2160042538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c0d1060 msgr2=0x7f387c0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.773+0000 7f3880fff700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c0d1060 0x7f387c0b4950 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f387c0b5a70 tx=0x7f3864009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 -- 172.21.15.88:0/2160042538 shutdown_connections 2023-08-10T10:30:48.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 --2- 172.21.15.88:0/2160042538 >> v2:172.21.15.187:3300/0 conn(0x7f387c0b4e90 0x7f387c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c15d1e0 0x7f387c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 --2- 172.21.15.88:0/2160042538 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c0d1060 0x7f387c0b4950 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 -- 172.21.15.88:0/2160042538 >> 172.21.15.88:0/2160042538 conn(0x7f387c0cf950 msgr2=0x7f387c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 -- 172.21.15.88:0/2160042538 shutdown_connections 2023-08-10T10:30:48.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.774+0000 7f3880fff700 1 -- 172.21.15.88:0/2160042538 wait complete. 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.775+0000 7f3880fff700 1 Processor -- start 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.775+0000 7f3880fff700 1 -- start start 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c0b4e90 0x7f387c1f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 0x7f387c154fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c155500 con 0x7f387c15d1e0 2023-08-10T10:30:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f387c155710 con 0x7f387c0d1060 2023-08-10T10:30:48.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.776+0000 7f3880fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f387c1559f0 con 0x7f387c0b4e90 2023-08-10T10:30:48.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44188/0 (socket says 172.21.15.88:44188) 2023-08-10T10:30:48.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 -- 172.21.15.88:0/696673949 learned_addr learned my addr 172.21.15.88:0/696673949 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387a59c700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c0b4e90 0x7f387c1f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3873fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 0x7f387c154fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 -- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c0b4e90 msgr2=0x7f387c1f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c0b4e90 0x7f387c1f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 -- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 msgr2=0x7f387c154fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 0x7f387c154fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 -- 172.21.15.88:0/696673949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3864009550 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3873fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 0x7f387c154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f387ad9d700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f387400cd50 tx=0x7f387400a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400f480 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f387400f600 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f387c155cd0 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.777+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387400f9b0 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.778+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f387c0c7a50 con 0x7f387c15d1e0 2023-08-10T10:30:48.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.779+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f387c0c7c70 con 0x7f387c15d1e0 2023-08-10T10:30:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.780+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f387400b040 con 0x7f387c15d1e0 2023-08-10T10:30:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.781+0000 7f3872ffd700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 0x7f385c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.781+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f387408a000 con 0x7f387c15d1e0 2023-08-10T10:30:48.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.781+0000 7f387a59c700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 0x7f385c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:48.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.782+0000 7f387a59c700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 0x7f385c06d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098b0 tx=0x7f386c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:48.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.785+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3874054dc0 con 0x7f387c15d1e0 2023-08-10T10:30:48.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.979+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f387c0b6170 con 0x7f387c15d1e0 2023-08-10T10:30:48.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.980+0000 7f3872ffd700 1 -- 172.21.15.88:0/696673949 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f387401d020 con 0x7f387c15d1e0 2023-08-10T10:30:48.980 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:30:48.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 msgr2=0x7f385c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 0x7f385c06d1a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f386c0098b0 tx=0x7f386c008040 comp rx=0 tx=0).stop 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 msgr2=0x7f387c0cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f387400cd50 tx=0x7f387400a560 comp rx=0 tx=0).stop 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 shutdown_connections 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f387c15d1e0 0x7f387c0cc0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f385c06ace0 0x7f385c06d1a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f387c0b4e90 0x7f387c1f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 --2- 172.21.15.88:0/696673949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f387c0d1060 0x7f387c154fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 >> 172.21.15.88:0/696673949 conn(0x7f387c0cf950 msgr2=0x7f387c0cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 shutdown_connections 2023-08-10T10:30:48.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:48.982+0000 7f3880fff700 1 -- 172.21.15.88:0/696673949 wait complete. 2023-08-10T10:30:49.000 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:30:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.197+0000 7febe03ff700 1 Processor -- start 2023-08-10T10:30:49.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.198+0000 7febe03ff700 1 -- start start 2023-08-10T10:30:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febe03ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febd815cf20 0x7febd815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febe03ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b8870 0x7febd80b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febe03ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80b5480 con 0x7febd80b5040 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febe03ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80cde30 con 0x7febd815cf20 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febe03ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd815e590 con 0x7febd80b8870 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febd815cf20 0x7febd815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde99c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7febd80b5040 0x7febd806a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34896/0 (socket says 172.21.15.88:34896) 2023-08-10T10:30:49.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7febd815cf20 0x7febd815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44198/0 (socket says 172.21.15.88:44198) 2023-08-10T10:30:49.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde99c700 1 -- 172.21.15.88:0/83786435 learned_addr learned my addr 172.21.15.88:0/83786435 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febdd99a700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b8870 0x7febd80b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 -- 172.21.15.88:0/83786435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b8870 msgr2=0x7febd80b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b8870 0x7febd80b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 -- 172.21.15.88:0/83786435 >> v1:172.21.15.88:6789/0 conn(0x7febd80b5040 legacy=0x7febd806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.199+0000 7febde19b700 1 -- 172.21.15.88:0/83786435 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80b8e30 con 0x7febd815cf20 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febde19b700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd815cf20 0x7febd815e050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febd4009840 tx=0x7febd4009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50e327e7a2f890 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febdd199700 1 -- 172.21.15.88:0/83786435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011830 con 0x7febd815cf20 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febdd199700 1 -- 172.21.15.88:0/83786435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4011990 con 0x7febd815cf20 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febdd199700 1 -- 172.21.15.88:0/83786435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011d20 con 0x7febd815cf20 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febe03ff700 1 -- 172.21.15.88:0/83786435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd815cf20 msgr2=0x7febd815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.200+0000 7febe03ff700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd815cf20 0x7febd815e050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7febd4009840 tx=0x7febd4009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 -- 172.21.15.88:0/83786435 shutdown_connections 2023-08-10T10:30:49.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd815cf20 0x7febd815e050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 --2- 172.21.15.88:0/83786435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b8870 0x7febd80b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 -- 172.21.15.88:0/83786435 >> 172.21.15.88:0/83786435 conn(0x7febd80d3080 msgr2=0x7febd80d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 -- 172.21.15.88:0/83786435 shutdown_connections 2023-08-10T10:30:49.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.201+0000 7febe03ff700 1 -- 172.21.15.88:0/83786435 wait complete. 2023-08-10T10:30:49.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.202+0000 7febe03ff700 1 Processor -- start 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.203+0000 7febe03ff700 1 -- start start 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.203+0000 7febe03ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b5040 0x7febd80c6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.203+0000 7febe03ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febe03ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd815cf20 0x7febd80c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febe03ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c80b0 con 0x7febd80b8870 2023-08-10T10:30:49.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febe03ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c7430 con 0x7febd815cf20 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febe03ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c7710 con 0x7febd80b5040 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44210/0 (socket says 172.21.15.88:44210) 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 -- 172.21.15.88:0/3096735439 learned_addr learned my addr 172.21.15.88:0/3096735439 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febde19b700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b5040 0x7febd80c6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febde99c700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd815cf20 0x7febd80c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 -- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b5040 msgr2=0x7febd80c6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b5040 0x7febd80c6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 -- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd815cf20 msgr2=0x7febd80c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd815cf20 0x7febd80c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 -- 172.21.15.88:0/3096735439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd40094a0 con 0x7febd80b8870 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.204+0000 7febdd99a700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7febc800e810 tx=0x7febc800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.205+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc800c070 con 0x7febd80b8870 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.205+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febc8013610 con 0x7febd80b8870 2023-08-10T10:30:49.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.205+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febc80139c0 con 0x7febd80b8870 2023-08-10T10:30:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.205+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd80c79f0 con 0x7febd80b8870 2023-08-10T10:30:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.205+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd80c84d0 con 0x7febd80b8870 2023-08-10T10:30:49.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.206+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80c81f0 con 0x7febd80b8870 2023-08-10T10:30:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.207+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febc8013b20 con 0x7febd80b8870 2023-08-10T10:30:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.208+0000 7febceffd700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 0x7febbc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.208+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7febc8089580 con 0x7febd80b8870 2023-08-10T10:30:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.208+0000 7febde19b700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 0x7febbc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.209+0000 7febde19b700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 0x7febbc06d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febd40090b0 tx=0x7febd401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.212+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febd80c81f0 con 0x7febd80b8870 2023-08-10T10:30:49.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.425+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7febd80c81f0 con 0x7febd80b8870 2023-08-10T10:30:49.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.425+0000 7febceffd700 1 -- 172.21.15.88:0/3096735439 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7febd80c81f0 con 0x7febd80b8870 2023-08-10T10:30:49.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 msgr2=0x7febbc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 0x7febbc06d1a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febd40090b0 tx=0x7febd401c040 comp rx=0 tx=0).stop 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 msgr2=0x7febd80cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7febc800e810 tx=0x7febc800eb20 comp rx=0 tx=0).stop 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 shutdown_connections 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd815cf20 0x7febd80c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febbc06ace0 0x7febbc06d1a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febd80b5040 0x7febd80c6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 --2- 172.21.15.88:0/3096735439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febd80b8870 0x7febd80cc290 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 >> 172.21.15.88:0/3096735439 conn(0x7febd80d3080 msgr2=0x7febd80d2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:49.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 shutdown_connections 2023-08-10T10:30:49.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.428+0000 7febe03ff700 1 -- 172.21.15.88:0/3096735439 wait complete. 2023-08-10T10:30:49.430 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:30:49.446 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:30:49.447 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:30:49.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:49.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.727+0000 7f9a1c3ff700 1 Processor -- start 2023-08-10T10:30:49.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.727+0000 7f9a1c3ff700 1 -- start start 2023-08-10T10:30:49.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1c3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a14159790 0x7f9a140c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1c3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 0x7f9a140ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1c3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140cb410 con 0x7f9a141593b0 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1c3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a1406af70 con 0x7f9a14159790 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1c3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140cab70 con 0x7f9a14071930 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1999a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a14159790 0x7f9a140c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1a19b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9a141593b0 0x7f9a14071220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34908/0 (socket says 172.21.15.88:34908) 2023-08-10T10:30:49.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.728+0000 7f9a1a19b700 1 -- 172.21.15.88:0/2131755593 learned_addr learned my addr 172.21.15.88:0/2131755593 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1999a700 1 -- 172.21.15.88:0/2131755593 >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 msgr2=0x7f9a140ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1a99c700 1 --2- 172.21.15.88:0/2131755593 >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 0x7f9a140ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1999a700 1 --2- 172.21.15.88:0/2131755593 >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 0x7f9a140ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1999a700 1 -- 172.21.15.88:0/2131755593 >> v1:172.21.15.88:6789/0 conn(0x7f9a141593b0 legacy=0x7f9a14071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1999a700 1 -- 172.21.15.88:0/2131755593 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140cae50 con 0x7f9a14159790 2023-08-10T10:30:49.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1a99c700 1 --2- 172.21.15.88:0/2131755593 >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 0x7f9a140ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a19199700 1 -- 172.21.15.88:0/2131755593 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603001856 0 0) 0x7f9a140cb410 con 0x7f9a141593b0 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a1999a700 1 --2- 172.21.15.88:0/2131755593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14159790 0x7f9a140c9f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a140c9a60 tx=0x7f9a04009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4539e3cea28c163 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a19199700 1 -- 172.21.15.88:0/2131755593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011830 con 0x7f9a14159790 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a19199700 1 -- 172.21.15.88:0/2131755593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a04011990 con 0x7f9a14159790 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.729+0000 7f9a19199700 1 -- 172.21.15.88:0/2131755593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04011d20 con 0x7f9a14159790 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/2131755593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14159790 msgr2=0x7f9a140c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/2131755593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14159790 0x7f9a140c9f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9a140c9a60 tx=0x7f9a04009b20 comp rx=0 tx=0).stop 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/2131755593 shutdown_connections 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/2131755593 >> v2:172.21.15.187:3300/0 conn(0x7f9a14071930 0x7f9a140ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/2131755593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14159790 0x7f9a140c9f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/2131755593 >> 172.21.15.88:0/2131755593 conn(0x7f9a140ced50 msgr2=0x7f9a140cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/2131755593 shutdown_connections 2023-08-10T10:30:49.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.730+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/2131755593 wait complete. 2023-08-10T10:30:49.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.732+0000 7f9a1c3ff700 1 Processor -- start 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.733+0000 7f9a1c3ff700 1 -- start start 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 0x7f9a140c0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a14159790 0x7f9a140c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140c1490 con 0x7f9a14071930 2023-08-10T10:30:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140c8380 con 0x7f9a14159790 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1c3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140c8660 con 0x7f9a141593b0 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44214/0 (socket says 172.21.15.88:44214) 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 -- 172.21.15.88:0/277115641 learned_addr learned my addr 172.21.15.88:0/277115641 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1999a700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 0x7f9a140c0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a99c700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a14159790 0x7f9a140c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 -- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 msgr2=0x7f9a140c0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 0x7f9a140c0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 -- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a14159790 msgr2=0x7f9a140c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a14159790 0x7f9a140c7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1a19b700 1 -- 172.21.15.88:0/277115641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040094a0 con 0x7f9a14071930 2023-08-10T10:30:49.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.734+0000 7f9a1999a700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 0x7f9a140c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:49.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a1a19b700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a100011e0 tx=0x7f9a1000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10004c80 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a10004e00 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a10007310 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a140c8940 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.735+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a140c8f00 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.736+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a140c3a40 con 0x7f9a14071930 2023-08-10T10:30:49.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.737+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a10007470 con 0x7f9a14071930 2023-08-10T10:30:49.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.738+0000 7f9a0affd700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 0x7f99f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:49.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.738+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a10089590 con 0x7f9a14071930 2023-08-10T10:30:49.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.738+0000 7f9a1999a700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 0x7f99f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:49.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.739+0000 7f9a1999a700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 0x7f99f806d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a040090b0 tx=0x7f9a04008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:49.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.742+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a140c3a40 con 0x7f9a14071930 2023-08-10T10:30:49.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.938+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a140c3a40 con 0x7f9a14071930 2023-08-10T10:30:49.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.939+0000 7f9a0affd700 1 -- 172.21.15.88:0/277115641 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f9a140c3a40 con 0x7f9a14071930 2023-08-10T10:30:49.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:49.941 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 msgr2=0x7f99f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 0x7f99f806d1a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a040090b0 tx=0x7f9a04008030 comp rx=0 tx=0).stop 2023-08-10T10:30:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 msgr2=0x7f9a1414f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9a100011e0 tx=0x7f9a1000cae0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 shutdown_connections 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a14159790 0x7f9a140c7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a14071930 0x7f9a1414f350 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f99f806ace0 0x7f99f806d1a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 --2- 172.21.15.88:0/277115641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a141593b0 0x7f9a140c0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 >> 172.21.15.88:0/277115641 conn(0x7f9a140ced50 msgr2=0x7f9a1415bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 shutdown_connections 2023-08-10T10:30:49.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:49.942+0000 7f9a1c3ff700 1 -- 172.21.15.88:0/277115641 wait complete. 2023-08-10T10:30:49.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:30:49.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:30:50.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.159+0000 7f48979ff700 1 Processor -- start 2023-08-10T10:30:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.159+0000 7f48979ff700 1 -- start start 2023-08-10T10:30:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.160+0000 7f48979ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f48900b5060 0x7f48900b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.160+0000 7f48979ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900d1840 con 0x7f489015d1e0 2023-08-10T10:30:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.160+0000 7f48979ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48900d1b20 con 0x7f48900d27a0 2023-08-10T10:30:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.160+0000 7f48979ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48900d2c50 con 0x7f48900b5060 2023-08-10T10:30:50.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f489579b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f489015d1e0 0x7f48900d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34914/0 (socket says 172.21.15.88:34914) 2023-08-10T10:30:50.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f489579b700 1 -- 172.21.15.88:0/708817084 learned_addr learned my addr 172.21.15.88:0/708817084 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:50.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4895f9c700 1 --2- 172.21.15.88:0/708817084 >> v2:172.21.15.88:3300/0 conn(0x7f48900b5060 0x7f48900b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4887fff700 1 -- 172.21.15.88:0/708817084 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115415097 0 0) 0x7f48900d1840 con 0x7f489015d1e0 2023-08-10T10:30:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4887fff700 1 -- 172.21.15.88:0/708817084 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f487c0035b0 con 0x7f489015d1e0 2023-08-10T10:30:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4895f9c700 1 -- 172.21.15.88:0/708817084 >> v1:172.21.15.187:6789/0 conn(0x7f48900d27a0 legacy=0x7f48900b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4895f9c700 1 -- 172.21.15.88:0/708817084 >> v1:172.21.15.88:6789/0 conn(0x7f489015d1e0 legacy=0x7f48900d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4895f9c700 1 -- 172.21.15.88:0/708817084 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48900d1e00 con 0x7f48900b5060 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.161+0000 7f4895f9c700 1 --2- 172.21.15.88:0/708817084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900b5060 0x7f48900b1940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7cfdd49e08cf2d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f4887fff700 1 -- 172.21.15.88:0/708817084 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488800e070 con 0x7f48900b5060 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f4887fff700 1 -- 172.21.15.88:0/708817084 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488800bb20 con 0x7f48900b5060 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f4887fff700 1 -- 172.21.15.88:0/708817084 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888012430 con 0x7f48900b5060 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 -- 172.21.15.88:0/708817084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900b5060 msgr2=0x7f48900b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 --2- 172.21.15.88:0/708817084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900b5060 0x7f48900b1940 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:50.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 -- 172.21.15.88:0/708817084 shutdown_connections 2023-08-10T10:30:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 --2- 172.21.15.88:0/708817084 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900b5060 0x7f48900b1940 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 -- 172.21.15.88:0/708817084 >> 172.21.15.88:0/708817084 conn(0x7f48900cf950 msgr2=0x7f48900cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 -- 172.21.15.88:0/708817084 shutdown_connections 2023-08-10T10:30:50.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.162+0000 7f48979ff700 1 -- 172.21.15.88:0/708817084 wait complete. 2023-08-10T10:30:50.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.164+0000 7f48979ff700 1 Processor -- start 2023-08-10T10:30:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.164+0000 7f48979ff700 1 -- start start 2023-08-10T10:30:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48900b5060 0x7f48900c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f489015d1e0 0x7f48900cbd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489014a800 con 0x7f48900d27a0 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48900ca610 con 0x7f48900b5060 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f48979ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48900ca8f0 con 0x7f489015d1e0 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f4894f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f4894f9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44242/0 (socket says 172.21.15.88:44242) 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f4894f9a700 1 -- 172.21.15.88:0/762651594 learned_addr learned my addr 172.21.15.88:0/762651594 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f489579b700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48900b5060 0x7f48900c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.165+0000 7f4895f9c700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f489015d1e0 0x7f48900cbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 -- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f489015d1e0 msgr2=0x7f48900cbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f489015d1e0 0x7f48900cbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 -- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48900b5060 msgr2=0x7f48900c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48900b5060 0x7f48900c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 -- 172.21.15.88:0/762651594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009a70 con 0x7f48900d27a0 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4894f9a700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f488000c700 tx=0x7f488000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48800052d0 con 0x7f48900d27a0 2023-08-10T10:30:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4880005430 con 0x7f48900d27a0 2023-08-10T10:30:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4880003880 con 0x7f48900d27a0 2023-08-10T10:30:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48900cabd0 con 0x7f48900d27a0 2023-08-10T10:30:50.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.166+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4890157b50 con 0x7f48900d27a0 2023-08-10T10:30:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.167+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900cb6c0 con 0x7f48900d27a0 2023-08-10T10:30:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.168+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48800039e0 con 0x7f48900d27a0 2023-08-10T10:30:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.169+0000 7f4885ffb700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 0x7f487406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.169+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4880088bb0 con 0x7f48900d27a0 2023-08-10T10:30:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.169+0000 7f489579b700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 0x7f487406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.170+0000 7f489579b700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 0x7f487406d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f488c007fd0 tx=0x7f488c007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.173+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48900cb6c0 con 0x7f48900d27a0 2023-08-10T10:30:50.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.372+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f48900cbaa0 con 0x7f48900d27a0 2023-08-10T10:30:50.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.372+0000 7f4885ffb700 1 -- 172.21.15.88:0/762651594 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4880017020 con 0x7f48900d27a0 2023-08-10T10:30:50.373 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:30:50.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 msgr2=0x7f487406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 0x7f487406d1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f488c007fd0 tx=0x7f488c007dc0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 msgr2=0x7f489014a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f488000c700 tx=0x7f488000ca10 comp rx=0 tx=0).stop 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 shutdown_connections 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f487406ace0 0x7f487406d1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f489015d1e0 0x7f48900cbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48900b5060 0x7f48900c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 --2- 172.21.15.88:0/762651594 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48900d27a0 0x7f489014a2c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 >> 172.21.15.88:0/762651594 conn(0x7f48900cf950 msgr2=0x7f489015d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 shutdown_connections 2023-08-10T10:30:50.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.375+0000 7f48979ff700 1 -- 172.21.15.88:0/762651594 wait complete. 2023-08-10T10:30:50.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:30:50.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.594+0000 7fee0b9ff700 1 Processor -- start 2023-08-10T10:30:50.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.594+0000 7fee0b9ff700 1 -- start start 2023-08-10T10:30:50.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.595+0000 7fee0b9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fee040cc6c0 0x7fee040cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.595+0000 7fee0b9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.595+0000 7fee0b9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee040c43a0 con 0x7fee04143810 2023-08-10T10:30:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.595+0000 7fee0b9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee040c4960 con 0x7fee040cc6c0 2023-08-10T10:30:50.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.595+0000 7fee0b9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040ce900 con 0x7fee0406dca0 2023-08-10T10:30:50.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee09f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fee040cc6c0 0x7fee040cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fee040cc6c0 0x7fee040cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:58038/0 (socket says 172.21.15.88:58038) 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee09f9c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:49954/0 (socket says 172.21.15.88:49954) 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 -- 172.21.15.88:0/1721635271 learned_addr learned my addr 172.21.15.88:0/1721635271 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 -- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 msgr2=0x7fee040ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:50.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 -- 172.21.15.88:0/1721635271 >> v1:172.21.15.187:6789/0 conn(0x7fee04143810 legacy=0x7fee040c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 -- 172.21.15.88:0/1721635271 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0406e8c0 con 0x7fee040cc6c0 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee09f9c700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fedfbfff700 1 -- 172.21.15.88:0/1721635271 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324083390 0 0) 0x7fee040c43a0 con 0x7fee04143810 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.596+0000 7fee08f9a700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee040cc6c0 0x7fee040cde80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedf40098f0 tx=0x7fedf4009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9000ee291a26321b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fedfbfff700 1 -- 172.21.15.88:0/1721635271 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4011830 con 0x7fee040cc6c0 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fedfbfff700 1 -- 172.21.15.88:0/1721635271 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf4011990 con 0x7fee040cc6c0 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fedfbfff700 1 -- 172.21.15.88:0/1721635271 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf4011d20 con 0x7fee040cc6c0 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 -- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee040cc6c0 msgr2=0x7fee040cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee040cc6c0 0x7fee040cde80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fedf40098f0 tx=0x7fedf4009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 -- 172.21.15.88:0/1721635271 shutdown_connections 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee0406dca0 0x7fee040ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/1721635271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee040cc6c0 0x7fee040cde80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 -- 172.21.15.88:0/1721635271 >> 172.21.15.88:0/1721635271 conn(0x7fee040cb570 msgr2=0x7fee040cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:50.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 -- 172.21.15.88:0/1721635271 shutdown_connections 2023-08-10T10:30:50.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.597+0000 7fee0b9ff700 1 -- 172.21.15.88:0/1721635271 wait complete. 2023-08-10T10:30:50.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.599+0000 7fee0b9ff700 1 Processor -- start 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.599+0000 7fee0b9ff700 1 -- start start 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee040cc6c0 0x7fee041e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee04143810 0x7fee041e71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b1d70 con 0x7fee0406dca0 2023-08-10T10:30:50.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee040ad0c0 con 0x7fee04143810 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.600+0000 7fee0b9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee040b1fc0 con 0x7fee040cc6c0 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44256/0 (socket says 172.21.15.88:44256) 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 -- 172.21.15.88:0/670462684 learned_addr learned my addr 172.21.15.88:0/670462684 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee08f9a700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee040cc6c0 0x7fee041e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee09f9c700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee04143810 0x7fee041e71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 -- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee040cc6c0 msgr2=0x7fee041e6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee040cc6c0 0x7fee041e6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 -- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee04143810 msgr2=0x7fee041e71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee04143810 0x7fee041e71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 -- 172.21.15.88:0/670462684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc009a70 con 0x7fee0406dca0 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fee0979b700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c550 tx=0x7fee0000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000054e0 con 0x7fee0406dca0 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00003680 con 0x7fee0406dca0 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.601+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee00003a30 con 0x7fee0406dca0 2023-08-10T10:30:50.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.602+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf4009550 con 0x7fee0406dca0 2023-08-10T10:30:50.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.602+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee040b2580 con 0x7fee0406dca0 2023-08-10T10:30:50.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.603+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee040b27c0 con 0x7fee0406dca0 2023-08-10T10:30:50.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.604+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee00003b90 con 0x7fee0406dca0 2023-08-10T10:30:50.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.605+0000 7fedf9ffb700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 0x7fede806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:50.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.605+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fee00088b10 con 0x7fee0406dca0 2023-08-10T10:30:50.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.605+0000 7fee08f9a700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 0x7fede806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:50.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.606+0000 7fee08f9a700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 0x7fede806d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee040ccb00 tx=0x7fedf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:50.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.609+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fee00053870 con 0x7fee0406dca0 2023-08-10T10:30:50.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.802+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee040cd500 con 0x7fee0406dca0 2023-08-10T10:30:50.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.802+0000 7fedf9ffb700 1 -- 172.21.15.88:0/670462684 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee000170a0 con 0x7fee0406dca0 2023-08-10T10:30:50.804 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:30:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 msgr2=0x7fede806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 0x7fede806d1a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fee040ccb00 tx=0x7fedf4008030 comp rx=0 tx=0).stop 2023-08-10T10:30:50.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 msgr2=0x7fee0415a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fee0000c550 tx=0x7fee0000c860 comp rx=0 tx=0).stop 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 shutdown_connections 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee04143810 0x7fee041e71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee0406dca0 0x7fee0415a490 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fede806ace0 0x7fede806d1a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 --2- 172.21.15.88:0/670462684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee040cc6c0 0x7fee041e6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:50.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 >> 172.21.15.88:0/670462684 conn(0x7fee040cb570 msgr2=0x7fee040cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:50.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 shutdown_connections 2023-08-10T10:30:50.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:50.805+0000 7fee0b9ff700 1 -- 172.21.15.88:0/670462684 wait complete. 2023-08-10T10:30:50.824 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:30:51.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.021+0000 7fa0603ff700 1 Processor -- start 2023-08-10T10:30:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.021+0000 7fa0603ff700 1 -- start start 2023-08-10T10:30:51.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.022+0000 7fa0603ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa05815d1e0 0x7fa0580d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.022+0000 7fa0603ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0580b5060 0x7fa0580b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.022+0000 7fa0603ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0580d1840 con 0x7fa0580d1060 2023-08-10T10:30:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.022+0000 7fa0603ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05815d5c0 con 0x7fa0580b5060 2023-08-10T10:30:51.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.022+0000 7fa0603ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0580d1b20 con 0x7fa05815d1e0 2023-08-10T10:30:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0580b5060 0x7fa0580b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa0580b5060 0x7fa0580b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44264/0 (socket says 172.21.15.88:44264) 2023-08-10T10:30:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 -- 172.21.15.88:0/2501883042 learned_addr learned my addr 172.21.15.88:0/2501883042 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e19b700 1 --2- 172.21.15.88:0/2501883042 >> v2:172.21.15.187:3300/0 conn(0x7fa05815d1e0 0x7fa0580d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 -- 172.21.15.88:0/2501883042 >> v2:172.21.15.187:3300/0 conn(0x7fa05815d1e0 msgr2=0x7fa0580d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 --2- 172.21.15.88:0/2501883042 >> v2:172.21.15.187:3300/0 conn(0x7fa05815d1e0 0x7fa0580d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 -- 172.21.15.88:0/2501883042 >> v1:172.21.15.187:6789/0 conn(0x7fa0580d1060 legacy=0x7fa0580b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 -- 172.21.15.88:0/2501883042 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0580d1e00 con 0x7fa0580b5060 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05e99c700 1 --2- 172.21.15.88:0/2501883042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580b5060 0x7fa0580b1940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa0580b5ac0 tx=0x7fa05000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f342ced581338df server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05d199700 1 -- 172.21.15.88:0/2501883042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000e070 con 0x7fa0580b5060 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.023+0000 7fa05d199700 1 -- 172.21.15.88:0/2501883042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa05000b9c0 con 0x7fa0580b5060 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa05d199700 1 -- 172.21.15.88:0/2501883042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa05000bd70 con 0x7fa0580b5060 2023-08-10T10:30:51.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 -- 172.21.15.88:0/2501883042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580b5060 msgr2=0x7fa0580b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 --2- 172.21.15.88:0/2501883042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580b5060 0x7fa0580b1940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa0580b5ac0 tx=0x7fa05000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 -- 172.21.15.88:0/2501883042 shutdown_connections 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 --2- 172.21.15.88:0/2501883042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580b5060 0x7fa0580b1940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 --2- 172.21.15.88:0/2501883042 >> v2:172.21.15.187:3300/0 conn(0x7fa05815d1e0 0x7fa0580d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 -- 172.21.15.88:0/2501883042 >> 172.21.15.88:0/2501883042 conn(0x7fa0580cf950 msgr2=0x7fa0580cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 -- 172.21.15.88:0/2501883042 shutdown_connections 2023-08-10T10:30:51.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.024+0000 7fa0603ff700 1 -- 172.21.15.88:0/2501883042 wait complete. 2023-08-10T10:30:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.026+0000 7fa0603ff700 1 Processor -- start 2023-08-10T10:30:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.026+0000 7fa0603ff700 1 -- start start 2023-08-10T10:30:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 0x7fa05815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa05815d1e0 0x7fa0580cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581e6f20 con 0x7fa0580d1060 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05815b510 con 0x7fa05815d1e0 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa0603ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0581e6960 con 0x7fa0580b5060 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.027+0000 7fa05d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44274/0 (socket says 172.21.15.88:44274) 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 -- 172.21.15.88:0/3196844300 learned_addr learned my addr 172.21.15.88:0/3196844300 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:51.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05e99c700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa05815d1e0 0x7fa0580cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05e19b700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 0x7fa05815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 -- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 msgr2=0x7fa05815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 0x7fa05815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 -- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa05815d1e0 msgr2=0x7fa0580cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa05815d1e0 0x7fa0580cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 -- 172.21.15.88:0/3196844300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009b30 con 0x7fa0580d1060 2023-08-10T10:30:51.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05e19b700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 0x7fa05815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa05d99a700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c4e0 tx=0x7fa04800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480052d0 con 0x7fa0580d1060 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa048005430 con 0x7fa0580d1060 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0480038c0 con 0x7fa0580d1060 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.028+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0581e6c40 con 0x7fa0580d1060 2023-08-10T10:30:51.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.029+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0580cae10 con 0x7fa0580d1060 2023-08-10T10:30:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.030+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0580cb020 con 0x7fa0580d1060 2023-08-10T10:30:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.030+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa048003a20 con 0x7fa0580d1060 2023-08-10T10:30:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.031+0000 7fa04effd700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 0x7fa03c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.031+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa048088cb0 con 0x7fa0580d1060 2023-08-10T10:30:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.032+0000 7fa05e19b700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 0x7fa03c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.032+0000 7fa05e19b700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 0x7fa03c06d1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa05815b830 tx=0x7fa054008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.035+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa0480539d0 con 0x7fa0580d1060 2023-08-10T10:30:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.230+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa0580cef10 con 0x7fa0580d1060 2023-08-10T10:30:51.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.231+0000 7fa04effd700 1 -- 172.21.15.88:0/3196844300 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa048056ff0 con 0x7fa0580d1060 2023-08-10T10:30:51.233 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:30:51.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 msgr2=0x7fa03c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 0x7fa03c06d1a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa05815b830 tx=0x7fa054008040 comp rx=0 tx=0).stop 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 msgr2=0x7fa05815a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa04800c4e0 tx=0x7fa04800c7f0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 shutdown_connections 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa05815d1e0 0x7fa0580cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa03c06ace0 0x7fa03c06d1a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0580b5060 0x7fa05815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 --2- 172.21.15.88:0/3196844300 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa0580d1060 0x7fa05815a670 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 >> 172.21.15.88:0/3196844300 conn(0x7fa0580cf950 msgr2=0x7fa058065e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 shutdown_connections 2023-08-10T10:30:51.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.233+0000 7fa0603ff700 1 -- 172.21.15.88:0/3196844300 wait complete. 2023-08-10T10:30:51.253 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:30:51.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.451+0000 7f8df23ff700 1 Processor -- start 2023-08-10T10:30:51.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.451+0000 7f8df23ff700 1 -- start start 2023-08-10T10:30:51.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.452+0000 7f8df23ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8dec0d27a0 0x7f8dec0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df23ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 0x7f8dec0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df23ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dec0d1840 con 0x7f8dec15d1e0 2023-08-10T10:30:51.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df23ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dec0d2c50 con 0x7f8dec0d27a0 2023-08-10T10:30:51.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df23ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec0b5320 con 0x7f8dec0b4e90 2023-08-10T10:30:51.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8debfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8dec15d1e0 0x7f8dec0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34926/0 (socket says 172.21.15.88:34926) 2023-08-10T10:30:51.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8debfff700 1 -- 172.21.15.88:0/1755072810 learned_addr learned my addr 172.21.15.88:0/1755072810 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:51.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df099c700 1 --2- 172.21.15.88:0/1755072810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 0x7f8dec0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8deb7fe700 1 --2- 172.21.15.88:0/1755072810 >> v2:172.21.15.187:3300/0 conn(0x7f8dec0d27a0 0x7f8dec0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8deaffd700 1 -- 172.21.15.88:0/1755072810 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869384274 0 0) 0x7f8dec0d1840 con 0x7f8dec15d1e0 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8deaffd700 1 -- 172.21.15.88:0/1755072810 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8dd40035b0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df099c700 1 -- 172.21.15.88:0/1755072810 >> v2:172.21.15.187:3300/0 conn(0x7f8dec0d27a0 msgr2=0x7f8dec0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.453+0000 7f8df099c700 1 --2- 172.21.15.88:0/1755072810 >> v2:172.21.15.187:3300/0 conn(0x7f8dec0d27a0 0x7f8dec0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8df099c700 1 -- 172.21.15.88:0/1755072810 >> v1:172.21.15.88:6789/0 conn(0x7f8dec15d1e0 legacy=0x7f8dec0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8df099c700 1 -- 172.21.15.88:0/1755072810 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dec0d1b20 con 0x7f8dec0b4e90 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8df099c700 1 --2- 172.21.15.88:0/1755072810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 0x7f8dec0b1940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009d90 tx=0x7f8de400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1744dc7af6f4b90 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8deaffd700 1 -- 172.21.15.88:0/1755072810 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de400e070 con 0x7f8dec0b4e90 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8deaffd700 1 -- 172.21.15.88:0/1755072810 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de400bb20 con 0x7f8dec0b4e90 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.454+0000 7f8deaffd700 1 -- 172.21.15.88:0/1755072810 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4012430 con 0x7f8dec0b4e90 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 -- 172.21.15.88:0/1755072810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 msgr2=0x7f8dec0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 --2- 172.21.15.88:0/1755072810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 0x7f8dec0b1940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8de4009d90 tx=0x7f8de400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 -- 172.21.15.88:0/1755072810 shutdown_connections 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 --2- 172.21.15.88:0/1755072810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0b4e90 0x7f8dec0b1940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 --2- 172.21.15.88:0/1755072810 >> v2:172.21.15.187:3300/0 conn(0x7f8dec0d27a0 0x7f8dec0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 -- 172.21.15.88:0/1755072810 >> 172.21.15.88:0/1755072810 conn(0x7f8dec0cf950 msgr2=0x7f8dec0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:51.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 -- 172.21.15.88:0/1755072810 shutdown_connections 2023-08-10T10:30:51.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.455+0000 7f8df23ff700 1 -- 172.21.15.88:0/1755072810 wait complete. 2023-08-10T10:30:51.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.457+0000 7f8df23ff700 1 Processor -- start 2023-08-10T10:30:51.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.457+0000 7f8df23ff700 1 -- start start 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8dec0b4e90 0x7f8dec0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0d27a0 0x7f8dec15f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15acd0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15bb30 con 0x7f8dec0b4e90 2023-08-10T10:30:51.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df23ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dec15af20 con 0x7f8dec0d27a0 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44288/0 (socket says 172.21.15.88:44288) 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 -- 172.21.15.88:0/2672134387 learned_addr learned my addr 172.21.15.88:0/2672134387 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8deb7fe700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0d27a0 0x7f8dec15f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8debfff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8dec0b4e90 0x7f8dec0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 -- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0d27a0 msgr2=0x7f8dec15f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0d27a0 0x7f8dec15f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 -- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8dec0b4e90 msgr2=0x7f8dec0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8dec0b4e90 0x7f8dec0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.458+0000 7f8df099c700 1 -- 172.21.15.88:0/2672134387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4009a70 con 0x7f8dec15d1e0 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8df099c700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8de4014040 tx=0x7f8de4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de40129f0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de4020070 con 0x7f8dec15d1e0 2023-08-10T10:30:51.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de4012db0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dec15b200 con 0x7f8dec15d1e0 2023-08-10T10:30:51.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.459+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dec15b7c0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.460+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dec15bca0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.461+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8de4004040 con 0x7f8dec15d1e0 2023-08-10T10:30:51.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.462+0000 7f8de8ff9700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 0x7f8dd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.462+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8de4022070 con 0x7f8dec15d1e0 2023-08-10T10:30:51.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.462+0000 7f8debfff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 0x7f8dd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.463+0000 7f8debfff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 0x7f8dd806d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0011e0 tx=0x7f8ddc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.467+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8de4056250 con 0x7f8dec15d1e0 2023-08-10T10:30:51.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.664+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8dec0743a0 con 0x7f8dec15d1e0 2023-08-10T10:30:51.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.664+0000 7f8de8ff9700 1 -- 172.21.15.88:0/2672134387 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8de402c020 con 0x7f8dec15d1e0 2023-08-10T10:30:51.666 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:30:51.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 msgr2=0x7f8dd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 0x7f8dd806d1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc0011e0 tx=0x7f8ddc009040 comp rx=0 tx=0).stop 2023-08-10T10:30:51.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 msgr2=0x7f8dec15f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8de4014040 tx=0x7f8de4004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 shutdown_connections 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8dec15d1e0 0x7f8dec15f650 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8dec0b4e90 0x7f8dec0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8dd806ace0 0x7f8dd806d1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 --2- 172.21.15.88:0/2672134387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8dec0d27a0 0x7f8dec15f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 >> 172.21.15.88:0/2672134387 conn(0x7f8dec0cf950 msgr2=0x7f8dec0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:51.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 shutdown_connections 2023-08-10T10:30:51.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.667+0000 7f8df23ff700 1 -- 172.21.15.88:0/2672134387 wait complete. 2023-08-10T10:30:51.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:30:51.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.883+0000 7f88cd1ff700 1 Processor -- start 2023-08-10T10:30:51.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.883+0000 7f88cd1ff700 1 -- start start 2023-08-10T10:30:51.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.884+0000 7f88cd1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88c815d1e0 0x7f88c80d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.884+0000 7f88cd1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88c80b5060 0x7f88c80b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.884+0000 7f88cd1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c80d1840 con 0x7f88c80d1060 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.884+0000 7f88cd1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c815d5c0 con 0x7f88c80b5060 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.884+0000 7f88cd1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80d1b20 con 0x7f88c815d1e0 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88c80b5060 0x7f88c80b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f88c80b5060 0x7f88c80b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44304/0 (socket says 172.21.15.88:44304) 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 -- 172.21.15.88:0/4294335435 learned_addr learned my addr 172.21.15.88:0/4294335435 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:51.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c6d9d700 1 --2- 172.21.15.88:0/4294335435 >> v2:172.21.15.187:3300/0 conn(0x7f88c815d1e0 0x7f88c80d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 -- 172.21.15.88:0/4294335435 >> v2:172.21.15.187:3300/0 conn(0x7f88c815d1e0 msgr2=0x7f88c80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 --2- 172.21.15.88:0/4294335435 >> v2:172.21.15.187:3300/0 conn(0x7f88c815d1e0 0x7f88c80d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 -- 172.21.15.88:0/4294335435 >> v1:172.21.15.187:6789/0 conn(0x7f88c80d1060 legacy=0x7f88c80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 -- 172.21.15.88:0/4294335435 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80d1e00 con 0x7f88c80b5060 2023-08-10T10:30:51.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.885+0000 7f88c759e700 1 --2- 172.21.15.88:0/4294335435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c80b5060 0x7f88c80b1940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b5ac0 tx=0x7f88c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b75aebfa8712152 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88c5d9b700 1 -- 172.21.15.88:0/4294335435 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000e070 con 0x7f88c80b5060 2023-08-10T10:30:51.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88c5d9b700 1 -- 172.21.15.88:0/4294335435 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c000b910 con 0x7f88c80b5060 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88c5d9b700 1 -- 172.21.15.88:0/4294335435 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c000bcc0 con 0x7f88c80b5060 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4294335435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c80b5060 msgr2=0x7f88c80b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4294335435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c80b5060 0x7f88c80b1940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b5ac0 tx=0x7f88c000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4294335435 shutdown_connections 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4294335435 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c80b5060 0x7f88c80b1940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4294335435 >> v2:172.21.15.187:3300/0 conn(0x7f88c815d1e0 0x7f88c80d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4294335435 >> 172.21.15.88:0/4294335435 conn(0x7f88c80cf950 msgr2=0x7f88c80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4294335435 shutdown_connections 2023-08-10T10:30:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.886+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4294335435 wait complete. 2023-08-10T10:30:51.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.888+0000 7f88cd1ff700 1 Processor -- start 2023-08-10T10:30:51.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.888+0000 7f88cd1ff700 1 -- start start 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c80b5060 0x7f88c80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 0x7f88c814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c78a0 con 0x7f88c815d1e0 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c7b80 con 0x7f88c80d1060 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88cd1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c80c7e60 con 0x7f88c80b5060 2023-08-10T10:30:51.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88c759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88c759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:44308/0 (socket says 172.21.15.88:44308) 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88c759e700 1 -- 172.21.15.88:0/4052383287 learned_addr learned my addr 172.21.15.88:0/4052383287 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.889+0000 7f88c659c700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 0x7f88c814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c6d9d700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c80b5060 0x7f88c80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 -- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c80b5060 msgr2=0x7f88c80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c80b5060 0x7f88c80c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 -- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 msgr2=0x7f88c814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 0x7f88c814c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 -- 172.21.15.88:0/4052383287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0009b30 con 0x7f88c815d1e0 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c659c700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 0x7f88c814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88c759e700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b5680 tx=0x7f88c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004930 con 0x7f88c815d1e0 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c00099b0 con 0x7f88c815d1e0 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c001c680 con 0x7f88c815d1e0 2023-08-10T10:30:51.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c80c8140 con 0x7f88c815d1e0 2023-08-10T10:30:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.890+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c80c8e80 con 0x7f88c815d1e0 2023-08-10T10:30:51.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.891+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c80c8660 con 0x7f88c815d1e0 2023-08-10T10:30:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.892+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f88c001c7e0 con 0x7f88c815d1e0 2023-08-10T10:30:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.893+0000 7f88af7fe700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 0x7f88b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.893+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f88c008b130 con 0x7f88c815d1e0 2023-08-10T10:30:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.893+0000 7f88c6d9d700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 0x7f88b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:51.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.894+0000 7f88c6d9d700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 0x7f88b406d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f88c81f5ec0 tx=0x7f88b8009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:51.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:51.898+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f88c80c8660 con 0x7f88c815d1e0 2023-08-10T10:30:52.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.092+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f88c80c8660 con 0x7f88c815d1e0 2023-08-10T10:30:52.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.093+0000 7f88af7fe700 1 -- 172.21.15.88:0/4052383287 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f88c80c8660 con 0x7f88c815d1e0 2023-08-10T10:30:52.094 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:30:52.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 msgr2=0x7f88b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 0x7f88b406d1a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f88c81f5ec0 tx=0x7f88b8009210 comp rx=0 tx=0).stop 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 msgr2=0x7f88c814ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88c80b5680 tx=0x7f88c0004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 shutdown_connections 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f88c815d1e0 0x7f88c814ce20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f88b406ace0 0x7f88b406d1a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c80b5060 0x7f88c80c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 --2- 172.21.15.88:0/4052383287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80d1060 0x7f88c814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 >> 172.21.15.88:0/4052383287 conn(0x7f88c80cf950 msgr2=0x7f88c815c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:52.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 shutdown_connections 2023-08-10T10:30:52.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.095+0000 7f88cd1ff700 1 -- 172.21.15.88:0/4052383287 wait complete. 2023-08-10T10:30:52.114 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:30:52.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.311+0000 7f3750fff700 1 Processor -- start 2023-08-10T10:30:52.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.311+0000 7f3750fff700 1 -- start start 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3750fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f374c15cf20 0x7f374c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3750fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f374c0b8870 0x7f374c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3750fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374c15e590 con 0x7f374c0b5040 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3750fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0cde30 con 0x7f374c0b8870 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3750fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374c0b54b0 con 0x7f374c15cf20 2023-08-10T10:30:52.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3743fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f374c0b8870 0x7f374c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f374ad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f374c0b5040 0x7f374c06a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39846/0 (socket says 172.21.15.88:39846) 2023-08-10T10:30:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.312+0000 7f3743fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f374c0b8870 0x7f374c0b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41102/0 (socket says 172.21.15.88:41102) 2023-08-10T10:30:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f374ad9d700 1 -- 172.21.15.88:0/4096260541 learned_addr learned my addr 172.21.15.88:0/4096260541 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:52.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f374a59c700 1 --2- 172.21.15.88:0/4096260541 >> v2:172.21.15.187:3300/0 conn(0x7f374c15cf20 0x7f374c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3743fff700 1 -- 172.21.15.88:0/4096260541 >> v2:172.21.15.187:3300/0 conn(0x7f374c15cf20 msgr2=0x7f374c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:52.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3743fff700 1 --2- 172.21.15.88:0/4096260541 >> v2:172.21.15.187:3300/0 conn(0x7f374c15cf20 0x7f374c15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3743fff700 1 -- 172.21.15.88:0/4096260541 >> v1:172.21.15.88:6789/0 conn(0x7f374c0b5040 legacy=0x7f374c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3743fff700 1 -- 172.21.15.88:0/4096260541 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0b8e30 con 0x7f374c0b8870 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3749d9b700 1 -- 172.21.15.88:0/4096260541 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751301134 0 0) 0x7f374c15e590 con 0x7f374c0b5040 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3743fff700 1 --2- 172.21.15.88:0/4096260541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c0b8870 0x7f374c0b4b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f374c06d190 tx=0x7f3734009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ea37e9fc5233e7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3749d9b700 1 -- 172.21.15.88:0/4096260541 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011830 con 0x7f374c0b8870 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3749d9b700 1 -- 172.21.15.88:0/4096260541 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3734011990 con 0x7f374c0b8870 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.313+0000 7f3749d9b700 1 -- 172.21.15.88:0/4096260541 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734011d20 con 0x7f374c0b8870 2023-08-10T10:30:52.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 -- 172.21.15.88:0/4096260541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c0b8870 msgr2=0x7f374c0b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 --2- 172.21.15.88:0/4096260541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c0b8870 0x7f374c0b4b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f374c06d190 tx=0x7f3734009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 -- 172.21.15.88:0/4096260541 shutdown_connections 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 --2- 172.21.15.88:0/4096260541 >> v2:172.21.15.187:3300/0 conn(0x7f374c15cf20 0x7f374c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 --2- 172.21.15.88:0/4096260541 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c0b8870 0x7f374c0b4b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 -- 172.21.15.88:0/4096260541 >> 172.21.15.88:0/4096260541 conn(0x7f374c0d3080 msgr2=0x7f374c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 -- 172.21.15.88:0/4096260541 shutdown_connections 2023-08-10T10:30:52.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.314+0000 7f3750fff700 1 -- 172.21.15.88:0/4096260541 wait complete. 2023-08-10T10:30:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.316+0000 7f3750fff700 1 Processor -- start 2023-08-10T10:30:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.316+0000 7f3750fff700 1 -- start start 2023-08-10T10:30:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f374c0b5040 0x7f374c1599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f374c0b8870 0x7f374c0b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c0b47c0 con 0x7f374c15cf20 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374c15ac60 con 0x7f374c0b5040 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3750fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374c15a050 con 0x7f374c0b8870 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374ad9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41116/0 (socket says 172.21.15.88:41116) 2023-08-10T10:30:52.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374ad9d700 1 -- 172.21.15.88:0/1787272350 learned_addr learned my addr 172.21.15.88:0/1787272350 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f3743fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f374c0b8870 0x7f374c0b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374a59c700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f374c0b5040 0x7f374c1599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374ad9d700 1 -- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f374c0b8870 msgr2=0x7f374c0b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.317+0000 7f374ad9d700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f374c0b8870 0x7f374c0b4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f374ad9d700 1 -- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f374c0b5040 msgr2=0x7f374c1599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f374ad9d700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f374c0b5040 0x7f374c1599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f374ad9d700 1 -- 172.21.15.88:0/1787272350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340094a0 con 0x7f374c15cf20 2023-08-10T10:30:52.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f374ad9d700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f374400cb90 tx=0x7f374400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374400aaa0 con 0x7f374c15cf20 2023-08-10T10:30:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374400ac20 con 0x7f374c15cf20 2023-08-10T10:30:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f374c15a330 con 0x7f374c15cf20 2023-08-10T10:30:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440070d0 con 0x7f374c15cf20 2023-08-10T10:30:52.323 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.318+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f374c15a8f0 con 0x7f374c15cf20 2023-08-10T10:30:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.319+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374c04ecc0 con 0x7f374c15cf20 2023-08-10T10:30:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.320+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3744007230 con 0x7f374c15cf20 2023-08-10T10:30:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.321+0000 7f3742ffd700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 0x7f372c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.321+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3744089250 con 0x7f374c15cf20 2023-08-10T10:30:52.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.321+0000 7f374a59c700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 0x7f372c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.325 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.322+0000 7f374a59c700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 0x7f372c06d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f373c009b40 tx=0x7f373c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.326 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.325+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3744054010 con 0x7f374c15cf20 2023-08-10T10:30:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.541+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f374c0b4e20 con 0x7f374c15cf20 2023-08-10T10:30:52.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.542+0000 7f3742ffd700 1 -- 172.21.15.88:0/1787272350 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3744057630 con 0x7f374c15cf20 2023-08-10T10:30:52.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 msgr2=0x7f372c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 0x7f372c06d1a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f373c009b40 tx=0x7f373c009210 comp rx=0 tx=0).stop 2023-08-10T10:30:52.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 msgr2=0x7f374c0c7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f374400cb90 tx=0x7f374400cea0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 shutdown_connections 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f374c15cf20 0x7f374c0c7580 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f374c0b5040 0x7f374c1599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f372c06ace0 0x7f372c06d1a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 --2- 172.21.15.88:0/1787272350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f374c0b8870 0x7f374c0b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 >> 172.21.15.88:0/1787272350 conn(0x7f374c0d3080 msgr2=0x7f374c15b900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 shutdown_connections 2023-08-10T10:30:52.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.544+0000 7f3750fff700 1 -- 172.21.15.88:0/1787272350 wait complete. 2023-08-10T10:30:52.548 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:30:52.563 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi088.front.sepia.ceph.com... 2023-08-10T10:30:52.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:52.564 DEBUG:teuthology.orchestra.run.smithi088:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-10T10:30:52.630 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi088.stderr:ceph-fuse[121529]: fuse finished with error 0 and tester_r 0 2023-08-10T10:30:52.633 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:30:52.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:30:52.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:30:52.676 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-10T10:30:52.733 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:52.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.926+0000 7f58f85ff700 1 Processor -- start 2023-08-10T10:30:52.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.926+0000 7f58f85ff700 1 -- start start 2023-08-10T10:30:52.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.927+0000 7f58f85ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f00b8870 0x7f58f00b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.927+0000 7f58f85ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f58f00b5040 0x7f58f00d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.927+0000 7f58f85ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f00b5480 con 0x7f58f015cf20 2023-08-10T10:30:52.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.927+0000 7f58f85ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f00cde30 con 0x7f58f00b5040 2023-08-10T10:30:52.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.927+0000 7f58f85ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f00b8e30 con 0x7f58f00b8870 2023-08-10T10:30:52.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f6b9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f58f00b5040 0x7f58f00d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f5b9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f00b8870 0x7f58f00b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f639b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f58f015cf20 0x7f58f015e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35874/0 (socket says 172.21.15.88:35874) 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f639b700 1 -- 172.21.15.88:0/2647202140 learned_addr learned my addr 172.21.15.88:0/2647202140 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f6b9c700 1 -- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f00b8870 msgr2=0x7f58f00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f6b9c700 1 --2- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f00b8870 0x7f58f00b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f6b9c700 1 -- 172.21.15.88:0/2647202140 >> v1:172.21.15.187:6789/0 conn(0x7f58f015cf20 legacy=0x7f58f015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.928+0000 7f58f6b9c700 1 -- 172.21.15.88:0/2647202140 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f00ce010 con 0x7f58f00b5040 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f6b9c700 1 --2- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b5040 0x7f58f00d1350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009d90 tx=0x7f58e800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb3021b03d479af server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f5399700 1 -- 172.21.15.88:0/2647202140 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e800e070 con 0x7f58f00b5040 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f5399700 1 -- 172.21.15.88:0/2647202140 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58e800bb20 con 0x7f58f00b5040 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f5399700 1 -- 172.21.15.88:0/2647202140 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58e8012430 con 0x7f58f00b5040 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f85ff700 1 -- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b5040 msgr2=0x7f58f00d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.932 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.929+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b5040 0x7f58f00d1350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58e8009d90 tx=0x7f58e800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:52.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 -- 172.21.15.88:0/2647202140 shutdown_connections 2023-08-10T10:30:52.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b5040 0x7f58f00d1350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2647202140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f00b8870 0x7f58f00b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 -- 172.21.15.88:0/2647202140 >> 172.21.15.88:0/2647202140 conn(0x7f58f00d3080 msgr2=0x7f58f00d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 -- 172.21.15.88:0/2647202140 shutdown_connections 2023-08-10T10:30:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.930+0000 7f58f85ff700 1 -- 172.21.15.88:0/2647202140 wait complete. 2023-08-10T10:30:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.931+0000 7f58f85ff700 1 Processor -- start 2023-08-10T10:30:52.934 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.931+0000 7f58f85ff700 1 -- start start 2023-08-10T10:30:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b8870 0x7f58f00c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f015cf20 0x7f58f00ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015f720 con 0x7f58f00b5040 2023-08-10T10:30:52.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015eb10 con 0x7f58f00b8870 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.932+0000 7f58f85ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f015edf0 con 0x7f58f015cf20 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41128/0 (socket says 172.21.15.88:41128) 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 -- 172.21.15.88:0/2859604151 learned_addr learned my addr 172.21.15.88:0/2859604151 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f5b9a700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b8870 0x7f58f00c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f6b9c700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f015cf20 0x7f58f00ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 -- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f015cf20 msgr2=0x7f58f00ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.937 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f015cf20 0x7f58f00ca5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 -- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b8870 msgr2=0x7f58f00c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b8870 0x7f58f00c8e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 -- 172.21.15.88:0/2859604151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e8009a70 con 0x7f58f00b5040 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58f639b700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c520 tx=0x7f58ec00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.933+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec005d70 con 0x7f58f00b5040 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.934+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec0070d0 con 0x7f58f00b5040 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.934+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f015f0d0 con 0x7f58f00b5040 2023-08-10T10:30:52.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.934+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec007440 con 0x7f58f00b5040 2023-08-10T10:30:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.934+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f015e7e0 con 0x7f58f00b5040 2023-08-10T10:30:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.935+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f004ecc0 con 0x7f58f00b5040 2023-08-10T10:30:52.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.936+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f58ec0075a0 con 0x7f58f00b5040 2023-08-10T10:30:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.936+0000 7f58e6ffd700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 0x7f58d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.937+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f58ec088b40 con 0x7f58f00b5040 2023-08-10T10:30:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.937+0000 7f58f5b9a700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 0x7f58d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:52.940 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.937+0000 7f58f5b9a700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 0x7f58d406d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58f00d2230 tx=0x7f58e0009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:52.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:52.941+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f58ec053890 con 0x7f58f00b5040 2023-08-10T10:30:53.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.135+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58f00d1f80 con 0x7f58f00b5040 2023-08-10T10:30:53.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.136+0000 7f58e6ffd700 1 -- 172.21.15.88:0/2859604151 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f58ec056eb0 con 0x7f58f00b5040 2023-08-10T10:30:53.138 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:53.138 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:53.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 msgr2=0x7f58d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 0x7f58d406d1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f58f00d2230 tx=0x7f58e0009210 comp rx=0 tx=0).stop 2023-08-10T10:30:53.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 msgr2=0x7f58f00cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00c520 tx=0x7f58ec00c830 comp rx=0 tx=0).stop 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 shutdown_connections 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f58d406ace0 0x7f58d406d1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f015cf20 0x7f58f00ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f58f00b5040 0x7f58f00cc5f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 --2- 172.21.15.88:0/2859604151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f00b8870 0x7f58f00c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.138+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 >> 172.21.15.88:0/2859604151 conn(0x7f58f00d3080 msgr2=0x7f58f00b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.139+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 shutdown_connections 2023-08-10T10:30:53.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.139+0000 7f58f85ff700 1 -- 172.21.15.88:0/2859604151 wait complete. 2023-08-10T10:30:53.159 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.353+0000 7f79591ff700 1 Processor -- start 2023-08-10T10:30:53.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.353+0000 7f79591ff700 1 -- start start 2023-08-10T10:30:53.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f79591ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f7954167c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f79591ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540b8e30 con 0x7f79540b8870 2023-08-10T10:30:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f79591ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79540ce010 con 0x7f795415cf20 2023-08-10T10:30:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f79591ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540cde30 con 0x7f79540b5210 2023-08-10T10:30:53.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f795259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f79540b8870 0x7f79540b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39850/0 (socket says 172.21.15.88:39850) 2023-08-10T10:30:53.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.354+0000 7f795259c700 1 -- 172.21.15.88:0/1288295411 learned_addr learned my addr 172.21.15.88:0/1288295411 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f795359e700 1 --2- 172.21.15.88:0/1288295411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f7954167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257190612 0 0) 0x7f79540b8e30 con 0x7f79540b8870 2023-08-10T10:30:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f793c0035b0 con 0x7f79540b8870 2023-08-10T10:30:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 198043486 0 0) 0x7f79540ce010 con 0x7f795415cf20 2023-08-10T10:30:53.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79540b8e30 con 0x7f795415cf20 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 497127018 0 0) 0x7f793c0035b0 con 0x7f79540b8870 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f795359e700 1 -- 172.21.15.88:0/1288295411 >> v1:172.21.15.187:6789/0 conn(0x7f795415cf20 legacy=0x7f795415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f795359e700 1 -- 172.21.15.88:0/1288295411 >> v1:172.21.15.88:6789/0 conn(0x7f79540b8870 legacy=0x7f79540b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f795359e700 1 -- 172.21.15.88:0/1288295411 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79540ce2f0 con 0x7f79540b5210 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.355+0000 7f795359e700 1 --2- 172.21.15.88:0/1288295411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f7954167c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f794c009dc0 tx=0x7f794c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc2bce988f65758f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c00e070 con 0x7f79540b5210 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c003a20 con 0x7f79540b5210 2023-08-10T10:30:53.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f7951d9b700 1 -- 172.21.15.88:0/1288295411 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948001670 con 0x7f79540b5210 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 -- 172.21.15.88:0/1288295411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 msgr2=0x7f7954167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 --2- 172.21.15.88:0/1288295411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f7954167c00 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f794c009dc0 tx=0x7f794c00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 -- 172.21.15.88:0/1288295411 shutdown_connections 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 --2- 172.21.15.88:0/1288295411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f7954167c00 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 -- 172.21.15.88:0/1288295411 >> 172.21.15.88:0/1288295411 conn(0x7f79540d3080 msgr2=0x7f79540d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 -- 172.21.15.88:0/1288295411 shutdown_connections 2023-08-10T10:30:53.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.356+0000 7f79591ff700 1 -- 172.21.15.88:0/1288295411 wait complete. 2023-08-10T10:30:53.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.358+0000 7f79591ff700 1 Processor -- start 2023-08-10T10:30:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.358+0000 7f79591ff700 1 -- start start 2023-08-10T10:30:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f79540cc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f795415cf20 0x7f79541596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79540c70e0 con 0x7f79540b8870 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795414ea80 con 0x7f795415cf20 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f79591ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79540ccfe0 con 0x7f79540b5210 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f795259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f795259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41140/0 (socket says 172.21.15.88:41140) 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.359+0000 7f795259c700 1 -- 172.21.15.88:0/1812952497 learned_addr learned my addr 172.21.15.88:0/1812952497 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795359e700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f795415cf20 0x7f79541596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f7952d9d700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f79540cc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 -- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 msgr2=0x7f79540cc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f79540cc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 -- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f795415cf20 msgr2=0x7f79541596c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f795415cf20 0x7f79541596c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 -- 172.21.15.88:0/1812952497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794c009a70 con 0x7f79540b8870 2023-08-10T10:30:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f795259c700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f794800c750 tx=0x7f794800ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948004d40 con 0x7f79540b8870 2023-08-10T10:30:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79480070d0 con 0x7f79540b8870 2023-08-10T10:30:53.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79540ca2f0 con 0x7f79540b8870 2023-08-10T10:30:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7948004ea0 con 0x7f79540b8870 2023-08-10T10:30:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.360+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79540ccd00 con 0x7f79540b8870 2023-08-10T10:30:53.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.361+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f795404ecc0 con 0x7f79540b8870 2023-08-10T10:30:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.362+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7948007460 con 0x7f79540b8870 2023-08-10T10:30:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.363+0000 7f793b7fe700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 0x7f794006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.363+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7948089590 con 0x7f79540b8870 2023-08-10T10:30:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.363+0000 7f7952d9d700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 0x7f794006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.364+0000 7f7952d9d700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 0x7f794006d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79440011e0 tx=0x7f7944009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.367+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7948054340 con 0x7f79540b8870 2023-08-10T10:30:53.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.572+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79540c6730 con 0x7f79540b8870 2023-08-10T10:30:53.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.573+0000 7f793b7fe700 1 -- 172.21.15.88:0/1812952497 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f7948057960 con 0x7f79540b8870 2023-08-10T10:30:53.575 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:53.576 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 msgr2=0x7f794006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 0x7f794006d1a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f79440011e0 tx=0x7f7944009040 comp rx=0 tx=0).stop 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 msgr2=0x7f795414e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f794800c750 tx=0x7f794800ca60 comp rx=0 tx=0).stop 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 shutdown_connections 2023-08-10T10:30:53.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f795415cf20 0x7f79541596c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f794006ace0 0x7f794006d1a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f79540b5210 0x7f79540cc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 --2- 172.21.15.88:0/1812952497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79540b8870 0x7f795414e540 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 >> 172.21.15.88:0/1812952497 conn(0x7f79540d3080 msgr2=0x7f79540b46d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 shutdown_connections 2023-08-10T10:30:53.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.576+0000 7f79591ff700 1 -- 172.21.15.88:0/1812952497 wait complete. 2023-08-10T10:30:53.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-10T10:30:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.793+0000 7f6f643ff700 1 Processor -- start 2023-08-10T10:30:53.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.794+0000 7f6f643ff700 1 -- start start 2023-08-10T10:30:53.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6f5c15d1e0 0x7f6f5c0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c0d1060 0x7f6f5c0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c15d5c0 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f5c0b5300 con 0x7f6f5c15d1e0 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f643ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0d1840 con 0x7f6f5c0d1060 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f6299c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f6299c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41146/0 (socket says 172.21.15.88:41146) 2023-08-10T10:30:53.797 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f6299c700 1 -- 172.21.15.88:0/4141684918 learned_addr learned my addr 172.21.15.88:0/4141684918 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f6199a700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c0d1060 0x7f6f5c0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.795+0000 7f6f6219b700 1 --2- 172.21.15.88:0/4141684918 >> v2:172.21.15.187:3300/0 conn(0x7f6f5c15d1e0 0x7f6f5c0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 -- 172.21.15.88:0/4141684918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c0d1060 msgr2=0x7f6f5c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c0d1060 0x7f6f5c0b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 -- 172.21.15.88:0/4141684918 >> v2:172.21.15.187:3300/0 conn(0x7f6f5c15d1e0 msgr2=0x7f6f5c0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:53.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 --2- 172.21.15.88:0/4141684918 >> v2:172.21.15.187:3300/0 conn(0x7f6f5c15d1e0 0x7f6f5c0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 -- 172.21.15.88:0/4141684918 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c0d1b20 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f6299c700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0b5ac0 tx=0x7f6f5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b86bc0727683c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f61199700 1 -- 172.21.15.88:0/4141684918 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400e070 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f61199700 1 -- 172.21.15.88:0/4141684918 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f5400b980 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.796+0000 7f6f61199700 1 -- 172.21.15.88:0/4141684918 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f5400bd30 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 -- 172.21.15.88:0/4141684918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 msgr2=0x7f6f5c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c0b5ac0 tx=0x7f6f5400b330 comp rx=0 tx=0).stop 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 -- 172.21.15.88:0/4141684918 shutdown_connections 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 --2- 172.21.15.88:0/4141684918 >> v2:172.21.15.187:3300/0 conn(0x7f6f5c15d1e0 0x7f6f5c0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c0b1940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 --2- 172.21.15.88:0/4141684918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c0d1060 0x7f6f5c0b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 -- 172.21.15.88:0/4141684918 >> 172.21.15.88:0/4141684918 conn(0x7f6f5c0cf950 msgr2=0x7f6f5c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 -- 172.21.15.88:0/4141684918 shutdown_connections 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.797+0000 7f6f643ff700 1 -- 172.21.15.88:0/4141684918 wait complete. 2023-08-10T10:30:53.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.798+0000 7f6f643ff700 1 Processor -- start 2023-08-10T10:30:53.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.799+0000 7f6f643ff700 1 -- start start 2023-08-10T10:30:53.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.799+0000 7f6f643ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.799+0000 7f6f643ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f5c0d1060 0x7f6f5c0cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f643ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c15d1e0 0x7f6f5c1491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f643ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cbc80 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f643ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0ccb60 con 0x7f6f5c0d1060 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f643ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c0cbf50 con 0x7f6f5c15d1e0 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41162/0 (socket says 172.21.15.88:41162) 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 -- 172.21.15.88:0/1291281407 learned_addr learned my addr 172.21.15.88:0/1291281407 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:53.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6199a700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f5c0d1060 0x7f6f5c0cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6299c700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c15d1e0 0x7f6f5c1491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 -- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c15d1e0 msgr2=0x7f6f5c1491a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c15d1e0 0x7f6f5c1491a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 -- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f5c0d1060 msgr2=0x7f6f5c0cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f5c0d1060 0x7f6f5c0cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 -- 172.21.15.88:0/1291281407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f54009b30 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.800+0000 7f6f6219b700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e840 tx=0x7f6f5800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.801+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58013610 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.801+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f58013770 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.801+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c0cc230 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.801+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f58013b20 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.801+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c0cc7f0 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.802+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c0cce40 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.803+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6f58013c80 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.804+0000 7f6f52ffd700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 0x7f6f4006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:53.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.804+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6f580892c0 con 0x7f6f5c0b4e90 2023-08-10T10:30:53.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.804+0000 7f6f6199a700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 0x7f6f4006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:53.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.804+0000 7f6f6199a700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 0x7f6f4006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006b20 tx=0x7f6f4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:53.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:53.808+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6f58057a80 con 0x7f6f5c0b4e90 2023-08-10T10:30:54.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.047+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6f5c0743a0 con 0x7f6f5c0b4e90 2023-08-10T10:30:54.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.422+0000 7f6f52ffd700 1 -- 172.21.15.88:0/1291281407 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6f58057610 con 0x7f6f5c0b4e90 2023-08-10T10:30:54.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 msgr2=0x7f6f4006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 0x7f6f4006d1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f4c006b20 tx=0x7f6f4c008040 comp rx=0 tx=0).stop 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 msgr2=0x7f6f5c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6f5800e840 tx=0x7f6f5800eb50 comp rx=0 tx=0).stop 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 shutdown_connections 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6f4006ace0 0x7f6f4006d1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6f5c15d1e0 0x7f6f5c1491a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f5c0b4e90 0x7f6f5c1583e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 --2- 172.21.15.88:0/1291281407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6f5c0d1060 0x7f6f5c0cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 >> 172.21.15.88:0/1291281407 conn(0x7f6f5c0cf950 msgr2=0x7f6f5c15d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:54.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 shutdown_connections 2023-08-10T10:30:54.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.425+0000 7f6f643ff700 1 -- 172.21.15.88:0/1291281407 wait complete. 2023-08-10T10:30:54.444 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-08-10T10:30:54.445 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-10T10:30:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.643+0000 7f9e027ff700 1 Processor -- start 2023-08-10T10:30:54.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.643+0000 7f9e027ff700 1 -- start start 2023-08-10T10:30:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e027ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9dfc15d1e0 0x7f9dfc0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e027ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9dfc0d1060 0x7f9dfc0b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e027ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc0b52a0 con 0x7f9dfc0b4e90 2023-08-10T10:30:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e027ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc15d5c0 con 0x7f9dfc0d1060 2023-08-10T10:30:54.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e027ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc0d1840 con 0x7f9dfc15d1e0 2023-08-10T10:30:54.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9dfb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9dfc0d1060 0x7f9dfc0b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:54.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e00d9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9dfc0b4e90 0x7f9dfc0b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39860/0 (socket says 172.21.15.88:39860) 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.644+0000 7f9e00d9c700 1 -- 172.21.15.88:0/408999723 learned_addr learned my addr 172.21.15.88:0/408999723 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfbfff700 1 --2- 172.21.15.88:0/408999723 >> v2:172.21.15.187:3300/0 conn(0x7f9dfc15d1e0 0x7f9dfc0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/408999723 >> v2:172.21.15.187:3300/0 conn(0x7f9dfc15d1e0 msgr2=0x7f9dfc0d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfb7fe700 1 --2- 172.21.15.88:0/408999723 >> v2:172.21.15.187:3300/0 conn(0x7f9dfc15d1e0 0x7f9dfc0d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/408999723 >> v1:172.21.15.88:6789/0 conn(0x7f9dfc0b4e90 legacy=0x7f9dfc0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/408999723 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc0d1b20 con 0x7f9dfc0d1060 2023-08-10T10:30:54.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfb7fe700 1 --2- 172.21.15.88:0/408999723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc0b4950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0b5ac0 tx=0x7f9df0009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab81c2b4fa47f43 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfaffd700 1 -- 172.21.15.88:0/408999723 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0011830 con 0x7f9dfc0d1060 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfaffd700 1 -- 172.21.15.88:0/408999723 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0011990 con 0x7f9dfc0d1060 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.645+0000 7f9dfaffd700 1 -- 172.21.15.88:0/408999723 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0011d20 con 0x7f9dfc0d1060 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 -- 172.21.15.88:0/408999723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 msgr2=0x7f9dfc0b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 --2- 172.21.15.88:0/408999723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc0b4950 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0b5ac0 tx=0x7f9df0009b20 comp rx=0 tx=0).stop 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 -- 172.21.15.88:0/408999723 shutdown_connections 2023-08-10T10:30:54.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 --2- 172.21.15.88:0/408999723 >> v2:172.21.15.187:3300/0 conn(0x7f9dfc15d1e0 0x7f9dfc0d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 --2- 172.21.15.88:0/408999723 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc0b4950 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 -- 172.21.15.88:0/408999723 >> 172.21.15.88:0/408999723 conn(0x7f9dfc0cf950 msgr2=0x7f9dfc0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 -- 172.21.15.88:0/408999723 shutdown_connections 2023-08-10T10:30:54.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.646+0000 7f9e027ff700 1 -- 172.21.15.88:0/408999723 wait complete. 2023-08-10T10:30:54.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.648+0000 7f9e027ff700 1 Processor -- start 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.648+0000 7f9e027ff700 1 -- start start 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dfc0b4e90 0x7f9dfc152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9dfc15d1e0 0x7f9dfc0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c7460 con 0x7f9dfc0d1060 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c7fa0 con 0x7f9dfc0b4e90 2023-08-10T10:30:54.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9e027ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc1529a0 con 0x7f9dfc15d1e0 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41180/0 (socket says 172.21.15.88:41180) 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/2021775138 learned_addr learned my addr 172.21.15.88:0/2021775138 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9dfc15d1e0 msgr2=0x7f9dfc0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9dfc15d1e0 0x7f9dfc0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dfc0b4e90 msgr2=0x7f9dfc152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dfc0b4e90 0x7f9dfc152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.649+0000 7f9dfb7fe700 1 -- 172.21.15.88:0/2021775138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df00094a0 con 0x7f9dfc0d1060 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9dfb7fe700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009b60 tx=0x7f9df0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df00036a0 con 0x7f9dfc0d1060 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df001f070 con 0x7f9dfc0d1060 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0003a60 con 0x7f9dfc0d1060 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0cb290 con 0x7f9dfc0d1060 2023-08-10T10:30:54.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.650+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc0c7950 con 0x7f9dfc0d1060 2023-08-10T10:30:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.651+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dfc0743a0 con 0x7f9dfc0d1060 2023-08-10T10:30:54.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.652+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9df0003bc0 con 0x7f9dfc0d1060 2023-08-10T10:30:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.653+0000 7f9df8ff9700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 0x7f9de806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.653+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9df0021070 con 0x7f9dfc0d1060 2023-08-10T10:30:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.653+0000 7f9dfbfff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 0x7f9de806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:54.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.654+0000 7f9dfbfff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 0x7f9de806d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0097f0 tx=0x7f9dec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:54.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.657+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9df0055f80 con 0x7f9dfc0d1060 2023-08-10T10:30:54.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:54.896+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9dfc0cf1f0 con 0x7f9dfc0d1060 2023-08-10T10:30:55.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.428+0000 7f9df8ff9700 1 -- 172.21.15.88:0/2021775138 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9df005de60 con 0x7f9dfc0d1060 2023-08-10T10:30:55.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 msgr2=0x7f9de806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 0x7f9de806d1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0097f0 tx=0x7f9dec008040 comp rx=0 tx=0).stop 2023-08-10T10:30:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 msgr2=0x7f9dfc1f2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9df0009b60 tx=0x7f9df0004750 comp rx=0 tx=0).stop 2023-08-10T10:30:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 shutdown_connections 2023-08-10T10:30:55.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9de806ace0 0x7f9de806d1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9dfc15d1e0 0x7f9dfc0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9dfc0b4e90 0x7f9dfc152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 --2- 172.21.15.88:0/2021775138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9dfc0d1060 0x7f9dfc1f2d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 >> 172.21.15.88:0/2021775138 conn(0x7f9dfc0cf950 msgr2=0x7f9dfc0d2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 shutdown_connections 2023-08-10T10:30:55.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.431+0000 7f9e027ff700 1 -- 172.21.15.88:0/2021775138 wait complete. 2023-08-10T10:30:55.452 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-10T10:30:55.452 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:30:55.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.648+0000 7fa77e3ff700 1 Processor -- start 2023-08-10T10:30:55.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.648+0000 7fa77e3ff700 1 -- start start 2023-08-10T10:30:55.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa77815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77e3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7780b8870 0x7fa7780b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77e3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780b5480 con 0x7fa7780b5040 2023-08-10T10:30:55.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77e3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780cde30 con 0x7fa7780b8870 2023-08-10T10:30:55.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815e590 con 0x7fa77815cf20 2023-08-10T10:30:55.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77c99c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa7780b5040 0x7fa77806a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39868/0 (socket says 172.21.15.88:39868) 2023-08-10T10:30:55.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa77c99c700 1 -- 172.21.15.88:0/825638042 learned_addr learned my addr 172.21.15.88:0/825638042 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:55.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa777fff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa77815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.649+0000 7fa7777fe700 1 --2- 172.21.15.88:0/825638042 >> v2:172.21.15.187:3300/0 conn(0x7fa7780b8870 0x7fa7780b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4022586250 0 0) 0x7fa7780b5480 con 0x7fa7780b5040 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7600035b0 con 0x7fa7780b5040 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205500609 0 0) 0x7fa7600035b0 con 0x7fa7780b5040 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 msgr2=0x7fa77815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa77815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 >> v2:172.21.15.187:3300/0 conn(0x7fa7780b8870 msgr2=0x7fa7780b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:55.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 --2- 172.21.15.88:0/825638042 >> v2:172.21.15.187:3300/0 conn(0x7fa7780b8870 0x7fa7780b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780b8e30 con 0x7fa7780b5040 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fa7700019f0 con 0x7fa7780b5040 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 >> v1:172.21.15.88:6789/0 conn(0x7fa7780b5040 legacy=0x7fa77806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760003a00 0x7fa760003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa760004850 0x7fa760004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa760005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780cde30 con 0x7fa760003a00 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77815e590 con 0x7fa760004850 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa76000ba10 con 0x7fa77815cf20 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa777fff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760003a00 0x7fa760003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa7777fe700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa760004850 0x7fa760004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.650+0000 7fa77c99c700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa760005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 -- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 msgr2=0x7fa760005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa77815cf20 0x7fa760005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 -- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa760004850 msgr2=0x7fa760004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa760004850 0x7fa760004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 -- 172.21.15.88:0/825638042 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7600035b0 con 0x7fa760003a00 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa777fff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760003a00 0x7fa760003e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa768009b60 tx=0x7fa760005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f609b7d61902e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800e6c0 con 0x7fa760003a00 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76800e820 con 0x7fa760003a00 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.651+0000 7fa776ffd700 1 -- 172.21.15.88:0/825638042 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800eb90 con 0x7fa760003a00 2023-08-10T10:30:55.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 -- 172.21.15.88:0/825638042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760003a00 msgr2=0x7fa760003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/825638042 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa760003a00 0x7fa760003e20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa768009b60 tx=0x7fa760005880 comp rx=0 tx=0).stop 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77c99c700 1 -- 172.21.15.88:0/825638042 reap_dead start 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 -- 172.21.15.88:0/825638042 shutdown_connections 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 -- 172.21.15.88:0/825638042 >> 172.21.15.88:0/825638042 conn(0x7fa7780d3080 msgr2=0x7fa7780d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 -- 172.21.15.88:0/825638042 shutdown_connections 2023-08-10T10:30:55.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.652+0000 7fa77e3ff700 1 -- 172.21.15.88:0/825638042 wait complete. 2023-08-10T10:30:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.654+0000 7fa77e3ff700 1 Processor -- start 2023-08-10T10:30:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.654+0000 7fa77e3ff700 1 -- start start 2023-08-10T10:30:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.655+0000 7fa77e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 0x7fa7780b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780cce90 con 0x7fa7780cc4a0 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780cd260 con 0x7fa7780ca0c0 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780b73d0 con 0x7fa760003a00 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77c99c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:49918/0 (socket says 172.21.15.88:49918) 2023-08-10T10:30:55.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa7777fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 0x7fa7780b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 -- 172.21.15.88:0/495372371 learned_addr learned my addr 172.21.15.88:0/495372371 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77c99c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41208/0 (socket says 172.21.15.88:41208) 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 -- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 msgr2=0x7fa7780b6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 0x7fa7780b6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 -- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 msgr2=0x7fa7780cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa777fff700 1 -- 172.21.15.88:0/495372371 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780b76b0 con 0x7fa760003a00 2023-08-10T10:30:55.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa77c99c700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.656+0000 7fa7777fe700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 0x7fa7780b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa777fff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa760004730 tx=0x7fa7680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76800e6c0 con 0x7fa760003a00 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768003ab0 con 0x7fa760003a00 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768003e60 con 0x7fa760003a00 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7780b7990 con 0x7fa760003a00 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.657+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7780b7f50 con 0x7fa760003a00 2023-08-10T10:30:55.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.658+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7780b73d0 con 0x7fa760003a00 2023-08-10T10:30:55.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.659+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa768013470 con 0x7fa760003a00 2023-08-10T10:30:55.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.660+0000 7fa774ff9700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 0x7fa76406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:55.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.660+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa76808b260 con 0x7fa760003a00 2023-08-10T10:30:55.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.660+0000 7fa7777fe700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 0x7fa76406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:55.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.661+0000 7fa7777fe700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 0x7fa76406d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7781f38b0 tx=0x7fa76c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:55.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.665+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa7680561b0 con 0x7fa760003a00 2023-08-10T10:30:55.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:55.716 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:30:55.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.910+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa7780b2950 con 0x7fa760003a00 2023-08-10T10:30:55.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.911+0000 7fa774ff9700 1 -- 172.21.15.88:0/495372371 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7fa7680597d0 con 0x7fa760003a00 2023-08-10T10:30:55.912 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:55.913 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 msgr2=0x7fa76406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 0x7fa76406d1a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa7781f38b0 tx=0x7fa76c009210 comp rx=0 tx=0).stop 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 msgr2=0x7fa778158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa760004730 tx=0x7fa7680047c0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 shutdown_connections 2023-08-10T10:30:55.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7780cc4a0 0x7fa7780cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa76406ace0 0x7fa76406d1a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa760003a00 0x7fa778158bc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 --2- 172.21.15.88:0/495372371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7780ca0c0 0x7fa7780b6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 >> 172.21.15.88:0/495372371 conn(0x7fa7780d3080 msgr2=0x7fa77806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 shutdown_connections 2023-08-10T10:30:55.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:55.913+0000 7fa77e3ff700 1 -- 172.21.15.88:0/495372371 wait complete. 2023-08-10T10:30:55.917 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:30:55.932 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:56.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.126+0000 7f041bfff700 1 Processor -- start 2023-08-10T10:30:56.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.127+0000 7f041bfff700 1 -- start start 2023-08-10T10:30:56.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041bfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04140b8870 0x7f04140b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04140b5040 0x7f04140d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041bfff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04140b8e30 con 0x7f041415cf20 2023-08-10T10:30:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140cde30 con 0x7f04140b5040 2023-08-10T10:30:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041bfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04140b54b0 con 0x7f04140b8870 2023-08-10T10:30:56.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04140b5040 0x7f04140d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041a59c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f04140b5040 0x7f04140d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41214/0 (socket says 172.21.15.88:41214) 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041a59c700 1 -- 172.21.15.88:0/2280668112 learned_addr learned my addr 172.21.15.88:0/2280668112 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.128+0000 7f041959a700 1 --2- 172.21.15.88:0/2280668112 >> v2:172.21.15.187:3300/0 conn(0x7f04140b8870 0x7f04140b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f041a59c700 1 -- 172.21.15.88:0/2280668112 >> v2:172.21.15.187:3300/0 conn(0x7f04140b8870 msgr2=0x7f04140b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f041a59c700 1 --2- 172.21.15.88:0/2280668112 >> v2:172.21.15.187:3300/0 conn(0x7f04140b8870 0x7f04140b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f041a59c700 1 -- 172.21.15.88:0/2280668112 >> v1:172.21.15.187:6789/0 conn(0x7f041415cf20 legacy=0x7f041415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f041a59c700 1 -- 172.21.15.88:0/2280668112 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04140ce010 con 0x7f04140b5040 2023-08-10T10:30:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f041a59c700 1 --2- 172.21.15.88:0/2280668112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04140b5040 0x7f04140d1350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04140d2950 tx=0x7f040c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f487de2eb5fc138d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f0418d99700 1 -- 172.21.15.88:0/2280668112 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00e070 con 0x7f04140b5040 2023-08-10T10:30:56.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f0418d99700 1 -- 172.21.15.88:0/2280668112 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c00b8d0 con 0x7f04140b5040 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.129+0000 7f0418d99700 1 -- 172.21.15.88:0/2280668112 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c00bc80 con 0x7f04140b5040 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 -- 172.21.15.88:0/2280668112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04140b5040 msgr2=0x7f04140d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 --2- 172.21.15.88:0/2280668112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04140b5040 0x7f04140d1350 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f04140d2950 tx=0x7f040c00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 -- 172.21.15.88:0/2280668112 shutdown_connections 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 --2- 172.21.15.88:0/2280668112 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f04140b5040 0x7f04140d1350 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 --2- 172.21.15.88:0/2280668112 >> v2:172.21.15.187:3300/0 conn(0x7f04140b8870 0x7f04140b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 -- 172.21.15.88:0/2280668112 >> 172.21.15.88:0/2280668112 conn(0x7f04140d3080 msgr2=0x7f04140d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 -- 172.21.15.88:0/2280668112 shutdown_connections 2023-08-10T10:30:56.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.130+0000 7f041bfff700 1 -- 172.21.15.88:0/2280668112 wait complete. 2023-08-10T10:30:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.131+0000 7f041bfff700 1 Processor -- start 2023-08-10T10:30:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 -- start start 2023-08-10T10:30:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 0x7f0414154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04140b8870 0x7f04140b7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04140cb060 con 0x7f041415cf20 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0414155350 con 0x7f04140b8870 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.132+0000 7f041bfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04140b6f90 con 0x7f04140b5040 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41224/0 (socket says 172.21.15.88:41224) 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 -- 172.21.15.88:0/2692124786 learned_addr learned my addr 172.21.15.88:0/2692124786 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041959a700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04140b8870 0x7f04140b7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f0419d9b700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 0x7f0414154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 -- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 msgr2=0x7f0414154e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 0x7f0414154e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 -- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04140b8870 msgr2=0x7f04140b7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04140b8870 0x7f04140b7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 -- 172.21.15.88:0/2692124786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040c009b30 con 0x7f041415cf20 2023-08-10T10:30:56.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f0419d9b700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 0x7f0414154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f041a59c700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04140b5970 tx=0x7f040c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.133+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c0048b0 con 0x7f041415cf20 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.134+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f040c0092e0 con 0x7f041415cf20 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.134+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04140b7270 con 0x7f041415cf20 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.134+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f040c01c680 con 0x7f041415cf20 2023-08-10T10:30:56.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.134+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04140b7830 con 0x7f041415cf20 2023-08-10T10:30:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.134+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f041404ecc0 con 0x7f041415cf20 2023-08-10T10:30:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.136+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f040c01c7e0 con 0x7f041415cf20 2023-08-10T10:30:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.136+0000 7f040a7fc700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 0x7f03f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.137+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f040c08b3c0 con 0x7f041415cf20 2023-08-10T10:30:56.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.137+0000 7f0419d9b700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 0x7f03f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.137+0000 7f0419d9b700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 0x7f03f806d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04100016e0 tx=0x7f0410009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.141+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f040c056170 con 0x7f041415cf20 2023-08-10T10:30:56.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.340+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04140d17f0 con 0x7f041415cf20 2023-08-10T10:30:56.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.341+0000 7f040a7fc700 1 -- 172.21.15.88:0/2692124786 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f040c059790 con 0x7f041415cf20 2023-08-10T10:30:56.343 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:56.343 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:56.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.343+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 msgr2=0x7f03f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.343+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 0x7f03f806d1a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f04100016e0 tx=0x7f0410009040 comp rx=0 tx=0).stop 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.343+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 msgr2=0x7f04140c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.343+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04140b5970 tx=0x7f040c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 shutdown_connections 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f041415cf20 0x7f04140c8ac0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03f806ace0 0x7f03f806d1a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04140b5040 0x7f0414154e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 --2- 172.21.15.88:0/2692124786 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04140b8870 0x7f04140b7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 >> 172.21.15.88:0/2692124786 conn(0x7f04140d3080 msgr2=0x7f04140d2100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 shutdown_connections 2023-08-10T10:30:56.347 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.344+0000 7f041bfff700 1 -- 172.21.15.88:0/2692124786 wait complete. 2023-08-10T10:30:56.364 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-10T10:30:56.364 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:30:56.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.561+0000 7fcf293ff700 1 Processor -- start 2023-08-10T10:30:56.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.561+0000 7fcf293ff700 1 -- start start 2023-08-10T10:30:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.562+0000 7fcf293ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b8870 0x7fcf240b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.562+0000 7fcf293ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf240b5040 0x7fcf240d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.562+0000 7fcf293ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf240b5480 con 0x7fcf2415cf20 2023-08-10T10:30:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.562+0000 7fcf293ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf240cde30 con 0x7fcf240b5040 2023-08-10T10:30:56.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.562+0000 7fcf293ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf240b8e30 con 0x7fcf240b8870 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf240b5040 0x7fcf240d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcf240b5040 0x7fcf240d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41228/0 (socket says 172.21.15.88:41228) 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 -- 172.21.15.88:0/1461687149 learned_addr learned my addr 172.21.15.88:0/1461687149 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf227fc700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b8870 0x7fcf240b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 -- 172.21.15.88:0/1461687149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b8870 msgr2=0x7fcf240b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b8870 0x7fcf240b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 -- 172.21.15.88:0/1461687149 >> v1:172.21.15.187:6789/0 conn(0x7fcf2415cf20 legacy=0x7fcf2415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 -- 172.21.15.88:0/1461687149 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf240ce010 con 0x7fcf240b5040 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf21ffb700 1 -- 172.21.15.88:0/1461687149 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250282166 0 0) 0x7fcf240b5480 con 0x7fcf2415cf20 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.563+0000 7fcf237fe700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf240b5040 0x7fcf240d1350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009e50 tx=0x7fcf1c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e08a5e71b721c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf21ffb700 1 -- 172.21.15.88:0/1461687149 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00e070 con 0x7fcf240b5040 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf21ffb700 1 -- 172.21.15.88:0/1461687149 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c00b910 con 0x7fcf240b5040 2023-08-10T10:30:56.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf21ffb700 1 -- 172.21.15.88:0/1461687149 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00bcc0 con 0x7fcf240b5040 2023-08-10T10:30:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 -- 172.21.15.88:0/1461687149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf240b5040 msgr2=0x7fcf240d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf240b5040 0x7fcf240d1350 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c009e50 tx=0x7fcf1c00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 -- 172.21.15.88:0/1461687149 shutdown_connections 2023-08-10T10:30:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf240b5040 0x7fcf240d1350 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 --2- 172.21.15.88:0/1461687149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b8870 0x7fcf240b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 -- 172.21.15.88:0/1461687149 >> 172.21.15.88:0/1461687149 conn(0x7fcf240d3080 msgr2=0x7fcf240d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 -- 172.21.15.88:0/1461687149 shutdown_connections 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.564+0000 7fcf293ff700 1 -- 172.21.15.88:0/1461687149 wait complete. 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.566+0000 7fcf293ff700 1 Processor -- start 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.566+0000 7fcf293ff700 1 -- start start 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b5040 0x7fcf240cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf240b8870 0x7fcf240c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2415e8d0 con 0x7fcf2415cf20 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2415eb70 con 0x7fcf240b8870 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf293ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2415ee50 con 0x7fcf240b5040 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.567+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41238/0 (socket says 172.21.15.88:41238) 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 -- 172.21.15.88:0/3163587348 learned_addr learned my addr 172.21.15.88:0/3163587348 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:56.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf22ffd700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b5040 0x7fcf240cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf227fc700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf240b8870 0x7fcf240c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 -- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b5040 msgr2=0x7fcf240cc870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b5040 0x7fcf240cc870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 -- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf240b8870 msgr2=0x7fcf240c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf240b8870 0x7fcf240c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 -- 172.21.15.88:0/3163587348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c009b30 con 0x7fcf2415cf20 2023-08-10T10:30:56.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf237fe700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b370 tx=0x7fcf1c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c004450 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c0045d0 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2415f130 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.568+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0099b0 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.569+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf240ccdb0 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.570+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2415f5f0 con 0x7fcf2415cf20 2023-08-10T10:30:56.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.570+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf1c01c440 con 0x7fcf2415cf20 2023-08-10T10:30:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.571+0000 7fcf0b7fe700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 0x7fcf1006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.571+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fcf1c08af90 con 0x7fcf2415cf20 2023-08-10T10:30:56.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.572+0000 7fcf22ffd700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 0x7fcf1006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:56.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.572+0000 7fcf22ffd700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 0x7fcf1006d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f60 tx=0x7fcf14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:56.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.576+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf1c055d40 con 0x7fcf2415cf20 2023-08-10T10:30:56.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.767+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf240ccf70 con 0x7fcf1006ace0 2023-08-10T10:30:56.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.779+0000 7fcf0b7fe700 1 -- 172.21.15.88:0/3163587348 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367409 (secure 0 0 0) 0x7fcf14001500 con 0x7fcf1006ace0 2023-08-10T10:30:56.784 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:56.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.783+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 msgr2=0x7fcf1006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.783+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 0x7fcf1006d1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcf14000f60 tx=0x7fcf14009040 comp rx=0 tx=0).stop 2023-08-10T10:30:56.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.783+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 msgr2=0x7fcf240c87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.783+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b370 tx=0x7fcf1c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 shutdown_connections 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf2415cf20 0x7fcf240c87e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf1006ace0 0x7fcf1006d1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf240b5040 0x7fcf240cc870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 --2- 172.21.15.88:0/3163587348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf240b8870 0x7fcf240c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:56.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 >> 172.21.15.88:0/3163587348 conn(0x7fcf240d3080 msgr2=0x7fcf240d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 shutdown_connections 2023-08-10T10:30:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:56.784+0000 7fcf293ff700 1 -- 172.21.15.88:0/3163587348 wait complete. 2023-08-10T10:30:56.788 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:30:56.804 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-10T10:30:55.529935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002542"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369311+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:30:39.369311+0000","last_peered":"2023-08-10T10:30:39.369311+0000","last_clean":"2023-08-10T10:30:39.369311+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:30:39.369311+0000","last_undegraded":"2023-08-10T10:30:39.369311+0000","last_fullsized":"2023-08-10T10:30:39.369311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:15:52.847844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983931+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:30:39.983931+0000","last_peered":"2023-08-10T10:30:39.983931+0000","last_clean":"2023-08-10T10:30:39.983931+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:30:39.983931+0000","last_undegraded":"2023-08-10T10:30:39.983931+0000","last_fullsized":"2023-08-10T10:30:39.983931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371111+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:30:39.371111+0000","last_peered":"2023-08-10T10:30:39.371111+0000","last_clean":"2023-08-10T10:30:39.371111+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:30:39.371111+0000","last_undegraded":"2023-08-10T10:30:39.371111+0000","last_fullsized":"2023-08-10T10:30:39.371111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:07.275147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984157+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:30:39.984157+0000","last_peered":"2023-08-10T10:30:39.984157+0000","last_clean":"2023-08-10T10:30:39.984157+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:30:39.984157+0000","last_undegraded":"2023-08-10T10:30:39.984157+0000","last_fullsized":"2023-08-10T10:30:39.984157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:45.483566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983455+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:30:39.983455+0000","last_peered":"2023-08-10T10:30:39.983455+0000","last_clean":"2023-08-10T10:30:39.983455+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:30:39.983455+0000","last_undegraded":"2023-08-10T10:30:39.983455+0000","last_fullsized":"2023-08-10T10:30:39.983455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371199+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:30:39.371199+0000","last_peered":"2023-08-10T10:30:39.371199+0000","last_clean":"2023-08-10T10:30:39.371199+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:30:39.371199+0000","last_undegraded":"2023-08-10T10:30:39.371199+0000","last_fullsized":"2023-08-10T10:30:39.371199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:29.585173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370548+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:30:39.370548+0000","last_peered":"2023-08-10T10:30:39.370548+0000","last_clean":"2023-08-10T10:30:39.370548+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:30:39.370548+0000","last_undegraded":"2023-08-10T10:30:39.370548+0000","last_fullsized":"2023-08-10T10:30:39.370548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983193+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:30:39.983193+0000","last_peered":"2023-08-10T10:30:39.983193+0000","last_clean":"2023-08-10T10:30:39.983193+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:30:39.983193+0000","last_undegraded":"2023-08-10T10:30:39.983193+0000","last_fullsized":"2023-08-10T10:30:39.983193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982871+0000","last_change":"2023-08-10T10:30:34.342831+0000","last_active":"2023-08-10T10:30:39.982871+0000","last_peered":"2023-08-10T10:30:39.982871+0000","last_clean":"2023-08-10T10:30:39.982871+0000","last_became_active":"2023-08-10T10:30:34.341582+0000","last_became_peered":"2023-08-10T10:30:34.341582+0000","last_unstale":"2023-08-10T10:30:39.982871+0000","last_undegraded":"2023-08-10T10:30:39.982871+0000","last_fullsized":"2023-08-10T10:30:39.982871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984422+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:30:39.984422+0000","last_peered":"2023-08-10T10:30:39.984422+0000","last_clean":"2023-08-10T10:30:39.984422+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:30:39.984422+0000","last_undegraded":"2023-08-10T10:30:39.984422+0000","last_fullsized":"2023-08-10T10:30:39.984422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370892+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:30:39.370892+0000","last_peered":"2023-08-10T10:30:39.370892+0000","last_clean":"2023-08-10T10:30:39.370892+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:30:39.370892+0000","last_undegraded":"2023-08-10T10:30:39.370892+0000","last_fullsized":"2023-08-10T10:30:39.370892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:25.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369176+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:30:39.369176+0000","last_peered":"2023-08-10T10:30:39.369176+0000","last_clean":"2023-08-10T10:30:39.369176+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:30:39.369176+0000","last_undegraded":"2023-08-10T10:30:39.369176+0000","last_fullsized":"2023-08-10T10:30:39.369176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:21.255854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369378+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:30:39.369378+0000","last_peered":"2023-08-10T10:30:39.369378+0000","last_clean":"2023-08-10T10:30:39.369378+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:30:39.369378+0000","last_undegraded":"2023-08-10T10:30:39.369378+0000","last_fullsized":"2023-08-10T10:30:39.369378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:14.864006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983136+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:30:39.983136+0000","last_peered":"2023-08-10T10:30:39.983136+0000","last_clean":"2023-08-10T10:30:39.983136+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:30:39.983136+0000","last_undegraded":"2023-08-10T10:30:39.983136+0000","last_fullsized":"2023-08-10T10:30:39.983136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369966+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:30:39.369966+0000","last_peered":"2023-08-10T10:30:39.369966+0000","last_clean":"2023-08-10T10:30:39.369966+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:30:39.369966+0000","last_undegraded":"2023-08-10T10:30:39.369966+0000","last_fullsized":"2023-08-10T10:30:39.369966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370894+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:30:39.370894+0000","last_peered":"2023-08-10T10:30:39.370894+0000","last_clean":"2023-08-10T10:30:39.370894+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:30:39.370894+0000","last_undegraded":"2023-08-10T10:30:39.370894+0000","last_fullsized":"2023-08-10T10:30:39.370894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982953+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:30:39.982953+0000","last_peered":"2023-08-10T10:30:39.982953+0000","last_clean":"2023-08-10T10:30:39.982953+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:30:39.982953+0000","last_undegraded":"2023-08-10T10:30:39.982953+0000","last_fullsized":"2023-08-10T10:30:39.982953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370539+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:30:39.370539+0000","last_peered":"2023-08-10T10:30:39.370539+0000","last_clean":"2023-08-10T10:30:39.370539+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:30:39.370539+0000","last_undegraded":"2023-08-10T10:30:39.370539+0000","last_fullsized":"2023-08-10T10:30:39.370539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:56.660087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369083+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:30:39.369083+0000","last_peered":"2023-08-10T10:30:39.369083+0000","last_clean":"2023-08-10T10:30:39.369083+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:30:39.369083+0000","last_undegraded":"2023-08-10T10:30:39.369083+0000","last_fullsized":"2023-08-10T10:30:39.369083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:22.279579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371337+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:30:39.371337+0000","last_peered":"2023-08-10T10:30:39.371337+0000","last_clean":"2023-08-10T10:30:39.371337+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:30:39.371337+0000","last_undegraded":"2023-08-10T10:30:39.371337+0000","last_fullsized":"2023-08-10T10:30:39.371337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370272+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:30:39.370272+0000","last_peered":"2023-08-10T10:30:39.370272+0000","last_clean":"2023-08-10T10:30:39.370272+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:30:39.370272+0000","last_undegraded":"2023-08-10T10:30:39.370272+0000","last_fullsized":"2023-08-10T10:30:39.370272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982720+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:30:39.982720+0000","last_peered":"2023-08-10T10:30:39.982720+0000","last_clean":"2023-08-10T10:30:39.982720+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:30:39.982720+0000","last_undegraded":"2023-08-10T10:30:39.982720+0000","last_fullsized":"2023-08-10T10:30:39.982720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983043+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:30:39.983043+0000","last_peered":"2023-08-10T10:30:39.983043+0000","last_clean":"2023-08-10T10:30:39.983043+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:30:39.983043+0000","last_undegraded":"2023-08-10T10:30:39.983043+0000","last_fullsized":"2023-08-10T10:30:39.983043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370537+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:30:39.370537+0000","last_peered":"2023-08-10T10:30:39.370537+0000","last_clean":"2023-08-10T10:30:39.370537+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:30:39.370537+0000","last_undegraded":"2023-08-10T10:30:39.370537+0000","last_fullsized":"2023-08-10T10:30:39.370537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872983+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:30:39.872983+0000","last_peered":"2023-08-10T10:30:39.872983+0000","last_clean":"2023-08-10T10:30:39.872983+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:30:39.872983+0000","last_undegraded":"2023-08-10T10:30:39.872983+0000","last_fullsized":"2023-08-10T10:30:39.872983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873160+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:30:39.873160+0000","last_peered":"2023-08-10T10:30:39.873160+0000","last_clean":"2023-08-10T10:30:39.873160+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:30:39.873160+0000","last_undegraded":"2023-08-10T10:30:39.873160+0000","last_fullsized":"2023-08-10T10:30:39.873160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984432+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:30:39.984432+0000","last_peered":"2023-08-10T10:30:39.984432+0000","last_clean":"2023-08-10T10:30:39.984432+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:30:39.984432+0000","last_undegraded":"2023-08-10T10:30:39.984432+0000","last_fullsized":"2023-08-10T10:30:39.984432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371835+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:30:39.371835+0000","last_peered":"2023-08-10T10:30:39.371835+0000","last_clean":"2023-08-10T10:30:39.371835+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:30:39.371835+0000","last_undegraded":"2023-08-10T10:30:39.371835+0000","last_fullsized":"2023-08-10T10:30:39.371835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:03.982064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370925+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:30:39.370925+0000","last_peered":"2023-08-10T10:30:39.370925+0000","last_clean":"2023-08-10T10:30:39.370925+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:30:39.370925+0000","last_undegraded":"2023-08-10T10:30:39.370925+0000","last_fullsized":"2023-08-10T10:30:39.370925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:32.438438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983791+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:30:39.983791+0000","last_peered":"2023-08-10T10:30:39.983791+0000","last_clean":"2023-08-10T10:30:39.983791+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:30:39.983791+0000","last_undegraded":"2023-08-10T10:30:39.983791+0000","last_fullsized":"2023-08-10T10:30:39.983791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983622+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:30:39.983622+0000","last_peered":"2023-08-10T10:30:39.983622+0000","last_clean":"2023-08-10T10:30:39.983622+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:30:39.983622+0000","last_undegraded":"2023-08-10T10:30:39.983622+0000","last_fullsized":"2023-08-10T10:30:39.983622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:07.717850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872457+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:30:39.872457+0000","last_peered":"2023-08-10T10:30:39.872457+0000","last_clean":"2023-08-10T10:30:39.872457+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:30:39.872457+0000","last_undegraded":"2023-08-10T10:30:39.872457+0000","last_fullsized":"2023-08-10T10:30:39.872457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:40.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983295+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:30:39.983295+0000","last_peered":"2023-08-10T10:30:39.983295+0000","last_clean":"2023-08-10T10:30:39.983295+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:30:39.983295+0000","last_undegraded":"2023-08-10T10:30:39.983295+0000","last_fullsized":"2023-08-10T10:30:39.983295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983451+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:30:39.983451+0000","last_peered":"2023-08-10T10:30:39.983451+0000","last_clean":"2023-08-10T10:30:39.983451+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:30:39.983451+0000","last_undegraded":"2023-08-10T10:30:39.983451+0000","last_fullsized":"2023-08-10T10:30:39.983451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:25.693202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983147+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:30:39.983147+0000","last_peered":"2023-08-10T10:30:39.983147+0000","last_clean":"2023-08-10T10:30:39.983147+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:30:39.983147+0000","last_undegraded":"2023-08-10T10:30:39.983147+0000","last_fullsized":"2023-08-10T10:30:39.983147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983947+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:30:39.983947+0000","last_peered":"2023-08-10T10:30:39.983947+0000","last_clean":"2023-08-10T10:30:39.983947+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:30:39.983947+0000","last_undegraded":"2023-08-10T10:30:39.983947+0000","last_fullsized":"2023-08-10T10:30:39.983947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:18.306807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983456+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:30:39.983456+0000","last_peered":"2023-08-10T10:30:39.983456+0000","last_clean":"2023-08-10T10:30:39.983456+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:30:39.983456+0000","last_undegraded":"2023-08-10T10:30:39.983456+0000","last_fullsized":"2023-08-10T10:30:39.983456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:22.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983003+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:30:39.983003+0000","last_peered":"2023-08-10T10:30:39.983003+0000","last_clean":"2023-08-10T10:30:39.983003+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:30:39.983003+0000","last_undegraded":"2023-08-10T10:30:39.983003+0000","last_fullsized":"2023-08-10T10:30:39.983003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983092+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:30:39.983092+0000","last_peered":"2023-08-10T10:30:39.983092+0000","last_clean":"2023-08-10T10:30:39.983092+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:30:39.983092+0000","last_undegraded":"2023-08-10T10:30:39.983092+0000","last_fullsized":"2023-08-10T10:30:39.983092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369849+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:30:39.369849+0000","last_peered":"2023-08-10T10:30:39.369849+0000","last_clean":"2023-08-10T10:30:39.369849+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:30:39.369849+0000","last_undegraded":"2023-08-10T10:30:39.369849+0000","last_fullsized":"2023-08-10T10:30:39.369849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984181+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:30:39.984181+0000","last_peered":"2023-08-10T10:30:39.984181+0000","last_clean":"2023-08-10T10:30:39.984181+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:30:39.984181+0000","last_undegraded":"2023-08-10T10:30:39.984181+0000","last_fullsized":"2023-08-10T10:30:39.984181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983153+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:30:39.983153+0000","last_peered":"2023-08-10T10:30:39.983153+0000","last_clean":"2023-08-10T10:30:39.983153+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:30:39.983153+0000","last_undegraded":"2023-08-10T10:30:39.983153+0000","last_fullsized":"2023-08-10T10:30:39.983153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984063+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:30:39.984063+0000","last_peered":"2023-08-10T10:30:39.984063+0000","last_clean":"2023-08-10T10:30:39.984063+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:30:39.984063+0000","last_undegraded":"2023-08-10T10:30:39.984063+0000","last_fullsized":"2023-08-10T10:30:39.984063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371870+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:30:39.371870+0000","last_peered":"2023-08-10T10:30:39.371870+0000","last_clean":"2023-08-10T10:30:39.371870+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:30:39.371870+0000","last_undegraded":"2023-08-10T10:30:39.371870+0000","last_fullsized":"2023-08-10T10:30:39.371870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:45.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872782+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:30:39.872782+0000","last_peered":"2023-08-10T10:30:39.872782+0000","last_clean":"2023-08-10T10:30:39.872782+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:30:39.872782+0000","last_undegraded":"2023-08-10T10:30:39.872782+0000","last_fullsized":"2023-08-10T10:30:39.872782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872553+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:30:39.872553+0000","last_peered":"2023-08-10T10:30:39.872553+0000","last_clean":"2023-08-10T10:30:39.872553+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:30:39.872553+0000","last_undegraded":"2023-08-10T10:30:39.872553+0000","last_fullsized":"2023-08-10T10:30:39.872553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:24.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:52.633741+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:30:52.633741+0000","last_peered":"2023-08-10T10:30:52.633741+0000","last_clean":"2023-08-10T10:30:52.633741+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:30:52.633741+0000","last_undegraded":"2023-08-10T10:30:52.633741+0000","last_fullsized":"2023-08-10T10:30:52.633741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:37.081141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371788+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:30:39.371788+0000","last_peered":"2023-08-10T10:30:39.371788+0000","last_clean":"2023-08-10T10:30:39.371788+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:30:39.371788+0000","last_undegraded":"2023-08-10T10:30:39.371788+0000","last_fullsized":"2023-08-10T10:30:39.371788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:24.614492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984518+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:30:39.984518+0000","last_peered":"2023-08-10T10:30:39.984518+0000","last_clean":"2023-08-10T10:30:39.984518+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:30:39.984518+0000","last_undegraded":"2023-08-10T10:30:39.984518+0000","last_fullsized":"2023-08-10T10:30:39.984518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370136+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:30:39.370136+0000","last_peered":"2023-08-10T10:30:39.370136+0000","last_clean":"2023-08-10T10:30:39.370136+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:30:39.370136+0000","last_undegraded":"2023-08-10T10:30:39.370136+0000","last_fullsized":"2023-08-10T10:30:39.370136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984177+0000","last_change":"2023-08-10T10:30:34.333045+0000","last_active":"2023-08-10T10:30:39.984177+0000","last_peered":"2023-08-10T10:30:39.984177+0000","last_clean":"2023-08-10T10:30:39.984177+0000","last_became_active":"2023-08-10T10:30:34.332756+0000","last_became_peered":"2023-08-10T10:30:34.332756+0000","last_unstale":"2023-08-10T10:30:39.984177+0000","last_undegraded":"2023-08-10T10:30:39.984177+0000","last_fullsized":"2023-08-10T10:30:39.984177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:28.964743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984070+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:30:39.984070+0000","last_peered":"2023-08-10T10:30:39.984070+0000","last_clean":"2023-08-10T10:30:39.984070+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:30:39.984070+0000","last_undegraded":"2023-08-10T10:30:39.984070+0000","last_fullsized":"2023-08-10T10:30:39.984070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982553+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:30:39.982553+0000","last_peered":"2023-08-10T10:30:39.982553+0000","last_clean":"2023-08-10T10:30:39.982553+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:30:39.982553+0000","last_undegraded":"2023-08-10T10:30:39.982553+0000","last_fullsized":"2023-08-10T10:30:39.982553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:12.238493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984332+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:30:39.984332+0000","last_peered":"2023-08-10T10:30:39.984332+0000","last_clean":"2023-08-10T10:30:39.984332+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:30:39.984332+0000","last_undegraded":"2023-08-10T10:30:39.984332+0000","last_fullsized":"2023-08-10T10:30:39.984332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:30:39.983925+0000","last_peered":"2023-08-10T10:30:39.983925+0000","last_clean":"2023-08-10T10:30:39.983925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:30:39.983925+0000","last_undegraded":"2023-08-10T10:30:39.983925+0000","last_fullsized":"2023-08-10T10:30:39.983925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370418+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:30:39.370418+0000","last_peered":"2023-08-10T10:30:39.370418+0000","last_clean":"2023-08-10T10:30:39.370418+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.370418+0000","last_undegraded":"2023-08-10T10:30:39.370418+0000","last_fullsized":"2023-08-10T10:30:39.370418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983299+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:30:39.983299+0000","last_peered":"2023-08-10T10:30:39.983299+0000","last_clean":"2023-08-10T10:30:39.983299+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:30:39.983299+0000","last_undegraded":"2023-08-10T10:30:39.983299+0000","last_fullsized":"2023-08-10T10:30:39.983299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:25.632086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983777+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:30:39.983777+0000","last_peered":"2023-08-10T10:30:39.983777+0000","last_clean":"2023-08-10T10:30:39.983777+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:30:39.983777+0000","last_undegraded":"2023-08-10T10:30:39.983777+0000","last_fullsized":"2023-08-10T10:30:39.983777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983006+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:30:39.983006+0000","last_peered":"2023-08-10T10:30:39.983006+0000","last_clean":"2023-08-10T10:30:39.983006+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:30:39.983006+0000","last_undegraded":"2023-08-10T10:30:39.983006+0000","last_fullsized":"2023-08-10T10:30:39.983006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:25.545777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984046+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:30:39.984046+0000","last_peered":"2023-08-10T10:30:39.984046+0000","last_clean":"2023-08-10T10:30:39.984046+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:30:39.984046+0000","last_undegraded":"2023-08-10T10:30:39.984046+0000","last_fullsized":"2023-08-10T10:30:39.984046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:12.376679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371191+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:30:39.371191+0000","last_peered":"2023-08-10T10:30:39.371191+0000","last_clean":"2023-08-10T10:30:39.371191+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:30:39.371191+0000","last_undegraded":"2023-08-10T10:30:39.371191+0000","last_fullsized":"2023-08-10T10:30:39.371191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:53.760062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371171+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:30:39.371171+0000","last_peered":"2023-08-10T10:30:39.371171+0000","last_clean":"2023-08-10T10:30:39.371171+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.371171+0000","last_undegraded":"2023-08-10T10:30:39.371171+0000","last_fullsized":"2023-08-10T10:30:39.371171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:34.188865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983055+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:30:39.983055+0000","last_peered":"2023-08-10T10:30:39.983055+0000","last_clean":"2023-08-10T10:30:39.983055+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:30:39.983055+0000","last_undegraded":"2023-08-10T10:30:39.983055+0000","last_fullsized":"2023-08-10T10:30:39.983055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:13.245170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368831+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:30:39.368831+0000","last_peered":"2023-08-10T10:30:39.368831+0000","last_clean":"2023-08-10T10:30:39.368831+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:30:39.368831+0000","last_undegraded":"2023-08-10T10:30:39.368831+0000","last_fullsized":"2023-08-10T10:30:39.368831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:29.757505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370481+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:30:39.370481+0000","last_peered":"2023-08-10T10:30:39.370481+0000","last_clean":"2023-08-10T10:30:39.370481+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:30:39.370481+0000","last_undegraded":"2023-08-10T10:30:39.370481+0000","last_fullsized":"2023-08-10T10:30:39.370481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371233+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:30:39.371233+0000","last_peered":"2023-08-10T10:30:39.371233+0000","last_clean":"2023-08-10T10:30:39.371233+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:30:39.371233+0000","last_undegraded":"2023-08-10T10:30:39.371233+0000","last_fullsized":"2023-08-10T10:30:39.371233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:49.770265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369037+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:30:39.369037+0000","last_peered":"2023-08-10T10:30:39.369037+0000","last_clean":"2023-08-10T10:30:39.369037+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:30:39.369037+0000","last_undegraded":"2023-08-10T10:30:39.369037+0000","last_fullsized":"2023-08-10T10:30:39.369037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:31.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371929+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:30:39.371929+0000","last_peered":"2023-08-10T10:30:39.371929+0000","last_clean":"2023-08-10T10:30:39.371929+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:30:39.371929+0000","last_undegraded":"2023-08-10T10:30:39.371929+0000","last_fullsized":"2023-08-10T10:30:39.371929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:07.689076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983438+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:30:39.983438+0000","last_peered":"2023-08-10T10:30:39.983438+0000","last_clean":"2023-08-10T10:30:39.983438+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:30:39.983438+0000","last_undegraded":"2023-08-10T10:30:39.983438+0000","last_fullsized":"2023-08-10T10:30:39.983438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:28:12.535150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369073+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:30:39.369073+0000","last_peered":"2023-08-10T10:30:39.369073+0000","last_clean":"2023-08-10T10:30:39.369073+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:30:39.369073+0000","last_undegraded":"2023-08-10T10:30:39.369073+0000","last_fullsized":"2023-08-10T10:30:39.369073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:39.562819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983698+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:30:39.983698+0000","last_peered":"2023-08-10T10:30:39.983698+0000","last_clean":"2023-08-10T10:30:39.983698+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:30:39.983698+0000","last_undegraded":"2023-08-10T10:30:39.983698+0000","last_fullsized":"2023-08-10T10:30:39.983698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983097+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:30:39.983097+0000","last_peered":"2023-08-10T10:30:39.983097+0000","last_clean":"2023-08-10T10:30:39.983097+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:30:39.983097+0000","last_undegraded":"2023-08-10T10:30:39.983097+0000","last_fullsized":"2023-08-10T10:30:39.983097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369182+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:30:39.369182+0000","last_peered":"2023-08-10T10:30:39.369182+0000","last_clean":"2023-08-10T10:30:39.369182+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:30:39.369182+0000","last_undegraded":"2023-08-10T10:30:39.369182+0000","last_fullsized":"2023-08-10T10:30:39.369182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:12.307358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983784+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:30:39.983784+0000","last_peered":"2023-08-10T10:30:39.983784+0000","last_clean":"2023-08-10T10:30:39.983784+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:30:39.983784+0000","last_undegraded":"2023-08-10T10:30:39.983784+0000","last_fullsized":"2023-08-10T10:30:39.983784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:20.631743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371024+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:30:39.371024+0000","last_peered":"2023-08-10T10:30:39.371024+0000","last_clean":"2023-08-10T10:30:39.371024+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:30:39.371024+0000","last_undegraded":"2023-08-10T10:30:39.371024+0000","last_fullsized":"2023-08-10T10:30:39.371024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:42.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872669+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:30:39.872669+0000","last_peered":"2023-08-10T10:30:39.872669+0000","last_clean":"2023-08-10T10:30:39.872669+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:30:39.872669+0000","last_undegraded":"2023-08-10T10:30:39.872669+0000","last_fullsized":"2023-08-10T10:30:39.872669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:17.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983630+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:30:39.983630+0000","last_peered":"2023-08-10T10:30:39.983630+0000","last_clean":"2023-08-10T10:30:39.983630+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:30:39.983630+0000","last_undegraded":"2023-08-10T10:30:39.983630+0000","last_fullsized":"2023-08-10T10:30:39.983630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:25.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370188+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:30:39.370188+0000","last_peered":"2023-08-10T10:30:39.370188+0000","last_clean":"2023-08-10T10:30:39.370188+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:30:39.370188+0000","last_undegraded":"2023-08-10T10:30:39.370188+0000","last_fullsized":"2023-08-10T10:30:39.370188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:46.308677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983978+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:30:39.983978+0000","last_peered":"2023-08-10T10:30:39.983978+0000","last_clean":"2023-08-10T10:30:39.983978+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:30:39.983978+0000","last_undegraded":"2023-08-10T10:30:39.983978+0000","last_fullsized":"2023-08-10T10:30:39.983978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:54.599910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370824+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:30:39.370824+0000","last_peered":"2023-08-10T10:30:39.370824+0000","last_clean":"2023-08-10T10:30:39.370824+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:30:39.370824+0000","last_undegraded":"2023-08-10T10:30:39.370824+0000","last_fullsized":"2023-08-10T10:30:39.370824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:45.246627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370711+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:30:39.370711+0000","last_peered":"2023-08-10T10:30:39.370711+0000","last_clean":"2023-08-10T10:30:39.370711+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:30:39.370711+0000","last_undegraded":"2023-08-10T10:30:39.370711+0000","last_fullsized":"2023-08-10T10:30:39.370711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370373+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:30:39.370373+0000","last_peered":"2023-08-10T10:30:39.370373+0000","last_clean":"2023-08-10T10:30:39.370373+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:30:39.370373+0000","last_undegraded":"2023-08-10T10:30:39.370373+0000","last_fullsized":"2023-08-10T10:30:39.370373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982981+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:30:39.982981+0000","last_peered":"2023-08-10T10:30:39.982981+0000","last_clean":"2023-08-10T10:30:39.982981+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:30:39.982981+0000","last_undegraded":"2023-08-10T10:30:39.982981+0000","last_fullsized":"2023-08-10T10:30:39.982981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873270+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:30:39.873270+0000","last_peered":"2023-08-10T10:30:39.873270+0000","last_clean":"2023-08-10T10:30:39.873270+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:30:39.873270+0000","last_undegraded":"2023-08-10T10:30:39.873270+0000","last_fullsized":"2023-08-10T10:30:39.873270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982968+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:30:39.982968+0000","last_peered":"2023-08-10T10:30:39.982968+0000","last_clean":"2023-08-10T10:30:39.982968+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:30:39.982968+0000","last_undegraded":"2023-08-10T10:30:39.982968+0000","last_fullsized":"2023-08-10T10:30:39.982968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872875+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:30:39.872875+0000","last_peered":"2023-08-10T10:30:39.872875+0000","last_clean":"2023-08-10T10:30:39.872875+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:30:39.872875+0000","last_undegraded":"2023-08-10T10:30:39.872875+0000","last_fullsized":"2023-08-10T10:30:39.872875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984191+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:30:39.984191+0000","last_peered":"2023-08-10T10:30:39.984191+0000","last_clean":"2023-08-10T10:30:39.984191+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:30:39.984191+0000","last_undegraded":"2023-08-10T10:30:39.984191+0000","last_fullsized":"2023-08-10T10:30:39.984191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872443+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:30:39.872443+0000","last_peered":"2023-08-10T10:30:39.872443+0000","last_clean":"2023-08-10T10:30:39.872443+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:30:39.872443+0000","last_undegraded":"2023-08-10T10:30:39.872443+0000","last_fullsized":"2023-08-10T10:30:39.872443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:22.886580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982829+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:30:39.982829+0000","last_peered":"2023-08-10T10:30:39.982829+0000","last_clean":"2023-08-10T10:30:39.982829+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:30:39.982829+0000","last_undegraded":"2023-08-10T10:30:39.982829+0000","last_fullsized":"2023-08-10T10:30:39.982829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983219+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:30:39.983219+0000","last_peered":"2023-08-10T10:30:39.983219+0000","last_clean":"2023-08-10T10:30:39.983219+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:30:39.983219+0000","last_undegraded":"2023-08-10T10:30:39.983219+0000","last_fullsized":"2023-08-10T10:30:39.983219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:00.831050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371933+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:30:39.371933+0000","last_peered":"2023-08-10T10:30:39.371933+0000","last_clean":"2023-08-10T10:30:39.371933+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:30:39.371933+0000","last_undegraded":"2023-08-10T10:30:39.371933+0000","last_fullsized":"2023-08-10T10:30:39.371933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:13.886565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872839+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:30:39.872839+0000","last_peered":"2023-08-10T10:30:39.872839+0000","last_clean":"2023-08-10T10:30:39.872839+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:30:39.872839+0000","last_undegraded":"2023-08-10T10:30:39.872839+0000","last_fullsized":"2023-08-10T10:30:39.872839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369614+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:30:39.369614+0000","last_peered":"2023-08-10T10:30:39.369614+0000","last_clean":"2023-08-10T10:30:39.369614+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:30:39.369614+0000","last_undegraded":"2023-08-10T10:30:39.369614+0000","last_fullsized":"2023-08-10T10:30:39.369614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:31.264771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368880+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:30:39.368880+0000","last_peered":"2023-08-10T10:30:39.368880+0000","last_clean":"2023-08-10T10:30:39.368880+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:30:39.368880+0000","last_undegraded":"2023-08-10T10:30:39.368880+0000","last_fullsized":"2023-08-10T10:30:39.368880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.879507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872450+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:30:39.872450+0000","last_peered":"2023-08-10T10:30:39.872450+0000","last_clean":"2023-08-10T10:30:39.872450+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:30:39.872450+0000","last_undegraded":"2023-08-10T10:30:39.872450+0000","last_fullsized":"2023-08-10T10:30:39.872450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:27.225030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873190+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:30:39.873190+0000","last_peered":"2023-08-10T10:30:39.873190+0000","last_clean":"2023-08-10T10:30:39.873190+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:30:39.873190+0000","last_undegraded":"2023-08-10T10:30:39.873190+0000","last_fullsized":"2023-08-10T10:30:39.873190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370168+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:30:39.370168+0000","last_peered":"2023-08-10T10:30:39.370168+0000","last_clean":"2023-08-10T10:30:39.370168+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:30:39.370168+0000","last_undegraded":"2023-08-10T10:30:39.370168+0000","last_fullsized":"2023-08-10T10:30:39.370168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:08.726944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983289+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:30:39.983289+0000","last_peered":"2023-08-10T10:30:39.983289+0000","last_clean":"2023-08-10T10:30:39.983289+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:30:39.983289+0000","last_undegraded":"2023-08-10T10:30:39.983289+0000","last_fullsized":"2023-08-10T10:30:39.983289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370088+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:30:39.370088+0000","last_peered":"2023-08-10T10:30:39.370088+0000","last_clean":"2023-08-10T10:30:39.370088+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:30:39.370088+0000","last_undegraded":"2023-08-10T10:30:39.370088+0000","last_fullsized":"2023-08-10T10:30:39.370088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:57.539627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983688+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:30:39.983688+0000","last_peered":"2023-08-10T10:30:39.983688+0000","last_clean":"2023-08-10T10:30:39.983688+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:30:39.983688+0000","last_undegraded":"2023-08-10T10:30:39.983688+0000","last_fullsized":"2023-08-10T10:30:39.983688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983836+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:30:39.983836+0000","last_peered":"2023-08-10T10:30:39.983836+0000","last_clean":"2023-08-10T10:30:39.983836+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:30:39.983836+0000","last_undegraded":"2023-08-10T10:30:39.983836+0000","last_fullsized":"2023-08-10T10:30:39.983836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:55.787159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983619+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:30:39.983619+0000","last_peered":"2023-08-10T10:30:39.983619+0000","last_clean":"2023-08-10T10:30:39.983619+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:30:39.983619+0000","last_undegraded":"2023-08-10T10:30:39.983619+0000","last_fullsized":"2023-08-10T10:30:39.983619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370678+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:30:39.370678+0000","last_peered":"2023-08-10T10:30:39.370678+0000","last_clean":"2023-08-10T10:30:39.370678+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:30:39.370678+0000","last_undegraded":"2023-08-10T10:30:39.370678+0000","last_fullsized":"2023-08-10T10:30:39.370678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982478+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:30:39.982478+0000","last_peered":"2023-08-10T10:30:39.982478+0000","last_clean":"2023-08-10T10:30:39.982478+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:30:39.982478+0000","last_undegraded":"2023-08-10T10:30:39.982478+0000","last_fullsized":"2023-08-10T10:30:39.982478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:02.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982630+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:30:39.982630+0000","last_peered":"2023-08-10T10:30:39.982630+0000","last_clean":"2023-08-10T10:30:39.982630+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:30:39.982630+0000","last_undegraded":"2023-08-10T10:30:39.982630+0000","last_fullsized":"2023-08-10T10:30:39.982630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984052+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:30:39.984052+0000","last_peered":"2023-08-10T10:30:39.984052+0000","last_clean":"2023-08-10T10:30:39.984052+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:30:39.984052+0000","last_undegraded":"2023-08-10T10:30:39.984052+0000","last_fullsized":"2023-08-10T10:30:39.984052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:59.078823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371781+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:30:39.371781+0000","last_peered":"2023-08-10T10:30:39.371781+0000","last_clean":"2023-08-10T10:30:39.371781+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:30:39.371781+0000","last_undegraded":"2023-08-10T10:30:39.371781+0000","last_fullsized":"2023-08-10T10:30:39.371781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:06.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873008+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:30:39.873008+0000","last_peered":"2023-08-10T10:30:39.873008+0000","last_clean":"2023-08-10T10:30:39.873008+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:30:39.873008+0000","last_undegraded":"2023-08-10T10:30:39.873008+0000","last_fullsized":"2023-08-10T10:30:39.873008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983910+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:30:39.983910+0000","last_peered":"2023-08-10T10:30:39.983910+0000","last_clean":"2023-08-10T10:30:39.983910+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:30:39.983910+0000","last_undegraded":"2023-08-10T10:30:39.983910+0000","last_fullsized":"2023-08-10T10:30:39.983910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371390+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:30:39.371390+0000","last_peered":"2023-08-10T10:30:39.371390+0000","last_clean":"2023-08-10T10:30:39.371390+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:30:39.371390+0000","last_undegraded":"2023-08-10T10:30:39.371390+0000","last_fullsized":"2023-08-10T10:30:39.371390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984167+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:30:39.984167+0000","last_peered":"2023-08-10T10:30:39.984167+0000","last_clean":"2023-08-10T10:30:39.984167+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:30:39.984167+0000","last_undegraded":"2023-08-10T10:30:39.984167+0000","last_fullsized":"2023-08-10T10:30:39.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:55.653411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873193+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:30:39.873193+0000","last_peered":"2023-08-10T10:30:39.873193+0000","last_clean":"2023-08-10T10:30:39.873193+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:30:39.873193+0000","last_undegraded":"2023-08-10T10:30:39.873193+0000","last_fullsized":"2023-08-10T10:30:39.873193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:44.518583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982243+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:30:39.982243+0000","last_peered":"2023-08-10T10:30:39.982243+0000","last_clean":"2023-08-10T10:30:39.982243+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:30:39.982243+0000","last_undegraded":"2023-08-10T10:30:39.982243+0000","last_fullsized":"2023-08-10T10:30:39.982243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982179+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:30:39.982179+0000","last_peered":"2023-08-10T10:30:39.982179+0000","last_clean":"2023-08-10T10:30:39.982179+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:30:39.982179+0000","last_undegraded":"2023-08-10T10:30:39.982179+0000","last_fullsized":"2023-08-10T10:30:39.982179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983789+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:30:39.983789+0000","last_peered":"2023-08-10T10:30:39.983789+0000","last_clean":"2023-08-10T10:30:39.983789+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:30:39.983789+0000","last_undegraded":"2023-08-10T10:30:39.983789+0000","last_fullsized":"2023-08-10T10:30:39.983789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:50:24.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982789+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:30:39.982789+0000","last_peered":"2023-08-10T10:30:39.982789+0000","last_clean":"2023-08-10T10:30:39.982789+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:30:39.982789+0000","last_undegraded":"2023-08-10T10:30:39.982789+0000","last_fullsized":"2023-08-10T10:30:39.982789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:04.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370966+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:30:39.370966+0000","last_peered":"2023-08-10T10:30:39.370966+0000","last_clean":"2023-08-10T10:30:39.370966+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:30:39.370966+0000","last_undegraded":"2023-08-10T10:30:39.370966+0000","last_fullsized":"2023-08-10T10:30:39.370966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:05.482062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872971+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:30:39.872971+0000","last_peered":"2023-08-10T10:30:39.872971+0000","last_clean":"2023-08-10T10:30:39.872971+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:30:39.872971+0000","last_undegraded":"2023-08-10T10:30:39.872971+0000","last_fullsized":"2023-08-10T10:30:39.872971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983288+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:30:39.983288+0000","last_peered":"2023-08-10T10:30:39.983288+0000","last_clean":"2023-08-10T10:30:39.983288+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:30:39.983288+0000","last_undegraded":"2023-08-10T10:30:39.983288+0000","last_fullsized":"2023-08-10T10:30:39.983288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369221+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:30:39.369221+0000","last_peered":"2023-08-10T10:30:39.369221+0000","last_clean":"2023-08-10T10:30:39.369221+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:30:39.369221+0000","last_undegraded":"2023-08-10T10:30:39.369221+0000","last_fullsized":"2023-08-10T10:30:39.369221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:55:31.891569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370491+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:30:39.370491+0000","last_peered":"2023-08-10T10:30:39.370491+0000","last_clean":"2023-08-10T10:30:39.370491+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:30:39.370491+0000","last_undegraded":"2023-08-10T10:30:39.370491+0000","last_fullsized":"2023-08-10T10:30:39.370491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:10.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983827+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:30:39.983827+0000","last_peered":"2023-08-10T10:30:39.983827+0000","last_clean":"2023-08-10T10:30:39.983827+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:30:39.983827+0000","last_undegraded":"2023-08-10T10:30:39.983827+0000","last_fullsized":"2023-08-10T10:30:39.983827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.372064+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:30:39.372064+0000","last_peered":"2023-08-10T10:30:39.372064+0000","last_clean":"2023-08-10T10:30:39.372064+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:30:39.372064+0000","last_undegraded":"2023-08-10T10:30:39.372064+0000","last_fullsized":"2023-08-10T10:30:39.372064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983306+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:30:39.983306+0000","last_peered":"2023-08-10T10:30:39.983306+0000","last_clean":"2023-08-10T10:30:39.983306+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:30:39.983306+0000","last_undegraded":"2023-08-10T10:30:39.983306+0000","last_fullsized":"2023-08-10T10:30:39.983306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984069+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:30:39.984069+0000","last_peered":"2023-08-10T10:30:39.984069+0000","last_clean":"2023-08-10T10:30:39.984069+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:30:39.984069+0000","last_undegraded":"2023-08-10T10:30:39.984069+0000","last_fullsized":"2023-08-10T10:30:39.984069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370682+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:30:39.370682+0000","last_peered":"2023-08-10T10:30:39.370682+0000","last_clean":"2023-08-10T10:30:39.370682+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:30:39.370682+0000","last_undegraded":"2023-08-10T10:30:39.370682+0000","last_fullsized":"2023-08-10T10:30:39.370682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370384+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:30:39.370384+0000","last_peered":"2023-08-10T10:30:39.370384+0000","last_clean":"2023-08-10T10:30:39.370384+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:30:39.370384+0000","last_undegraded":"2023-08-10T10:30:39.370384+0000","last_fullsized":"2023-08-10T10:30:39.370384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983703+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:30:39.983703+0000","last_peered":"2023-08-10T10:30:39.983703+0000","last_clean":"2023-08-10T10:30:39.983703+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:30:39.983703+0000","last_undegraded":"2023-08-10T10:30:39.983703+0000","last_fullsized":"2023-08-10T10:30:39.983703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983297+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:30:39.983297+0000","last_peered":"2023-08-10T10:30:39.983297+0000","last_clean":"2023-08-10T10:30:39.983297+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:30:39.983297+0000","last_undegraded":"2023-08-10T10:30:39.983297+0000","last_fullsized":"2023-08-10T10:30:39.983297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872672+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:30:39.872672+0000","last_peered":"2023-08-10T10:30:39.872672+0000","last_clean":"2023-08-10T10:30:39.872672+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:30:39.872672+0000","last_undegraded":"2023-08-10T10:30:39.872672+0000","last_fullsized":"2023-08-10T10:30:39.872672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:07.784753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983138+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:30:39.983138+0000","last_peered":"2023-08-10T10:30:39.983138+0000","last_clean":"2023-08-10T10:30:39.983138+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:30:39.983138+0000","last_undegraded":"2023-08-10T10:30:39.983138+0000","last_fullsized":"2023-08-10T10:30:39.983138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:49.538451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370654+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:30:39.370654+0000","last_peered":"2023-08-10T10:30:39.370654+0000","last_clean":"2023-08-10T10:30:39.370654+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:30:39.370654+0000","last_undegraded":"2023-08-10T10:30:39.370654+0000","last_fullsized":"2023-08-10T10:30:39.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984216+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:30:39.984216+0000","last_peered":"2023-08-10T10:30:39.984216+0000","last_clean":"2023-08-10T10:30:39.984216+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:30:39.984216+0000","last_undegraded":"2023-08-10T10:30:39.984216+0000","last_fullsized":"2023-08-10T10:30:39.984216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:58:25.947292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983467+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:30:39.983467+0000","last_peered":"2023-08-10T10:30:39.983467+0000","last_clean":"2023-08-10T10:30:39.983467+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:30:39.983467+0000","last_undegraded":"2023-08-10T10:30:39.983467+0000","last_fullsized":"2023-08-10T10:30:39.983467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371344+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:30:39.371344+0000","last_peered":"2023-08-10T10:30:39.371344+0000","last_clean":"2023-08-10T10:30:39.371344+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:30:39.371344+0000","last_undegraded":"2023-08-10T10:30:39.371344+0000","last_fullsized":"2023-08-10T10:30:39.371344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.149063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983858+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:30:39.983858+0000","last_peered":"2023-08-10T10:30:39.983858+0000","last_clean":"2023-08-10T10:30:39.983858+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:30:39.983858+0000","last_undegraded":"2023-08-10T10:30:39.983858+0000","last_fullsized":"2023-08-10T10:30:39.983858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873013+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:30:39.873013+0000","last_peered":"2023-08-10T10:30:39.873013+0000","last_clean":"2023-08-10T10:30:39.873013+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:30:39.873013+0000","last_undegraded":"2023-08-10T10:30:39.873013+0000","last_fullsized":"2023-08-10T10:30:39.873013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:30:56.818 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:30:57.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.038+0000 7fd0963ff700 1 Processor -- start 2023-08-10T10:30:57.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.038+0000 7fd0963ff700 1 -- start start 2023-08-10T10:30:57.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd0963ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd09015cf20 0x7fd09015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd0963ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0900b5210 0x7fd0900d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd0963ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09015e590 con 0x7fd0900b8870 2023-08-10T10:30:57.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd0963ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900cde30 con 0x7fd0900b5210 2023-08-10T10:30:57.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd0963ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0900b8e30 con 0x7fd09015cf20 2023-08-10T10:30:57.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd08f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd0900b8870 0x7fd0900b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39870/0 (socket says 172.21.15.88:39870) 2023-08-10T10:30:57.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd09499c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd0900b5210 0x7fd0900d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd08f7fe700 1 -- 172.21.15.88:0/3785168206 learned_addr learned my addr 172.21.15.88:0/3785168206 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.039+0000 7fd08ffff700 1 --2- 172.21.15.88:0/3785168206 >> v2:172.21.15.187:3300/0 conn(0x7fd09015cf20 0x7fd09015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd09499c700 1 -- 172.21.15.88:0/3785168206 >> v2:172.21.15.187:3300/0 conn(0x7fd09015cf20 msgr2=0x7fd09015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd09499c700 1 --2- 172.21.15.88:0/3785168206 >> v2:172.21.15.187:3300/0 conn(0x7fd09015cf20 0x7fd09015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd09499c700 1 -- 172.21.15.88:0/3785168206 >> v1:172.21.15.88:6789/0 conn(0x7fd0900b8870 legacy=0x7fd0900b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd09499c700 1 -- 172.21.15.88:0/3785168206 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0900ce010 con 0x7fd0900b5210 2023-08-10T10:30:57.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd08effd700 1 -- 172.21.15.88:0/3785168206 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121308897 0 0) 0x7fd09015e590 con 0x7fd0900b8870 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd09499c700 1 --2- 172.21.15.88:0/3785168206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0900b5210 0x7fd0900d1350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd09006d190 tx=0x7fd08800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e81b71ab2342cf0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd08effd700 1 -- 172.21.15.88:0/3785168206 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08800e070 con 0x7fd0900b5210 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd08effd700 1 -- 172.21.15.88:0/3785168206 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08800bb20 con 0x7fd0900b5210 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.040+0000 7fd08effd700 1 -- 172.21.15.88:0/3785168206 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088012430 con 0x7fd0900b5210 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 -- 172.21.15.88:0/3785168206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0900b5210 msgr2=0x7fd0900d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 --2- 172.21.15.88:0/3785168206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0900b5210 0x7fd0900d1350 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd09006d190 tx=0x7fd08800b330 comp rx=0 tx=0).stop 2023-08-10T10:30:57.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 -- 172.21.15.88:0/3785168206 shutdown_connections 2023-08-10T10:30:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 --2- 172.21.15.88:0/3785168206 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd0900b5210 0x7fd0900d1350 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 --2- 172.21.15.88:0/3785168206 >> v2:172.21.15.187:3300/0 conn(0x7fd09015cf20 0x7fd09015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 -- 172.21.15.88:0/3785168206 >> 172.21.15.88:0/3785168206 conn(0x7fd0900d3080 msgr2=0x7fd0900d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 -- 172.21.15.88:0/3785168206 shutdown_connections 2023-08-10T10:30:57.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.041+0000 7fd0963ff700 1 -- 172.21.15.88:0/3785168206 wait complete. 2023-08-10T10:30:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.043+0000 7fd0963ff700 1 Processor -- start 2023-08-10T10:30:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.043+0000 7fd0963ff700 1 -- start start 2023-08-10T10:30:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0900b5210 0x7fd0901f20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0900b8870 0x7fd09015bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09014ee10 con 0x7fd09015cf20 2023-08-10T10:30:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0900cb440 con 0x7fd0900b8870 2023-08-10T10:30:57.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd0963ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0901f2630 con 0x7fd0900b5210 2023-08-10T10:30:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41254/0 (socket says 172.21.15.88:41254) 2023-08-10T10:30:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 -- 172.21.15.88:0/1401651721 learned_addr learned my addr 172.21.15.88:0/1401651721 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:57.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd08ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0900b5210 0x7fd0901f20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd08f7fe700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0900b8870 0x7fd09015bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 -- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0900b5210 msgr2=0x7fd0901f20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0900b5210 0x7fd0901f20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 -- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0900b8870 msgr2=0x7fd09015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0900b8870 0x7fd09015bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.045+0000 7fd09499c700 1 -- 172.21.15.88:0/1401651721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd088009a70 con 0x7fd09015cf20 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd09499c700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd088013000 tx=0x7fd088004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088012430 con 0x7fd09015cf20 2023-08-10T10:30:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd088020070 con 0x7fd09015cf20 2023-08-10T10:30:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd088003e10 con 0x7fd09015cf20 2023-08-10T10:30:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0900cab50 con 0x7fd09015cf20 2023-08-10T10:30:57.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.046+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09015c450 con 0x7fd09015cf20 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.047+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0900cb5f0 con 0x7fd09015cf20 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.048+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd088004040 con 0x7fd09015cf20 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.049+0000 7fd08cff9700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 0x7fd07c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.049+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd088022070 con 0x7fd09015cf20 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.049+0000 7fd08ffff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 0x7fd07c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.050+0000 7fd08ffff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 0x7fd07c06d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd080009b40 tx=0x7fd080009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.053+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd0900cb5f0 con 0x7fd09015cf20 2023-08-10T10:30:57.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.244+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd09015d300 con 0x7fd07c06ace0 2023-08-10T10:30:57.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.254+0000 7fd08cff9700 1 -- 172.21.15.88:0/1401651721 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367409 (secure 0 0 0) 0x7fd080011810 con 0x7fd07c06ace0 2023-08-10T10:30:57.259 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 msgr2=0x7fd07c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 0x7fd07c06d1a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd080009b40 tx=0x7fd080009210 comp rx=0 tx=0).stop 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 msgr2=0x7fd0900c8e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd088013000 tx=0x7fd088004ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 shutdown_connections 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd09015cf20 0x7fd0900c8e90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd07c06ace0 0x7fd07c06d1a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0900b5210 0x7fd0901f20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 --2- 172.21.15.88:0/1401651721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0900b8870 0x7fd09015bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.258+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 >> 172.21.15.88:0/1401651721 conn(0x7fd0900d3080 msgr2=0x7fd09006aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:57.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.259+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 shutdown_connections 2023-08-10T10:30:57.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.259+0000 7fd0963ff700 1 -- 172.21.15.88:0/1401651721 wait complete. 2023-08-10T10:30:57.263 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:30:57.278 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-10T10:30:55.529935+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002542"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369311+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:30:39.369311+0000","last_peered":"2023-08-10T10:30:39.369311+0000","last_clean":"2023-08-10T10:30:39.369311+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:30:39.369311+0000","last_undegraded":"2023-08-10T10:30:39.369311+0000","last_fullsized":"2023-08-10T10:30:39.369311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:15:52.847844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983931+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:30:39.983931+0000","last_peered":"2023-08-10T10:30:39.983931+0000","last_clean":"2023-08-10T10:30:39.983931+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:30:39.983931+0000","last_undegraded":"2023-08-10T10:30:39.983931+0000","last_fullsized":"2023-08-10T10:30:39.983931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371111+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:30:39.371111+0000","last_peered":"2023-08-10T10:30:39.371111+0000","last_clean":"2023-08-10T10:30:39.371111+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:30:39.371111+0000","last_undegraded":"2023-08-10T10:30:39.371111+0000","last_fullsized":"2023-08-10T10:30:39.371111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:07.275147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984157+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:30:39.984157+0000","last_peered":"2023-08-10T10:30:39.984157+0000","last_clean":"2023-08-10T10:30:39.984157+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:30:39.984157+0000","last_undegraded":"2023-08-10T10:30:39.984157+0000","last_fullsized":"2023-08-10T10:30:39.984157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:45.483566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983455+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:30:39.983455+0000","last_peered":"2023-08-10T10:30:39.983455+0000","last_clean":"2023-08-10T10:30:39.983455+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:30:39.983455+0000","last_undegraded":"2023-08-10T10:30:39.983455+0000","last_fullsized":"2023-08-10T10:30:39.983455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371199+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:30:39.371199+0000","last_peered":"2023-08-10T10:30:39.371199+0000","last_clean":"2023-08-10T10:30:39.371199+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:30:39.371199+0000","last_undegraded":"2023-08-10T10:30:39.371199+0000","last_fullsized":"2023-08-10T10:30:39.371199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:29.585173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370548+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:30:39.370548+0000","last_peered":"2023-08-10T10:30:39.370548+0000","last_clean":"2023-08-10T10:30:39.370548+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:30:39.370548+0000","last_undegraded":"2023-08-10T10:30:39.370548+0000","last_fullsized":"2023-08-10T10:30:39.370548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983193+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:30:39.983193+0000","last_peered":"2023-08-10T10:30:39.983193+0000","last_clean":"2023-08-10T10:30:39.983193+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:30:39.983193+0000","last_undegraded":"2023-08-10T10:30:39.983193+0000","last_fullsized":"2023-08-10T10:30:39.983193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982871+0000","last_change":"2023-08-10T10:30:34.342831+0000","last_active":"2023-08-10T10:30:39.982871+0000","last_peered":"2023-08-10T10:30:39.982871+0000","last_clean":"2023-08-10T10:30:39.982871+0000","last_became_active":"2023-08-10T10:30:34.341582+0000","last_became_peered":"2023-08-10T10:30:34.341582+0000","last_unstale":"2023-08-10T10:30:39.982871+0000","last_undegraded":"2023-08-10T10:30:39.982871+0000","last_fullsized":"2023-08-10T10:30:39.982871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984422+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:30:39.984422+0000","last_peered":"2023-08-10T10:30:39.984422+0000","last_clean":"2023-08-10T10:30:39.984422+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:30:39.984422+0000","last_undegraded":"2023-08-10T10:30:39.984422+0000","last_fullsized":"2023-08-10T10:30:39.984422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370892+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:30:39.370892+0000","last_peered":"2023-08-10T10:30:39.370892+0000","last_clean":"2023-08-10T10:30:39.370892+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:30:39.370892+0000","last_undegraded":"2023-08-10T10:30:39.370892+0000","last_fullsized":"2023-08-10T10:30:39.370892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:25.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369176+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:30:39.369176+0000","last_peered":"2023-08-10T10:30:39.369176+0000","last_clean":"2023-08-10T10:30:39.369176+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:30:39.369176+0000","last_undegraded":"2023-08-10T10:30:39.369176+0000","last_fullsized":"2023-08-10T10:30:39.369176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:21.255854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369378+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:30:39.369378+0000","last_peered":"2023-08-10T10:30:39.369378+0000","last_clean":"2023-08-10T10:30:39.369378+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:30:39.369378+0000","last_undegraded":"2023-08-10T10:30:39.369378+0000","last_fullsized":"2023-08-10T10:30:39.369378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:14.864006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983136+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:30:39.983136+0000","last_peered":"2023-08-10T10:30:39.983136+0000","last_clean":"2023-08-10T10:30:39.983136+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:30:39.983136+0000","last_undegraded":"2023-08-10T10:30:39.983136+0000","last_fullsized":"2023-08-10T10:30:39.983136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369966+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:30:39.369966+0000","last_peered":"2023-08-10T10:30:39.369966+0000","last_clean":"2023-08-10T10:30:39.369966+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:30:39.369966+0000","last_undegraded":"2023-08-10T10:30:39.369966+0000","last_fullsized":"2023-08-10T10:30:39.369966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370894+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:30:39.370894+0000","last_peered":"2023-08-10T10:30:39.370894+0000","last_clean":"2023-08-10T10:30:39.370894+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:30:39.370894+0000","last_undegraded":"2023-08-10T10:30:39.370894+0000","last_fullsized":"2023-08-10T10:30:39.370894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982953+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:30:39.982953+0000","last_peered":"2023-08-10T10:30:39.982953+0000","last_clean":"2023-08-10T10:30:39.982953+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:30:39.982953+0000","last_undegraded":"2023-08-10T10:30:39.982953+0000","last_fullsized":"2023-08-10T10:30:39.982953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370539+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:30:39.370539+0000","last_peered":"2023-08-10T10:30:39.370539+0000","last_clean":"2023-08-10T10:30:39.370539+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:30:39.370539+0000","last_undegraded":"2023-08-10T10:30:39.370539+0000","last_fullsized":"2023-08-10T10:30:39.370539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:56.660087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369083+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:30:39.369083+0000","last_peered":"2023-08-10T10:30:39.369083+0000","last_clean":"2023-08-10T10:30:39.369083+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:30:39.369083+0000","last_undegraded":"2023-08-10T10:30:39.369083+0000","last_fullsized":"2023-08-10T10:30:39.369083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:22.279579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371337+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:30:39.371337+0000","last_peered":"2023-08-10T10:30:39.371337+0000","last_clean":"2023-08-10T10:30:39.371337+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:30:39.371337+0000","last_undegraded":"2023-08-10T10:30:39.371337+0000","last_fullsized":"2023-08-10T10:30:39.371337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370272+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:30:39.370272+0000","last_peered":"2023-08-10T10:30:39.370272+0000","last_clean":"2023-08-10T10:30:39.370272+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:30:39.370272+0000","last_undegraded":"2023-08-10T10:30:39.370272+0000","last_fullsized":"2023-08-10T10:30:39.370272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982720+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:30:39.982720+0000","last_peered":"2023-08-10T10:30:39.982720+0000","last_clean":"2023-08-10T10:30:39.982720+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:30:39.982720+0000","last_undegraded":"2023-08-10T10:30:39.982720+0000","last_fullsized":"2023-08-10T10:30:39.982720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983043+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:30:39.983043+0000","last_peered":"2023-08-10T10:30:39.983043+0000","last_clean":"2023-08-10T10:30:39.983043+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:30:39.983043+0000","last_undegraded":"2023-08-10T10:30:39.983043+0000","last_fullsized":"2023-08-10T10:30:39.983043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370537+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:30:39.370537+0000","last_peered":"2023-08-10T10:30:39.370537+0000","last_clean":"2023-08-10T10:30:39.370537+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:30:39.370537+0000","last_undegraded":"2023-08-10T10:30:39.370537+0000","last_fullsized":"2023-08-10T10:30:39.370537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872983+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:30:39.872983+0000","last_peered":"2023-08-10T10:30:39.872983+0000","last_clean":"2023-08-10T10:30:39.872983+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:30:39.872983+0000","last_undegraded":"2023-08-10T10:30:39.872983+0000","last_fullsized":"2023-08-10T10:30:39.872983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873160+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:30:39.873160+0000","last_peered":"2023-08-10T10:30:39.873160+0000","last_clean":"2023-08-10T10:30:39.873160+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:30:39.873160+0000","last_undegraded":"2023-08-10T10:30:39.873160+0000","last_fullsized":"2023-08-10T10:30:39.873160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984432+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:30:39.984432+0000","last_peered":"2023-08-10T10:30:39.984432+0000","last_clean":"2023-08-10T10:30:39.984432+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:30:39.984432+0000","last_undegraded":"2023-08-10T10:30:39.984432+0000","last_fullsized":"2023-08-10T10:30:39.984432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371835+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:30:39.371835+0000","last_peered":"2023-08-10T10:30:39.371835+0000","last_clean":"2023-08-10T10:30:39.371835+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:30:39.371835+0000","last_undegraded":"2023-08-10T10:30:39.371835+0000","last_fullsized":"2023-08-10T10:30:39.371835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:03.982064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370925+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:30:39.370925+0000","last_peered":"2023-08-10T10:30:39.370925+0000","last_clean":"2023-08-10T10:30:39.370925+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:30:39.370925+0000","last_undegraded":"2023-08-10T10:30:39.370925+0000","last_fullsized":"2023-08-10T10:30:39.370925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:32.438438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983791+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:30:39.983791+0000","last_peered":"2023-08-10T10:30:39.983791+0000","last_clean":"2023-08-10T10:30:39.983791+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:30:39.983791+0000","last_undegraded":"2023-08-10T10:30:39.983791+0000","last_fullsized":"2023-08-10T10:30:39.983791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983622+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:30:39.983622+0000","last_peered":"2023-08-10T10:30:39.983622+0000","last_clean":"2023-08-10T10:30:39.983622+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:30:39.983622+0000","last_undegraded":"2023-08-10T10:30:39.983622+0000","last_fullsized":"2023-08-10T10:30:39.983622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:07.717850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872457+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:30:39.872457+0000","last_peered":"2023-08-10T10:30:39.872457+0000","last_clean":"2023-08-10T10:30:39.872457+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:30:39.872457+0000","last_undegraded":"2023-08-10T10:30:39.872457+0000","last_fullsized":"2023-08-10T10:30:39.872457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:40.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983295+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:30:39.983295+0000","last_peered":"2023-08-10T10:30:39.983295+0000","last_clean":"2023-08-10T10:30:39.983295+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:30:39.983295+0000","last_undegraded":"2023-08-10T10:30:39.983295+0000","last_fullsized":"2023-08-10T10:30:39.983295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983451+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:30:39.983451+0000","last_peered":"2023-08-10T10:30:39.983451+0000","last_clean":"2023-08-10T10:30:39.983451+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:30:39.983451+0000","last_undegraded":"2023-08-10T10:30:39.983451+0000","last_fullsized":"2023-08-10T10:30:39.983451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:25.693202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983147+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:30:39.983147+0000","last_peered":"2023-08-10T10:30:39.983147+0000","last_clean":"2023-08-10T10:30:39.983147+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:30:39.983147+0000","last_undegraded":"2023-08-10T10:30:39.983147+0000","last_fullsized":"2023-08-10T10:30:39.983147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983947+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:30:39.983947+0000","last_peered":"2023-08-10T10:30:39.983947+0000","last_clean":"2023-08-10T10:30:39.983947+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:30:39.983947+0000","last_undegraded":"2023-08-10T10:30:39.983947+0000","last_fullsized":"2023-08-10T10:30:39.983947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:18.306807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983456+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:30:39.983456+0000","last_peered":"2023-08-10T10:30:39.983456+0000","last_clean":"2023-08-10T10:30:39.983456+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:30:39.983456+0000","last_undegraded":"2023-08-10T10:30:39.983456+0000","last_fullsized":"2023-08-10T10:30:39.983456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:22.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983003+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:30:39.983003+0000","last_peered":"2023-08-10T10:30:39.983003+0000","last_clean":"2023-08-10T10:30:39.983003+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:30:39.983003+0000","last_undegraded":"2023-08-10T10:30:39.983003+0000","last_fullsized":"2023-08-10T10:30:39.983003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983092+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:30:39.983092+0000","last_peered":"2023-08-10T10:30:39.983092+0000","last_clean":"2023-08-10T10:30:39.983092+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:30:39.983092+0000","last_undegraded":"2023-08-10T10:30:39.983092+0000","last_fullsized":"2023-08-10T10:30:39.983092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369849+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:30:39.369849+0000","last_peered":"2023-08-10T10:30:39.369849+0000","last_clean":"2023-08-10T10:30:39.369849+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:30:39.369849+0000","last_undegraded":"2023-08-10T10:30:39.369849+0000","last_fullsized":"2023-08-10T10:30:39.369849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984181+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:30:39.984181+0000","last_peered":"2023-08-10T10:30:39.984181+0000","last_clean":"2023-08-10T10:30:39.984181+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:30:39.984181+0000","last_undegraded":"2023-08-10T10:30:39.984181+0000","last_fullsized":"2023-08-10T10:30:39.984181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983153+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:30:39.983153+0000","last_peered":"2023-08-10T10:30:39.983153+0000","last_clean":"2023-08-10T10:30:39.983153+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:30:39.983153+0000","last_undegraded":"2023-08-10T10:30:39.983153+0000","last_fullsized":"2023-08-10T10:30:39.983153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984063+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:30:39.984063+0000","last_peered":"2023-08-10T10:30:39.984063+0000","last_clean":"2023-08-10T10:30:39.984063+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:30:39.984063+0000","last_undegraded":"2023-08-10T10:30:39.984063+0000","last_fullsized":"2023-08-10T10:30:39.984063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371870+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:30:39.371870+0000","last_peered":"2023-08-10T10:30:39.371870+0000","last_clean":"2023-08-10T10:30:39.371870+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:30:39.371870+0000","last_undegraded":"2023-08-10T10:30:39.371870+0000","last_fullsized":"2023-08-10T10:30:39.371870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:45.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872782+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:30:39.872782+0000","last_peered":"2023-08-10T10:30:39.872782+0000","last_clean":"2023-08-10T10:30:39.872782+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:30:39.872782+0000","last_undegraded":"2023-08-10T10:30:39.872782+0000","last_fullsized":"2023-08-10T10:30:39.872782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872553+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:30:39.872553+0000","last_peered":"2023-08-10T10:30:39.872553+0000","last_clean":"2023-08-10T10:30:39.872553+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:30:39.872553+0000","last_undegraded":"2023-08-10T10:30:39.872553+0000","last_fullsized":"2023-08-10T10:30:39.872553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:24.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:52.633741+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:30:52.633741+0000","last_peered":"2023-08-10T10:30:52.633741+0000","last_clean":"2023-08-10T10:30:52.633741+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:30:52.633741+0000","last_undegraded":"2023-08-10T10:30:52.633741+0000","last_fullsized":"2023-08-10T10:30:52.633741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:37.081141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371788+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:30:39.371788+0000","last_peered":"2023-08-10T10:30:39.371788+0000","last_clean":"2023-08-10T10:30:39.371788+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:30:39.371788+0000","last_undegraded":"2023-08-10T10:30:39.371788+0000","last_fullsized":"2023-08-10T10:30:39.371788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:24.614492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984518+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:30:39.984518+0000","last_peered":"2023-08-10T10:30:39.984518+0000","last_clean":"2023-08-10T10:30:39.984518+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:30:39.984518+0000","last_undegraded":"2023-08-10T10:30:39.984518+0000","last_fullsized":"2023-08-10T10:30:39.984518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370136+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:30:39.370136+0000","last_peered":"2023-08-10T10:30:39.370136+0000","last_clean":"2023-08-10T10:30:39.370136+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:30:39.370136+0000","last_undegraded":"2023-08-10T10:30:39.370136+0000","last_fullsized":"2023-08-10T10:30:39.370136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984177+0000","last_change":"2023-08-10T10:30:34.333045+0000","last_active":"2023-08-10T10:30:39.984177+0000","last_peered":"2023-08-10T10:30:39.984177+0000","last_clean":"2023-08-10T10:30:39.984177+0000","last_became_active":"2023-08-10T10:30:34.332756+0000","last_became_peered":"2023-08-10T10:30:34.332756+0000","last_unstale":"2023-08-10T10:30:39.984177+0000","last_undegraded":"2023-08-10T10:30:39.984177+0000","last_fullsized":"2023-08-10T10:30:39.984177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:28.964743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984070+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:30:39.984070+0000","last_peered":"2023-08-10T10:30:39.984070+0000","last_clean":"2023-08-10T10:30:39.984070+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:30:39.984070+0000","last_undegraded":"2023-08-10T10:30:39.984070+0000","last_fullsized":"2023-08-10T10:30:39.984070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982553+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:30:39.982553+0000","last_peered":"2023-08-10T10:30:39.982553+0000","last_clean":"2023-08-10T10:30:39.982553+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:30:39.982553+0000","last_undegraded":"2023-08-10T10:30:39.982553+0000","last_fullsized":"2023-08-10T10:30:39.982553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:12.238493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984332+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:30:39.984332+0000","last_peered":"2023-08-10T10:30:39.984332+0000","last_clean":"2023-08-10T10:30:39.984332+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:30:39.984332+0000","last_undegraded":"2023-08-10T10:30:39.984332+0000","last_fullsized":"2023-08-10T10:30:39.984332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:30:39.983925+0000","last_peered":"2023-08-10T10:30:39.983925+0000","last_clean":"2023-08-10T10:30:39.983925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:30:39.983925+0000","last_undegraded":"2023-08-10T10:30:39.983925+0000","last_fullsized":"2023-08-10T10:30:39.983925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370418+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:30:39.370418+0000","last_peered":"2023-08-10T10:30:39.370418+0000","last_clean":"2023-08-10T10:30:39.370418+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.370418+0000","last_undegraded":"2023-08-10T10:30:39.370418+0000","last_fullsized":"2023-08-10T10:30:39.370418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983299+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:30:39.983299+0000","last_peered":"2023-08-10T10:30:39.983299+0000","last_clean":"2023-08-10T10:30:39.983299+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:30:39.983299+0000","last_undegraded":"2023-08-10T10:30:39.983299+0000","last_fullsized":"2023-08-10T10:30:39.983299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:25.632086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983777+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:30:39.983777+0000","last_peered":"2023-08-10T10:30:39.983777+0000","last_clean":"2023-08-10T10:30:39.983777+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:30:39.983777+0000","last_undegraded":"2023-08-10T10:30:39.983777+0000","last_fullsized":"2023-08-10T10:30:39.983777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983006+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:30:39.983006+0000","last_peered":"2023-08-10T10:30:39.983006+0000","last_clean":"2023-08-10T10:30:39.983006+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:30:39.983006+0000","last_undegraded":"2023-08-10T10:30:39.983006+0000","last_fullsized":"2023-08-10T10:30:39.983006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:25.545777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984046+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:30:39.984046+0000","last_peered":"2023-08-10T10:30:39.984046+0000","last_clean":"2023-08-10T10:30:39.984046+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:30:39.984046+0000","last_undegraded":"2023-08-10T10:30:39.984046+0000","last_fullsized":"2023-08-10T10:30:39.984046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:12.376679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371191+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:30:39.371191+0000","last_peered":"2023-08-10T10:30:39.371191+0000","last_clean":"2023-08-10T10:30:39.371191+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:30:39.371191+0000","last_undegraded":"2023-08-10T10:30:39.371191+0000","last_fullsized":"2023-08-10T10:30:39.371191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:53.760062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371171+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:30:39.371171+0000","last_peered":"2023-08-10T10:30:39.371171+0000","last_clean":"2023-08-10T10:30:39.371171+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.371171+0000","last_undegraded":"2023-08-10T10:30:39.371171+0000","last_fullsized":"2023-08-10T10:30:39.371171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:34.188865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983055+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:30:39.983055+0000","last_peered":"2023-08-10T10:30:39.983055+0000","last_clean":"2023-08-10T10:30:39.983055+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:30:39.983055+0000","last_undegraded":"2023-08-10T10:30:39.983055+0000","last_fullsized":"2023-08-10T10:30:39.983055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:13.245170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368831+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:30:39.368831+0000","last_peered":"2023-08-10T10:30:39.368831+0000","last_clean":"2023-08-10T10:30:39.368831+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:30:39.368831+0000","last_undegraded":"2023-08-10T10:30:39.368831+0000","last_fullsized":"2023-08-10T10:30:39.368831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:29.757505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370481+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:30:39.370481+0000","last_peered":"2023-08-10T10:30:39.370481+0000","last_clean":"2023-08-10T10:30:39.370481+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:30:39.370481+0000","last_undegraded":"2023-08-10T10:30:39.370481+0000","last_fullsized":"2023-08-10T10:30:39.370481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371233+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:30:39.371233+0000","last_peered":"2023-08-10T10:30:39.371233+0000","last_clean":"2023-08-10T10:30:39.371233+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:30:39.371233+0000","last_undegraded":"2023-08-10T10:30:39.371233+0000","last_fullsized":"2023-08-10T10:30:39.371233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:49.770265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369037+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:30:39.369037+0000","last_peered":"2023-08-10T10:30:39.369037+0000","last_clean":"2023-08-10T10:30:39.369037+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:30:39.369037+0000","last_undegraded":"2023-08-10T10:30:39.369037+0000","last_fullsized":"2023-08-10T10:30:39.369037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:31.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371929+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:30:39.371929+0000","last_peered":"2023-08-10T10:30:39.371929+0000","last_clean":"2023-08-10T10:30:39.371929+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:30:39.371929+0000","last_undegraded":"2023-08-10T10:30:39.371929+0000","last_fullsized":"2023-08-10T10:30:39.371929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:07.689076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983438+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:30:39.983438+0000","last_peered":"2023-08-10T10:30:39.983438+0000","last_clean":"2023-08-10T10:30:39.983438+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:30:39.983438+0000","last_undegraded":"2023-08-10T10:30:39.983438+0000","last_fullsized":"2023-08-10T10:30:39.983438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:28:12.535150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369073+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:30:39.369073+0000","last_peered":"2023-08-10T10:30:39.369073+0000","last_clean":"2023-08-10T10:30:39.369073+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:30:39.369073+0000","last_undegraded":"2023-08-10T10:30:39.369073+0000","last_fullsized":"2023-08-10T10:30:39.369073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:39.562819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983698+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:30:39.983698+0000","last_peered":"2023-08-10T10:30:39.983698+0000","last_clean":"2023-08-10T10:30:39.983698+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:30:39.983698+0000","last_undegraded":"2023-08-10T10:30:39.983698+0000","last_fullsized":"2023-08-10T10:30:39.983698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983097+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:30:39.983097+0000","last_peered":"2023-08-10T10:30:39.983097+0000","last_clean":"2023-08-10T10:30:39.983097+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:30:39.983097+0000","last_undegraded":"2023-08-10T10:30:39.983097+0000","last_fullsized":"2023-08-10T10:30:39.983097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369182+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:30:39.369182+0000","last_peered":"2023-08-10T10:30:39.369182+0000","last_clean":"2023-08-10T10:30:39.369182+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:30:39.369182+0000","last_undegraded":"2023-08-10T10:30:39.369182+0000","last_fullsized":"2023-08-10T10:30:39.369182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:12.307358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983784+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:30:39.983784+0000","last_peered":"2023-08-10T10:30:39.983784+0000","last_clean":"2023-08-10T10:30:39.983784+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:30:39.983784+0000","last_undegraded":"2023-08-10T10:30:39.983784+0000","last_fullsized":"2023-08-10T10:30:39.983784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:20.631743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371024+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:30:39.371024+0000","last_peered":"2023-08-10T10:30:39.371024+0000","last_clean":"2023-08-10T10:30:39.371024+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:30:39.371024+0000","last_undegraded":"2023-08-10T10:30:39.371024+0000","last_fullsized":"2023-08-10T10:30:39.371024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:42.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872669+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:30:39.872669+0000","last_peered":"2023-08-10T10:30:39.872669+0000","last_clean":"2023-08-10T10:30:39.872669+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:30:39.872669+0000","last_undegraded":"2023-08-10T10:30:39.872669+0000","last_fullsized":"2023-08-10T10:30:39.872669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:17.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983630+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:30:39.983630+0000","last_peered":"2023-08-10T10:30:39.983630+0000","last_clean":"2023-08-10T10:30:39.983630+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:30:39.983630+0000","last_undegraded":"2023-08-10T10:30:39.983630+0000","last_fullsized":"2023-08-10T10:30:39.983630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:25.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370188+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:30:39.370188+0000","last_peered":"2023-08-10T10:30:39.370188+0000","last_clean":"2023-08-10T10:30:39.370188+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:30:39.370188+0000","last_undegraded":"2023-08-10T10:30:39.370188+0000","last_fullsized":"2023-08-10T10:30:39.370188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:46.308677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983978+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:30:39.983978+0000","last_peered":"2023-08-10T10:30:39.983978+0000","last_clean":"2023-08-10T10:30:39.983978+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:30:39.983978+0000","last_undegraded":"2023-08-10T10:30:39.983978+0000","last_fullsized":"2023-08-10T10:30:39.983978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:54.599910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370824+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:30:39.370824+0000","last_peered":"2023-08-10T10:30:39.370824+0000","last_clean":"2023-08-10T10:30:39.370824+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:30:39.370824+0000","last_undegraded":"2023-08-10T10:30:39.370824+0000","last_fullsized":"2023-08-10T10:30:39.370824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:45.246627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370711+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:30:39.370711+0000","last_peered":"2023-08-10T10:30:39.370711+0000","last_clean":"2023-08-10T10:30:39.370711+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:30:39.370711+0000","last_undegraded":"2023-08-10T10:30:39.370711+0000","last_fullsized":"2023-08-10T10:30:39.370711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370373+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:30:39.370373+0000","last_peered":"2023-08-10T10:30:39.370373+0000","last_clean":"2023-08-10T10:30:39.370373+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:30:39.370373+0000","last_undegraded":"2023-08-10T10:30:39.370373+0000","last_fullsized":"2023-08-10T10:30:39.370373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982981+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:30:39.982981+0000","last_peered":"2023-08-10T10:30:39.982981+0000","last_clean":"2023-08-10T10:30:39.982981+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:30:39.982981+0000","last_undegraded":"2023-08-10T10:30:39.982981+0000","last_fullsized":"2023-08-10T10:30:39.982981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873270+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:30:39.873270+0000","last_peered":"2023-08-10T10:30:39.873270+0000","last_clean":"2023-08-10T10:30:39.873270+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:30:39.873270+0000","last_undegraded":"2023-08-10T10:30:39.873270+0000","last_fullsized":"2023-08-10T10:30:39.873270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982968+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:30:39.982968+0000","last_peered":"2023-08-10T10:30:39.982968+0000","last_clean":"2023-08-10T10:30:39.982968+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:30:39.982968+0000","last_undegraded":"2023-08-10T10:30:39.982968+0000","last_fullsized":"2023-08-10T10:30:39.982968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872875+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:30:39.872875+0000","last_peered":"2023-08-10T10:30:39.872875+0000","last_clean":"2023-08-10T10:30:39.872875+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:30:39.872875+0000","last_undegraded":"2023-08-10T10:30:39.872875+0000","last_fullsized":"2023-08-10T10:30:39.872875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984191+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:30:39.984191+0000","last_peered":"2023-08-10T10:30:39.984191+0000","last_clean":"2023-08-10T10:30:39.984191+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:30:39.984191+0000","last_undegraded":"2023-08-10T10:30:39.984191+0000","last_fullsized":"2023-08-10T10:30:39.984191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872443+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:30:39.872443+0000","last_peered":"2023-08-10T10:30:39.872443+0000","last_clean":"2023-08-10T10:30:39.872443+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:30:39.872443+0000","last_undegraded":"2023-08-10T10:30:39.872443+0000","last_fullsized":"2023-08-10T10:30:39.872443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:22.886580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982829+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:30:39.982829+0000","last_peered":"2023-08-10T10:30:39.982829+0000","last_clean":"2023-08-10T10:30:39.982829+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:30:39.982829+0000","last_undegraded":"2023-08-10T10:30:39.982829+0000","last_fullsized":"2023-08-10T10:30:39.982829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983219+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:30:39.983219+0000","last_peered":"2023-08-10T10:30:39.983219+0000","last_clean":"2023-08-10T10:30:39.983219+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:30:39.983219+0000","last_undegraded":"2023-08-10T10:30:39.983219+0000","last_fullsized":"2023-08-10T10:30:39.983219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:00.831050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371933+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:30:39.371933+0000","last_peered":"2023-08-10T10:30:39.371933+0000","last_clean":"2023-08-10T10:30:39.371933+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:30:39.371933+0000","last_undegraded":"2023-08-10T10:30:39.371933+0000","last_fullsized":"2023-08-10T10:30:39.371933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:13.886565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872839+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:30:39.872839+0000","last_peered":"2023-08-10T10:30:39.872839+0000","last_clean":"2023-08-10T10:30:39.872839+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:30:39.872839+0000","last_undegraded":"2023-08-10T10:30:39.872839+0000","last_fullsized":"2023-08-10T10:30:39.872839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369614+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:30:39.369614+0000","last_peered":"2023-08-10T10:30:39.369614+0000","last_clean":"2023-08-10T10:30:39.369614+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:30:39.369614+0000","last_undegraded":"2023-08-10T10:30:39.369614+0000","last_fullsized":"2023-08-10T10:30:39.369614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:31.264771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368880+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:30:39.368880+0000","last_peered":"2023-08-10T10:30:39.368880+0000","last_clean":"2023-08-10T10:30:39.368880+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:30:39.368880+0000","last_undegraded":"2023-08-10T10:30:39.368880+0000","last_fullsized":"2023-08-10T10:30:39.368880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.879507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872450+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:30:39.872450+0000","last_peered":"2023-08-10T10:30:39.872450+0000","last_clean":"2023-08-10T10:30:39.872450+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:30:39.872450+0000","last_undegraded":"2023-08-10T10:30:39.872450+0000","last_fullsized":"2023-08-10T10:30:39.872450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:27.225030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873190+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:30:39.873190+0000","last_peered":"2023-08-10T10:30:39.873190+0000","last_clean":"2023-08-10T10:30:39.873190+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:30:39.873190+0000","last_undegraded":"2023-08-10T10:30:39.873190+0000","last_fullsized":"2023-08-10T10:30:39.873190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370168+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:30:39.370168+0000","last_peered":"2023-08-10T10:30:39.370168+0000","last_clean":"2023-08-10T10:30:39.370168+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:30:39.370168+0000","last_undegraded":"2023-08-10T10:30:39.370168+0000","last_fullsized":"2023-08-10T10:30:39.370168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:08.726944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983289+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:30:39.983289+0000","last_peered":"2023-08-10T10:30:39.983289+0000","last_clean":"2023-08-10T10:30:39.983289+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:30:39.983289+0000","last_undegraded":"2023-08-10T10:30:39.983289+0000","last_fullsized":"2023-08-10T10:30:39.983289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370088+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:30:39.370088+0000","last_peered":"2023-08-10T10:30:39.370088+0000","last_clean":"2023-08-10T10:30:39.370088+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:30:39.370088+0000","last_undegraded":"2023-08-10T10:30:39.370088+0000","last_fullsized":"2023-08-10T10:30:39.370088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:57.539627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983688+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:30:39.983688+0000","last_peered":"2023-08-10T10:30:39.983688+0000","last_clean":"2023-08-10T10:30:39.983688+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:30:39.983688+0000","last_undegraded":"2023-08-10T10:30:39.983688+0000","last_fullsized":"2023-08-10T10:30:39.983688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983836+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:30:39.983836+0000","last_peered":"2023-08-10T10:30:39.983836+0000","last_clean":"2023-08-10T10:30:39.983836+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:30:39.983836+0000","last_undegraded":"2023-08-10T10:30:39.983836+0000","last_fullsized":"2023-08-10T10:30:39.983836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:55.787159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983619+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:30:39.983619+0000","last_peered":"2023-08-10T10:30:39.983619+0000","last_clean":"2023-08-10T10:30:39.983619+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:30:39.983619+0000","last_undegraded":"2023-08-10T10:30:39.983619+0000","last_fullsized":"2023-08-10T10:30:39.983619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370678+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:30:39.370678+0000","last_peered":"2023-08-10T10:30:39.370678+0000","last_clean":"2023-08-10T10:30:39.370678+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:30:39.370678+0000","last_undegraded":"2023-08-10T10:30:39.370678+0000","last_fullsized":"2023-08-10T10:30:39.370678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982478+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:30:39.982478+0000","last_peered":"2023-08-10T10:30:39.982478+0000","last_clean":"2023-08-10T10:30:39.982478+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:30:39.982478+0000","last_undegraded":"2023-08-10T10:30:39.982478+0000","last_fullsized":"2023-08-10T10:30:39.982478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:02.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982630+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:30:39.982630+0000","last_peered":"2023-08-10T10:30:39.982630+0000","last_clean":"2023-08-10T10:30:39.982630+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:30:39.982630+0000","last_undegraded":"2023-08-10T10:30:39.982630+0000","last_fullsized":"2023-08-10T10:30:39.982630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984052+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:30:39.984052+0000","last_peered":"2023-08-10T10:30:39.984052+0000","last_clean":"2023-08-10T10:30:39.984052+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:30:39.984052+0000","last_undegraded":"2023-08-10T10:30:39.984052+0000","last_fullsized":"2023-08-10T10:30:39.984052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:59.078823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371781+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:30:39.371781+0000","last_peered":"2023-08-10T10:30:39.371781+0000","last_clean":"2023-08-10T10:30:39.371781+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:30:39.371781+0000","last_undegraded":"2023-08-10T10:30:39.371781+0000","last_fullsized":"2023-08-10T10:30:39.371781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:06.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873008+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:30:39.873008+0000","last_peered":"2023-08-10T10:30:39.873008+0000","last_clean":"2023-08-10T10:30:39.873008+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:30:39.873008+0000","last_undegraded":"2023-08-10T10:30:39.873008+0000","last_fullsized":"2023-08-10T10:30:39.873008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983910+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:30:39.983910+0000","last_peered":"2023-08-10T10:30:39.983910+0000","last_clean":"2023-08-10T10:30:39.983910+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:30:39.983910+0000","last_undegraded":"2023-08-10T10:30:39.983910+0000","last_fullsized":"2023-08-10T10:30:39.983910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371390+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:30:39.371390+0000","last_peered":"2023-08-10T10:30:39.371390+0000","last_clean":"2023-08-10T10:30:39.371390+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:30:39.371390+0000","last_undegraded":"2023-08-10T10:30:39.371390+0000","last_fullsized":"2023-08-10T10:30:39.371390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984167+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:30:39.984167+0000","last_peered":"2023-08-10T10:30:39.984167+0000","last_clean":"2023-08-10T10:30:39.984167+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:30:39.984167+0000","last_undegraded":"2023-08-10T10:30:39.984167+0000","last_fullsized":"2023-08-10T10:30:39.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:55.653411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873193+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:30:39.873193+0000","last_peered":"2023-08-10T10:30:39.873193+0000","last_clean":"2023-08-10T10:30:39.873193+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:30:39.873193+0000","last_undegraded":"2023-08-10T10:30:39.873193+0000","last_fullsized":"2023-08-10T10:30:39.873193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:44.518583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982243+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:30:39.982243+0000","last_peered":"2023-08-10T10:30:39.982243+0000","last_clean":"2023-08-10T10:30:39.982243+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:30:39.982243+0000","last_undegraded":"2023-08-10T10:30:39.982243+0000","last_fullsized":"2023-08-10T10:30:39.982243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982179+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:30:39.982179+0000","last_peered":"2023-08-10T10:30:39.982179+0000","last_clean":"2023-08-10T10:30:39.982179+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:30:39.982179+0000","last_undegraded":"2023-08-10T10:30:39.982179+0000","last_fullsized":"2023-08-10T10:30:39.982179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983789+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:30:39.983789+0000","last_peered":"2023-08-10T10:30:39.983789+0000","last_clean":"2023-08-10T10:30:39.983789+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:30:39.983789+0000","last_undegraded":"2023-08-10T10:30:39.983789+0000","last_fullsized":"2023-08-10T10:30:39.983789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:50:24.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982789+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:30:39.982789+0000","last_peered":"2023-08-10T10:30:39.982789+0000","last_clean":"2023-08-10T10:30:39.982789+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:30:39.982789+0000","last_undegraded":"2023-08-10T10:30:39.982789+0000","last_fullsized":"2023-08-10T10:30:39.982789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:04.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370966+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:30:39.370966+0000","last_peered":"2023-08-10T10:30:39.370966+0000","last_clean":"2023-08-10T10:30:39.370966+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:30:39.370966+0000","last_undegraded":"2023-08-10T10:30:39.370966+0000","last_fullsized":"2023-08-10T10:30:39.370966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:05.482062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872971+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:30:39.872971+0000","last_peered":"2023-08-10T10:30:39.872971+0000","last_clean":"2023-08-10T10:30:39.872971+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:30:39.872971+0000","last_undegraded":"2023-08-10T10:30:39.872971+0000","last_fullsized":"2023-08-10T10:30:39.872971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983288+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:30:39.983288+0000","last_peered":"2023-08-10T10:30:39.983288+0000","last_clean":"2023-08-10T10:30:39.983288+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:30:39.983288+0000","last_undegraded":"2023-08-10T10:30:39.983288+0000","last_fullsized":"2023-08-10T10:30:39.983288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369221+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:30:39.369221+0000","last_peered":"2023-08-10T10:30:39.369221+0000","last_clean":"2023-08-10T10:30:39.369221+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:30:39.369221+0000","last_undegraded":"2023-08-10T10:30:39.369221+0000","last_fullsized":"2023-08-10T10:30:39.369221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:55:31.891569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370491+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:30:39.370491+0000","last_peered":"2023-08-10T10:30:39.370491+0000","last_clean":"2023-08-10T10:30:39.370491+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:30:39.370491+0000","last_undegraded":"2023-08-10T10:30:39.370491+0000","last_fullsized":"2023-08-10T10:30:39.370491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:10.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983827+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:30:39.983827+0000","last_peered":"2023-08-10T10:30:39.983827+0000","last_clean":"2023-08-10T10:30:39.983827+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:30:39.983827+0000","last_undegraded":"2023-08-10T10:30:39.983827+0000","last_fullsized":"2023-08-10T10:30:39.983827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.372064+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:30:39.372064+0000","last_peered":"2023-08-10T10:30:39.372064+0000","last_clean":"2023-08-10T10:30:39.372064+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:30:39.372064+0000","last_undegraded":"2023-08-10T10:30:39.372064+0000","last_fullsized":"2023-08-10T10:30:39.372064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983306+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:30:39.983306+0000","last_peered":"2023-08-10T10:30:39.983306+0000","last_clean":"2023-08-10T10:30:39.983306+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:30:39.983306+0000","last_undegraded":"2023-08-10T10:30:39.983306+0000","last_fullsized":"2023-08-10T10:30:39.983306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984069+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:30:39.984069+0000","last_peered":"2023-08-10T10:30:39.984069+0000","last_clean":"2023-08-10T10:30:39.984069+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:30:39.984069+0000","last_undegraded":"2023-08-10T10:30:39.984069+0000","last_fullsized":"2023-08-10T10:30:39.984069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370682+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:30:39.370682+0000","last_peered":"2023-08-10T10:30:39.370682+0000","last_clean":"2023-08-10T10:30:39.370682+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:30:39.370682+0000","last_undegraded":"2023-08-10T10:30:39.370682+0000","last_fullsized":"2023-08-10T10:30:39.370682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370384+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:30:39.370384+0000","last_peered":"2023-08-10T10:30:39.370384+0000","last_clean":"2023-08-10T10:30:39.370384+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:30:39.370384+0000","last_undegraded":"2023-08-10T10:30:39.370384+0000","last_fullsized":"2023-08-10T10:30:39.370384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983703+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:30:39.983703+0000","last_peered":"2023-08-10T10:30:39.983703+0000","last_clean":"2023-08-10T10:30:39.983703+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:30:39.983703+0000","last_undegraded":"2023-08-10T10:30:39.983703+0000","last_fullsized":"2023-08-10T10:30:39.983703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983297+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:30:39.983297+0000","last_peered":"2023-08-10T10:30:39.983297+0000","last_clean":"2023-08-10T10:30:39.983297+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:30:39.983297+0000","last_undegraded":"2023-08-10T10:30:39.983297+0000","last_fullsized":"2023-08-10T10:30:39.983297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872672+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:30:39.872672+0000","last_peered":"2023-08-10T10:30:39.872672+0000","last_clean":"2023-08-10T10:30:39.872672+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:30:39.872672+0000","last_undegraded":"2023-08-10T10:30:39.872672+0000","last_fullsized":"2023-08-10T10:30:39.872672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:07.784753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983138+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:30:39.983138+0000","last_peered":"2023-08-10T10:30:39.983138+0000","last_clean":"2023-08-10T10:30:39.983138+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:30:39.983138+0000","last_undegraded":"2023-08-10T10:30:39.983138+0000","last_fullsized":"2023-08-10T10:30:39.983138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:49.538451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370654+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:30:39.370654+0000","last_peered":"2023-08-10T10:30:39.370654+0000","last_clean":"2023-08-10T10:30:39.370654+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:30:39.370654+0000","last_undegraded":"2023-08-10T10:30:39.370654+0000","last_fullsized":"2023-08-10T10:30:39.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984216+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:30:39.984216+0000","last_peered":"2023-08-10T10:30:39.984216+0000","last_clean":"2023-08-10T10:30:39.984216+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:30:39.984216+0000","last_undegraded":"2023-08-10T10:30:39.984216+0000","last_fullsized":"2023-08-10T10:30:39.984216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:58:25.947292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983467+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:30:39.983467+0000","last_peered":"2023-08-10T10:30:39.983467+0000","last_clean":"2023-08-10T10:30:39.983467+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:30:39.983467+0000","last_undegraded":"2023-08-10T10:30:39.983467+0000","last_fullsized":"2023-08-10T10:30:39.983467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371344+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:30:39.371344+0000","last_peered":"2023-08-10T10:30:39.371344+0000","last_clean":"2023-08-10T10:30:39.371344+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:30:39.371344+0000","last_undegraded":"2023-08-10T10:30:39.371344+0000","last_fullsized":"2023-08-10T10:30:39.371344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.149063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983858+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:30:39.983858+0000","last_peered":"2023-08-10T10:30:39.983858+0000","last_clean":"2023-08-10T10:30:39.983858+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:30:39.983858+0000","last_undegraded":"2023-08-10T10:30:39.983858+0000","last_fullsized":"2023-08-10T10:30:39.983858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873013+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:30:39.873013+0000","last_peered":"2023-08-10T10:30:39.873013+0000","last_clean":"2023-08-10T10:30:39.873013+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:30:39.873013+0000","last_undegraded":"2023-08-10T10:30:39.873013+0000","last_fullsized":"2023-08-10T10:30:39.873013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60299999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81000000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:30:57.286 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-10T10:30:57.287 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-10T10:30:57.287 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-10T10:30:57.287 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-10T10:30:57.288 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-10T10:30:57.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.515+0000 7fc169dff700 1 Processor -- start 2023-08-10T10:30:57.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.515+0000 7fc169dff700 1 -- start start 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc169dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc169dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1640b5040 0x7fc1640d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc169dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1640b5480 con 0x7fc16415cf20 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc169dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1640cde30 con 0x7fc1640b5040 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc169dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640b8e30 con 0x7fc1640b8870 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc163fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc1640b5040 0x7fc1640d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc1637fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc16415cf20 0x7fc16415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39882/0 (socket says 172.21.15.88:39882) 2023-08-10T10:30:57.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.516+0000 7fc1637fe700 1 -- 172.21.15.88:0/3019236063 learned_addr learned my addr 172.21.15.88:0/3019236063 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc162ffd700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc163fff700 1 -- 172.21.15.88:0/3019236063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 msgr2=0x7fc1640b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc163fff700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc163fff700 1 -- 172.21.15.88:0/3019236063 >> v1:172.21.15.88:6789/0 conn(0x7fc16415cf20 legacy=0x7fc16415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc163fff700 1 -- 172.21.15.88:0/3019236063 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640ce010 con 0x7fc1640b5040 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc1627fc700 1 -- 172.21.15.88:0/3019236063 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2556775894 0 0) 0x7fc1640b5480 con 0x7fc16415cf20 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc163fff700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1640d1350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009d90 tx=0x7fc15c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8959c12821cba5fe server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc1627fc700 1 -- 172.21.15.88:0/3019236063 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00e070 con 0x7fc1640b5040 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc1627fc700 1 -- 172.21.15.88:0/3019236063 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc15c00bb20 con 0x7fc1640b5040 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.517+0000 7fc1627fc700 1 -- 172.21.15.88:0/3019236063 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc15c012430 con 0x7fc1640b5040 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 -- 172.21.15.88:0/3019236063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 msgr2=0x7fc1640d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1640d1350 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009d90 tx=0x7fc15c00b330 comp rx=0 tx=0).stop 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 -- 172.21.15.88:0/3019236063 shutdown_connections 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1640d1350 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 --2- 172.21.15.88:0/3019236063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 -- 172.21.15.88:0/3019236063 >> 172.21.15.88:0/3019236063 conn(0x7fc1640d3080 msgr2=0x7fc1640d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 -- 172.21.15.88:0/3019236063 shutdown_connections 2023-08-10T10:30:57.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.518+0000 7fc169dff700 1 -- 172.21.15.88:0/3019236063 wait complete. 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.520+0000 7fc169dff700 1 Processor -- start 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.520+0000 7fc169dff700 1 -- start start 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640c8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16415cf20 0x7fc16414abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640c9750 con 0x7fc1640b5040 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16414b120 con 0x7fc16415cf20 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc169dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1640c8b40 con 0x7fc1640b8870 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc1637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc1637fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41284/0 (socket says 172.21.15.88:41284) 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.521+0000 7fc1637fe700 1 -- 172.21.15.88:0/2822157798 learned_addr learned my addr 172.21.15.88:0/2822157798 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 -- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 msgr2=0x7fc1640c8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640c8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 -- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16415cf20 msgr2=0x7fc16414abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16415cf20 0x7fc16414abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 -- 172.21.15.88:0/2822157798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c009a70 con 0x7fc1640b5040 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc1637fe700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c550 tx=0x7fc15400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154004c80 con 0x7fc1640b5040 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc154004e00 con 0x7fc1640b5040 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1640c8e20 con 0x7fc1640b5040 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc154007310 con 0x7fc1640b5040 2023-08-10T10:30:57.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.522+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1640c93e0 con 0x7fc1640b5040 2023-08-10T10:30:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.523+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16404ecc0 con 0x7fc1640b5040 2023-08-10T10:30:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.524+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc154007470 con 0x7fc1640b5040 2023-08-10T10:30:57.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.525+0000 7fc14bfff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 0x7fc15006d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:57.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.525+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fc154089600 con 0x7fc1640b5040 2023-08-10T10:30:57.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.525+0000 7fc162ffd700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 0x7fc15006d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:57.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.526+0000 7fc162ffd700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 0x7fc15006d1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc158006b20 tx=0x7fc158006ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:57.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.529+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc154054290 con 0x7fc1640b5040 2023-08-10T10:30:57.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.781+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc1640d1ed0 con 0x7fc1640b5040 2023-08-10T10:30:57.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.784+0000 7fc14bfff700 1 -- 172.21.15.88:0/2822157798 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170840 (secure 0 0 0) 0x7fc1540578b0 con 0x7fc1640b5040 2023-08-10T10:30:57.788 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:57.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 msgr2=0x7fc15006d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 0x7fc15006d1d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc158006b20 tx=0x7fc158006ab0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 msgr2=0x7fc1641f5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc15400c550 tx=0x7fc15400c910 comp rx=0 tx=0).stop 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 shutdown_connections 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc16415cf20 0x7fc16414abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc1640b5040 0x7fc1641f5bd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc15006ad10 0x7fc15006d1d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 --2- 172.21.15.88:0/2822157798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1640b8870 0x7fc1640c8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:57.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 >> 172.21.15.88:0/2822157798 conn(0x7fc1640d3080 msgr2=0x7fc1640d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:57.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 shutdown_connections 2023-08-10T10:30:57.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:57.788+0000 7fc169dff700 1 -- 172.21.15.88:0/2822157798 wait complete. 2023-08-10T10:30:57.807 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":1444548676},{"type":"v1","addr":"172.21.15.88:6833","nonce":1444548676}]},"active_addr":"172.21.15.88:6833/1444548676","active_change":"2023-08-10T10:30:13.510919+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3893170489}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":847236199}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":959901393}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1401717051}]}]} 2023-08-10T10:30:57.811 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-10T10:30:57.812 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-10T10:30:57.812 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.007+0000 7f755d3ff700 1 Processor -- start 2023-08-10T10:30:58.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.008+0000 7f755d3ff700 1 -- start start 2023-08-10T10:30:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f755d3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f755815cf20 0x7f755815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f755d3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f755815e590 con 0x7f75580b8870 2023-08-10T10:30:58.010 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f755d3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75580b8e30 con 0x7f75580b5210 2023-08-10T10:30:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f755d3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75580cde30 con 0x7f755815cf20 2023-08-10T10:30:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f754ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f75580b8870 0x7f75580b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39892/0 (socket says 172.21.15.88:39892) 2023-08-10T10:30:58.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f754ffff700 1 -- 172.21.15.88:0/3325217871 learned_addr learned my addr 172.21.15.88:0/3325217871 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f7556ffd700 1 --2- 172.21.15.88:0/3325217871 >> v2:172.21.15.187:3300/0 conn(0x7f755815cf20 0x7f755815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.009+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517786033 0 0) 0x7f755815e590 con 0x7f75580b8870 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75440035b0 con 0x7f75580b8870 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3561913694 0 0) 0x7f75440035b0 con 0x7f75580b8870 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 >> v2:172.21.15.187:3300/0 conn(0x7f755815cf20 msgr2=0x7f755815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 --2- 172.21.15.88:0/3325217871 >> v2:172.21.15.187:3300/0 conn(0x7f755815cf20 0x7f755815e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 >> v1:172.21.15.187:6789/0 conn(0x7f75580b5210 legacy=0x7f75580d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580ce010 con 0x7f75580b8870 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f7540001670 con 0x7f75580b8870 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 >> v1:172.21.15.88:6789/0 conn(0x7f75580b8870 legacy=0x7f75580b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7544003a00 0x7f7544003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 0x7f7544004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544005210 0x7f754400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580cde30 con 0x7f7544004850 2023-08-10T10:30:58.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754400c110 con 0x7f7544005210 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754400c2d0 con 0x7f7544003a00 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f754ffff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 0x7f7544004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f75577fe700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544005210 0x7f754400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.010+0000 7f7556ffd700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7544003a00 0x7f7544003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 -- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7544003a00 msgr2=0x7f7544003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7544003a00 0x7f7544003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 -- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544005210 msgr2=0x7f754400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544005210 0x7f754400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 -- 172.21.15.88:0/3325217871 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75440035b0 con 0x7f7544004850 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f75577fe700 1 -- 172.21.15.88:0/3325217871 reap_dead start 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f754ffff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 0x7f7544004cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7540005010 tx=0x7f7544005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cd9293bd70311 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7540004ab0 con 0x7f7544004850 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7540005b60 con 0x7f7544004850 2023-08-10T10:30:58.016 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.011+0000 7f75567fc700 1 -- 172.21.15.88:0/3325217871 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75400080e0 con 0x7f7544004850 2023-08-10T10:30:58.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 -- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 msgr2=0x7f7544004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 0x7f7544004cd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7540005010 tx=0x7f7544005880 comp rx=0 tx=0).stop 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 -- 172.21.15.88:0/3325217871 shutdown_connections 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 --2- 172.21.15.88:0/3325217871 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7544004850 0x7f7544004cd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 -- 172.21.15.88:0/3325217871 >> 172.21.15.88:0/3325217871 conn(0x7f75580d3080 msgr2=0x7f75580d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 -- 172.21.15.88:0/3325217871 shutdown_connections 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.012+0000 7f755d3ff700 1 -- 172.21.15.88:0/3325217871 wait complete. 2023-08-10T10:30:58.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.014+0000 7f755d3ff700 1 Processor -- start 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.014+0000 7f755d3ff700 1 -- start start 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 0x7f755814eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75580b6c30 0x7f755815ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c7210 con 0x7f755815f440 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755815fa70 con 0x7f7544004850 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f755d3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75580b6150 con 0x7f75580b6c30 2023-08-10T10:30:58.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f7556ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 0x7f755814eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41302/0 (socket says 172.21.15.88:41302) 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 -- 172.21.15.88:0/2640511995 learned_addr learned my addr 172.21.15.88:0/2640511995 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f754ffff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75580b6c30 0x7f755815ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 -- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75580b6c30 msgr2=0x7f755815ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75580b6c30 0x7f755815ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 -- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 msgr2=0x7f755814eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 0x7f755814eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f75577fe700 1 -- 172.21.15.88:0/2640511995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75580b6430 con 0x7f755815f440 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.015+0000 7f7556ffd700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 0x7f755814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f75577fe700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75580cede0 tx=0x7f755000ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550003cd0 con 0x7f755815f440 2023-08-10T10:30:58.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7550003e30 con 0x7f755815f440 2023-08-10T10:30:58.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75580b6710 con 0x7f755815f440 2023-08-10T10:30:58.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7550005310 con 0x7f755815f440 2023-08-10T10:30:58.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.016+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755814f930 con 0x7f755815f440 2023-08-10T10:30:58.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.017+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755804ecc0 con 0x7f755815f440 2023-08-10T10:30:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.018+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7550005470 con 0x7f755815f440 2023-08-10T10:30:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.019+0000 7f754f7fe700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 0x7f753806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.019+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7550089850 con 0x7f755815f440 2023-08-10T10:30:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.019+0000 7f7556ffd700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 0x7f753806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.020+0000 7f7556ffd700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 0x7f753806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75580d1d80 tx=0x7f7548009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.023+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7550054570 con 0x7f755815f440 2023-08-10T10:30:58.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.221+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75580cd5f0 con 0x7f755815f440 2023-08-10T10:30:58.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.222+0000 7f754f7fe700 1 -- 172.21.15.88:0/2640511995 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f7550057b90 con 0x7f755815f440 2023-08-10T10:30:58.224 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:58.224 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.224+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 msgr2=0x7f753806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.224+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 0x7f753806d1a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f75580d1d80 tx=0x7f7548009210 comp rx=0 tx=0).stop 2023-08-10T10:30:58.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.224+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 msgr2=0x7f75580b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.224+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f75580cede0 tx=0x7f755000ff00 comp rx=0 tx=0).stop 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 shutdown_connections 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f755815f440 0x7f75580b3b30 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7544004850 0x7f755814eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f753806ace0 0x7f753806d1a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 --2- 172.21.15.88:0/2640511995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75580b6c30 0x7f755815ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 >> 172.21.15.88:0/2640511995 conn(0x7f75580d3080 msgr2=0x7f75580d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:58.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 shutdown_connections 2023-08-10T10:30:58.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.225+0000 7f755d3ff700 1 -- 172.21.15.88:0/2640511995 wait complete. 2023-08-10T10:30:58.244 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-10T10:30:58.245 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:30:58.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.444+0000 7f82ae1ff700 1 Processor -- start 2023-08-10T10:30:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.444+0000 7f82ae1ff700 1 -- start start 2023-08-10T10:30:58.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.445+0000 7f82ae1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 0x7f82a80d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.445+0000 7f82ae1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f82a80cd870 0x7f82a80cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.445+0000 7f82ae1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a80ce610 con 0x7f82a806bf90 2023-08-10T10:30:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.445+0000 7f82ae1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a80d21b0 con 0x7f82a80cd870 2023-08-10T10:30:58.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.445+0000 7f82ae1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80ce330 con 0x7f82a815ced0 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f82a806bf90 0x7f82a80b60a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39898/0 (socket says 172.21.15.88:39898) 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a7fff700 1 -- 172.21.15.88:0/2693711409 learned_addr learned my addr 172.21.15.88:0/2693711409 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a77fe700 1 --2- 172.21.15.88:0/2693711409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 0x7f82a80d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a6ffd700 1 --2- 172.21.15.88:0/2693711409 >> v2:172.21.15.187:3300/0 conn(0x7f82a80cd870 0x7f82a80cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647549144 0 0) 0x7f82a80ce610 con 0x7f82a806bf90 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82900035b0 con 0x7f82a806bf90 2023-08-10T10:30:58.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547998307 0 0) 0x7f82900035b0 con 0x7f82a806bf90 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a77fe700 1 -- 172.21.15.88:0/2693711409 >> v2:172.21.15.187:3300/0 conn(0x7f82a80cd870 msgr2=0x7f82a80cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a77fe700 1 --2- 172.21.15.88:0/2693711409 >> v2:172.21.15.187:3300/0 conn(0x7f82a80cd870 0x7f82a80cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a77fe700 1 -- 172.21.15.88:0/2693711409 >> v1:172.21.15.88:6789/0 conn(0x7f82a806bf90 legacy=0x7f82a80b60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.446+0000 7f82a77fe700 1 -- 172.21.15.88:0/2693711409 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a80d1190 con 0x7f82a815ced0 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82a77fe700 1 --2- 172.21.15.88:0/2693711409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 0x7f82a80d1c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8298009840 tx=0x7f8298009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa4d2bb2d7af0da0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00019f0 con 0x7f82a815ced0 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8298004030 con 0x7f82a815ced0 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82a67fc700 1 -- 172.21.15.88:0/2693711409 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82980043c0 con 0x7f82a815ced0 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 -- 172.21.15.88:0/2693711409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 msgr2=0x7f82a80d1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/2693711409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 0x7f82a80d1c70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f8298009840 tx=0x7f8298009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 -- 172.21.15.88:0/2693711409 shutdown_connections 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/2693711409 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a815ced0 0x7f82a80d1c70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/2693711409 >> v2:172.21.15.187:3300/0 conn(0x7f82a80cd870 0x7f82a80cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 -- 172.21.15.88:0/2693711409 >> 172.21.15.88:0/2693711409 conn(0x7f82a80d31f0 msgr2=0x7f82a80d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 -- 172.21.15.88:0/2693711409 shutdown_connections 2023-08-10T10:30:58.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.447+0000 7f82ae1ff700 1 -- 172.21.15.88:0/2693711409 wait complete. 2023-08-10T10:30:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.449+0000 7f82ae1ff700 1 Processor -- start 2023-08-10T10:30:58.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.449+0000 7f82ae1ff700 1 -- start start 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a806bf90 0x7f82a80b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a80cd870 0x7f82a81efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80b5110 con 0x7f82a815ced0 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a815add0 con 0x7f82a806bf90 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82ae1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a80a98f0 con 0x7f82a80cd870 2023-08-10T10:30:58.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82a7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82a7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41304/0 (socket says 172.21.15.88:41304) 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82a7fff700 1 -- 172.21.15.88:0/1211717646 learned_addr learned my addr 172.21.15.88:0/1211717646 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.450+0000 7f82a6ffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a80cd870 0x7f82a81efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a77fe700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a806bf90 0x7f82a80b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 -- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a80cd870 msgr2=0x7f82a81efe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a80cd870 0x7f82a81efe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 -- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a806bf90 msgr2=0x7f82a80b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a806bf90 0x7f82a80b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 -- 172.21.15.88:0/1211717646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82980094a0 con 0x7f82a815ced0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82a7fff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cc00 tx=0x7f82a000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a000aa20 con 0x7f82a815ced0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82a000aba0 con 0x7f82a815ced0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a00070d0 con 0x7f82a815ced0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.451+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a80b3af0 con 0x7f82a815ced0 2023-08-10T10:30:58.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.452+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a80b40b0 con 0x7f82a815ced0 2023-08-10T10:30:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.452+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a80a9b10 con 0x7f82a815ced0 2023-08-10T10:30:58.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.453+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f82a0007230 con 0x7f82a815ced0 2023-08-10T10:30:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.454+0000 7f828ffff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 0x7f829406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.454+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f82a00891a0 con 0x7f82a815ced0 2023-08-10T10:30:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.454+0000 7f82a77fe700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 0x7f829406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:58.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.455+0000 7f82a77fe700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 0x7f829406d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82980090b0 tx=0x7f8298008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:58.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.459+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f82a80a9b10 con 0x7f82a815ced0 2023-08-10T10:30:58.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.655+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82a80ce530 con 0x7f82a815ced0 2023-08-10T10:30:58.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.657+0000 7f828ffff700 1 -- 172.21.15.88:0/1211717646 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f82a0053f50 con 0x7f82a815ced0 2023-08-10T10:30:58.658 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:30:58.659 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:30:58.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 msgr2=0x7f829406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 0x7f829406d1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f82980090b0 tx=0x7f8298008030 comp rx=0 tx=0).stop 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 msgr2=0x7f82a80b4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f82a000cc00 tx=0x7f82a000cf10 comp rx=0 tx=0).stop 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 shutdown_connections 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f82a815ced0 0x7f82a80b4bd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82a806bf90 0x7f82a80b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f829406ace0 0x7f829406d1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 --2- 172.21.15.88:0/1211717646 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f82a80cd870 0x7f82a81efe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:58.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 >> 172.21.15.88:0/1211717646 conn(0x7f82a80d31f0 msgr2=0x7f82a815f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:58.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 shutdown_connections 2023-08-10T10:30:58.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:58.659+0000 7f82ae1ff700 1 -- 172.21.15.88:0/1211717646 wait complete. 2023-08-10T10:30:58.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-10T10:30:58.679 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-10T10:30:58.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-10T10:30:58.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-10T10:30:58.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-10T10:30:58.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-10T10:30:58.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-10T10:30:58.682 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-10T10:30:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f9b559ff700 1 Processor -- start 2023-08-10T10:30:59.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f9b559ff700 1 -- start start 2023-08-10T10:30:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.035+0000 7f17af7ff700 1 Processor -- start 2023-08-10T10:30:59.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.035+0000 7f17af7ff700 1 -- start start 2023-08-10T10:30:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f17af7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a80cd3c0 0x7f17a8169ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f17af7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f17a8089170 0x7f17a816a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f17af7ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a806bb10 con 0x7f17a80cd7a0 2023-08-10T10:30:59.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f17af7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17a80ccf10 con 0x7f17a8089170 2023-08-10T10:30:59.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.037+0000 7f17af7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a806b550 con 0x7f17a80cd3c0 2023-08-10T10:30:59.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.038+0000 7f17ad59b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a80cd3c0 0x7f17a8169ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.038+0000 7f17ad59b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a80cd3c0 0x7f17a8169ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50012/0 (socket says 172.21.15.88:50012) 2023-08-10T10:30:59.044 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.038+0000 7f17ad59b700 1 -- 172.21.15.88:0/524769658 learned_addr learned my addr 172.21.15.88:0/524769658 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.039+0000 7f17acd9a700 1 --2- 172.21.15.88:0/524769658 >> v2:172.21.15.88:3300/0 conn(0x7f17a8089170 0x7f17a816a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.039+0000 7f9b559ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9b50161610 0x7f9b500cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.039+0000 7f9b559ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5006af90 con 0x7f9b5006b420 2023-08-10T10:30:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.039+0000 7f9b559ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b5006d650 con 0x7f9b501619f0 2023-08-10T10:30:59.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.039+0000 7f9b559ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b5006b990 con 0x7f9b50161610 2023-08-10T10:30:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.041+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2698141654 0 0) 0x7f17a0001490 con 0x7f17a80cd7a0 2023-08-10T10:30:59.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.041+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17940035b0 con 0x7f17a80cd7a0 2023-08-10T10:30:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7fd685fff700 1 Processor -- start 2023-08-10T10:30:59.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7fd685fff700 1 -- start start 2023-08-10T10:30:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2894215375 0 0) 0x7f17940035b0 con 0x7f17a80cd7a0 2023-08-10T10:30:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a80cd3c0 msgr2=0x7f17a8169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a80cd3c0 0x7f17a8169ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 >> v2:172.21.15.88:3300/0 conn(0x7f17a8089170 msgr2=0x7f17a816a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 --2- 172.21.15.88:0/524769658 >> v2:172.21.15.88:3300/0 conn(0x7f17a8089170 0x7f17a816a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a806b830 con 0x7f17a80cd7a0 2023-08-10T10:30:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f17a0001b80 con 0x7f17a80cd7a0 2023-08-10T10:30:59.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 >> v1:172.21.15.88:6789/0 conn(0x7f17a80cd7a0 legacy=0x7f17a806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794003a00 0x7f1794003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1794004850 0x7f1794004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794009a00 0x7f1794005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80ccf10 con 0x7f1794009a00 2023-08-10T10:30:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a806b550 con 0x7f1794003a00 2023-08-10T10:30:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1794014990 con 0x7f1794004850 2023-08-10T10:30:59.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7f17add9c700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794009a00 0x7f1794005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7fd685fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd6800ca750 0x7fd6800cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.041+0000 7f9b4e7fc700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9b501619f0 0x7f9b5006a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35918/0 (socket says 172.21.15.88:35918) 2023-08-10T10:30:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.041+0000 7f9b4e7fc700 1 -- 172.21.15.88:0/3586033595 learned_addr learned my addr 172.21.15.88:0/3586033595 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140864590 0 0) 0x7f9b5006d650 con 0x7f9b501619f0 2023-08-10T10:30:59.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b380035b0 con 0x7f9b501619f0 2023-08-10T10:30:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2774193889 0 0) 0x7f9b380035b0 con 0x7f9b501619f0 2023-08-10T10:30:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 >> v2:172.21.15.88:3300/0 conn(0x7f9b50161610 msgr2=0x7f9b500cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 --2- 172.21.15.88:0/3586033595 >> v2:172.21.15.88:3300/0 conn(0x7f9b50161610 0x7f9b500cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 >> v1:172.21.15.88:6789/0 conn(0x7f9b5006b420 legacy=0x7f9b5006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5006d920 con 0x7f9b501619f0 2023-08-10T10:30:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f9b44001670 con 0x7f9b501619f0 2023-08-10T10:30:59.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 >> v1:172.21.15.187:6789/0 conn(0x7f9b501619f0 legacy=0x7f9b5006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38003a00 0x7f9b38003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b38004850 0x7f9b38004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 0x7f9b3800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5006b990 con 0x7f9b38003a00 2023-08-10T10:30:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3800c230 con 0x7f9b38005330 2023-08-10T10:30:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.042+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b3800c3f0 con 0x7f9b38004850 2023-08-10T10:30:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.043+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 0x7f9b3800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4e7fc700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b38004850 0x7f9b38004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4effd700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38003a00 0x7f9b38003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7fd685fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd68015ca10 con 0x7fd68006d380 2023-08-10T10:30:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7fd685fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800cac50 con 0x7fd68015c630 2023-08-10T10:30:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7fd685fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800caf30 con 0x7fd6800ca750 2023-08-10T10:30:59.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7fd67f7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd68015c630 0x7fd68006cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35928/0 (socket says 172.21.15.88:35928) 2023-08-10T10:30:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7fd67f7fe700 1 -- 172.21.15.88:0/253386100 learned_addr learned my addr 172.21.15.88:0/253386100 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7f0a933ff700 1 Processor -- start 2023-08-10T10:30:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.044+0000 7f0a933ff700 1 -- start start 2023-08-10T10:30:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605458620 0 0) 0x7fd6800cac50 con 0x7fd68015c630 2023-08-10T10:30:59.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd66c0035b0 con 0x7fd68015c630 2023-08-10T10:30:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f17add9c700 1 -- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1794004850 msgr2=0x7f1794004cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:30:59.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f17add9c700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1794004850 0x7f1794004cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f17add9c700 1 -- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794003a00 msgr2=0x7f1794003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f17add9c700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1794003a00 0x7f1794003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f17add9c700 1 -- 172.21.15.88:0/524769658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a806b830 con 0x7f1794009a00 2023-08-10T10:30:59.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7f17add9c700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794009a00 0x7f1794005270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a000a920 tx=0x7f1794005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=926923eb1fc804a7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b38004850 msgr2=0x7f9b38004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b38004850 0x7f9b38004cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3586033595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38003a00 msgr2=0x7f9b38003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38003a00 0x7f9b38003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.045+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3586033595 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b5006d920 con 0x7f9b38005330 2023-08-10T10:30:59.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3586033595 reap_dead start 2023-08-10T10:30:59.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 0x7f9b3800ba10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001db0 tx=0x7f9b38005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdec955376cfb4a4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0012620 con 0x7f1794009a00 2023-08-10T10:30:59.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a0012780 con 0x7f1794009a00 2023-08-10T10:30:59.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f179ffff700 1 -- 172.21.15.88:0/524769658 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0012b30 con 0x7f1794009a00 2023-08-10T10:30:59.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f17af7ff700 1 -- 172.21.15.88:0/524769658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794009a00 msgr2=0x7f1794005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f17af7ff700 1 --2- 172.21.15.88:0/524769658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1794009a00 0x7f1794005270 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f17a000a920 tx=0x7f1794005880 comp rx=0 tx=0).stop 2023-08-10T10:30:59.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f17add9c700 1 -- 172.21.15.88:0/524769658 reap_dead start 2023-08-10T10:30:59.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f17af7ff700 1 -- 172.21.15.88:0/524769658 shutdown_connections 2023-08-10T10:30:59.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f17af7ff700 1 -- 172.21.15.88:0/524769658 >> 172.21.15.88:0/524769658 conn(0x7f17a80cb5f0 msgr2=0x7f17a80cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48001850 con 0x7f9b38005330 2023-08-10T10:30:59.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48003c20 con 0x7f9b38005330 2023-08-10T10:30:59.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7f9b4dffb700 1 -- 172.21.15.88:0/3586033595 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480050d0 con 0x7f9b38005330 2023-08-10T10:30:59.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4259690676 0 0) 0x7fd66c0035b0 con 0x7fd68015c630 2023-08-10T10:30:59.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 >> v2:172.21.15.187:3300/0 conn(0x7fd6800ca750 msgr2=0x7fd6800cd930 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:30:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 --2- 172.21.15.88:0/253386100 >> v2:172.21.15.187:3300/0 conn(0x7fd6800ca750 0x7fd6800cd930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 >> v1:172.21.15.88:6789/0 conn(0x7fd68006d380 legacy=0x7fd6800cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800cc740 con 0x7fd68015c630 2023-08-10T10:30:59.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fd6700019f0 con 0x7fd68015c630 2023-08-10T10:30:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.046+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 >> v1:172.21.15.187:6789/0 conn(0x7fd68015c630 legacy=0x7fd68006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd66c003a00 0x7fd66c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 0x7fd66c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c005410 0x7fd66c00ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800caf30 con 0x7fd66c003a00 2023-08-10T10:30:59.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c00c2d0 con 0x7fd66c005410 2023-08-10T10:30:59.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.047+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c00c490 con 0x7fd66c004850 2023-08-10T10:30:59.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f0a933ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0a8c0cd150 0x7f0a8c06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f9b559ff700 1 -- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 msgr2=0x7f9b3800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f9b559ff700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 0x7f9b3800ba10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001db0 tx=0x7f9b38005880 comp rx=0 tx=0).stop 2023-08-10T10:30:59.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7fd676ffd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 0x7fd66c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7fd67ffff700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c005410 0x7fd66c00ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f0a933ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0899e0 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f0a9119b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0a8c16d730 0x7f0a8c06b420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35940/0 (socket says 172.21.15.88:35940) 2023-08-10T10:30:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.048+0000 7f0a9119b700 1 -- 172.21.15.88:0/2270718917 learned_addr learned my addr 172.21.15.88:0/2270718917 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a8c0caa30 con 0x7f0a8c16d730 2023-08-10T10:30:59.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a8c0cd680 con 0x7f0a8c0cd150 2023-08-10T10:30:59.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f0a9099a700 1 --2- 172.21.15.88:0/2270718917 >> v2:172.21.15.187:3300/0 conn(0x7f0a8c0cd150 0x7f0a8c06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f9b559ff700 1 -- 172.21.15.88:0/3586033595 shutdown_connections 2023-08-10T10:30:59.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f9b559ff700 1 --2- 172.21.15.88:0/3586033595 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b38005330 0x7f9b3800ba10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f9b559ff700 1 -- 172.21.15.88:0/3586033595 >> 172.21.15.88:0/3586033595 conn(0x7f9b500cb5f0 msgr2=0x7f9b500cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 -- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c005410 msgr2=0x7fd66c00ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c005410 0x7fd66c00ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 -- 172.21.15.88:0/253386100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd66c003a00 msgr2=0x7fd66c003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd66c003a00 0x7fd66c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 -- 172.21.15.88:0/253386100 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800cc740 con 0x7fd66c004850 2023-08-10T10:30:59.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f17af7ff700 1 -- 172.21.15.88:0/524769658 shutdown_connections 2023-08-10T10:30:59.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7f17af7ff700 1 -- 172.21.15.88:0/524769658 wait complete. 2023-08-10T10:30:59.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd676ffd700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 0x7fd66c004cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6680017c0 tx=0x7fd66c005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=971eaee1625e583d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd67ffff700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c005410 0x7fd66c00ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:30:59.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.049+0000 7fd67ffff700 1 -- 172.21.15.88:0/253386100 reap_dead start 2023-08-10T10:30:59.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.050+0000 7f9b559ff700 1 -- 172.21.15.88:0/3586033595 shutdown_connections 2023-08-10T10:30:59.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.052+0000 7f17af7ff700 1 Processor -- start 2023-08-10T10:30:59.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.050+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6680052d0 con 0x7fd66c004850 2023-08-10T10:30:59.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.050+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668005430 con 0x7fd66c004850 2023-08-10T10:30:59.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.050+0000 7fd67effd700 1 -- 172.21.15.88:0/253386100 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668003880 con 0x7fd66c004850 2023-08-10T10:30:59.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7fd685fff700 1 -- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 msgr2=0x7fd66c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7fd685fff700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 0x7fd66c004cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd6680017c0 tx=0x7fd66c005880 comp rx=0 tx=0).stop 2023-08-10T10:30:59.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7fd685fff700 1 -- 172.21.15.88:0/253386100 shutdown_connections 2023-08-10T10:30:59.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7fd685fff700 1 --2- 172.21.15.88:0/253386100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd66c004850 0x7fd66c004cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7fd685fff700 1 -- 172.21.15.88:0/253386100 >> 172.21.15.88:0/253386100 conn(0x7fd6800cb5f0 msgr2=0x7fd6800cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7f0a9099a700 1 -- 172.21.15.88:0/2270718917 >> v1:172.21.15.187:6789/0 conn(0x7f0a8c16d730 legacy=0x7f0a8c06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7f0a9099a700 1 -- 172.21.15.88:0/2270718917 >> v1:172.21.15.88:6789/0 conn(0x7f0a8c06dbc0 legacy=0x7f0a8c0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.051+0000 7f0a9099a700 1 -- 172.21.15.88:0/2270718917 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0ccaf0 con 0x7f0a8c0cd150 2023-08-10T10:30:59.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.052+0000 7f0a9099a700 1 --2- 172.21.15.88:0/2270718917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c0cd150 0x7f0a8c06d680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009840 tx=0x7f0a7c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e09a5883e802a6d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.050+0000 7f9b559ff700 1 -- 172.21.15.88:0/3586033595 wait complete. 2023-08-10T10:30:59.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.053+0000 7f9b559ff700 1 Processor -- start 2023-08-10T10:30:59.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.052+0000 7f17af7ff700 1 -- start start 2023-08-10T10:30:59.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7fd685fff700 1 -- 172.21.15.88:0/253386100 shutdown_connections 2023-08-10T10:30:59.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 0x7f17a80aadd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17a80a8470 0x7f17a80ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a81f3990 0x7f17a8202d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80c4ea0 con 0x7f17a80a8470 2023-08-10T10:30:59.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81f3f50 con 0x7f17a816b1c0 2023-08-10T10:30:59.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7f17af7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a81f4230 con 0x7f17a81f3990 2023-08-10T10:30:59.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.054+0000 7fd685fff700 1 -- 172.21.15.88:0/253386100 wait complete. 2023-08-10T10:30:59.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 0x7f17a80aadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 0x7f17a80aadd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39202/0 (socket says 172.21.15.88:39202) 2023-08-10T10:30:59.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 -- 172.21.15.88:0/1622771957 learned_addr learned my addr 172.21.15.88:0/1622771957 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17add9c700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a81f3990 0x7f17a8202d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 -- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a81f3990 msgr2=0x7f17a8202d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a81f3990 0x7f17a8202d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 -- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17a80a8470 msgr2=0x7f17a80ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f17a80a8470 0x7f17a80ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f17ad59b700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a81f4510 con 0x7f17a816b1c0 2023-08-10T10:30:59.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f17ad59b700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 0x7f17a80aadd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17a4007810 tx=0x7f17a4007b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.053+0000 7f9b559ff700 1 -- start start 2023-08-10T10:30:59.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38005330 0x7f9b50156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b501e9ee0 0x7f9b500b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 0x7f9b501ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b500b41a0 con 0x7f9b38005330 2023-08-10T10:30:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501e8e40 con 0x7f9b500b3cf0 2023-08-10T10:30:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f9b559ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b501e9120 con 0x7f9b501e9ee0 2023-08-10T10:30:59.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fd685fff700 1 Processor -- start 2023-08-10T10:30:59.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f0a83fff700 1 -- 172.21.15.88:0/2270718917 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c004230 con 0x7f0a8c0cd150 2023-08-10T10:30:59.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f0a83fff700 1 -- 172.21.15.88:0/2270718917 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a7c004390 con 0x7f0a8c0cd150 2023-08-10T10:30:59.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7f0a83fff700 1 -- 172.21.15.88:0/2270718917 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a7c0036a0 con 0x7f0a8c0cd150 2023-08-10T10:30:59.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c0cd150 msgr2=0x7f0a8c06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f0a933ff700 1 --2- 172.21.15.88:0/2270718917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c0cd150 0x7f0a8c06d680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009840 tx=0x7f0a7c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 shutdown_connections 2023-08-10T10:30:59.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f0a933ff700 1 --2- 172.21.15.88:0/2270718917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c0cd150 0x7f0a8c06d680 secure :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009840 tx=0x7f0a7c009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 >> 172.21.15.88:0/2270718917 conn(0x7f0a8c0cb5f0 msgr2=0x7f0a8c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 shutdown_connections 2023-08-10T10:30:59.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f67f79ff700 1 Processor -- start 2023-08-10T10:30:59.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f67f79ff700 1 -- start start 2023-08-10T10:30:59.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7fb1309ff700 1 Processor -- start 2023-08-10T10:30:59.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.055+0000 7fb1309ff700 1 -- start start 2023-08-10T10:30:59.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a400f040 con 0x7f17a816b1c0 2023-08-10T10:30:59.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a4013610 con 0x7f17a816b1c0 2023-08-10T10:30:59.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a40139e0 con 0x7f17a816b1c0 2023-08-10T10:30:59.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a81f47f0 con 0x7f17a816b1c0 2023-08-10T10:30:59.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a816b5a0 con 0x7f17a816b1c0 2023-08-10T10:30:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f9b4f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 0x7f9b501ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f9b4f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 0x7f9b501ea510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39218/0 (socket says 172.21.15.88:39218) 2023-08-10T10:30:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.056+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3571160174 learned_addr learned my addr 172.21.15.88:0/3571160174 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f9b4e7fc700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b501e9ee0 0x7f9b500b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4effd700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38005330 0x7f9b50156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b501e9ee0 msgr2=0x7f9b500b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b501e9ee0 0x7f9b500b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38005330 msgr2=0x7f9b50156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38005330 0x7f9b50156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b501e9400 con 0x7f9b500b3cf0 2023-08-10T10:30:59.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7f9b4effd700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b38005330 0x7f9b50156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fd685fff700 1 -- start start 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c004850 0x7fd6800c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6801f17c0 0x7fd6800c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 0x7fd680159480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801ee250 con 0x7fd6801f17c0 2023-08-10T10:30:59.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800c84a0 con 0x7fd66c004850 2023-08-10T10:30:59.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.058+0000 7fd685fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6801599c0 con 0x7fd680158fd0 2023-08-10T10:30:59.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7f0a933ff700 1 -- 172.21.15.88:0/2270718917 wait complete. 2023-08-10T10:30:59.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 0x7fd680159480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 0x7fd680159480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50062/0 (socket says 172.21.15.88:50062) 2023-08-10T10:30:59.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 -- 172.21.15.88:0/4192352591 learned_addr learned my addr 172.21.15.88:0/4192352591 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fb1309ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb12c0cae20 0x7fb12c0c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fb1309ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c0cd1a0 con 0x7fb12c0710a0 2023-08-10T10:30:59.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fb1309ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c0c2440 con 0x7fb12c0c2060 2023-08-10T10:30:59.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.057+0000 7fb1309ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c0caa00 con 0x7fb12c0cae20 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd676ffd700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6801f17c0 0x7fd6800c4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 -- 172.21.15.88:0/4192352591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c004850 msgr2=0x7fd6800c7f60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd66c004850 0x7fd6800c7f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 -- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6801f17c0 msgr2=0x7fd6800c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd6801f17c0 0x7fd6800c4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fd67ffff700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800c2640 con 0x7fd680158fd0 2023-08-10T10:30:59.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fb12a59c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb12c0c2060 0x7fb12c070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35948/0 (socket says 172.21.15.88:35948) 2023-08-10T10:30:59.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7fb12a59c700 1 -- 172.21.15.88:0/1717150619 learned_addr learned my addr 172.21.15.88:0/1717150619 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f5ad93ff700 1 Processor -- start 2023-08-10T10:30:59.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f5ad93ff700 1 -- start start 2023-08-10T10:30:59.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7fd67ffff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 0x7fd680159480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6800cab80 tx=0x7fd67800d720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7fb12ad9d700 1 --2- 172.21.15.88:0/1717150619 >> v2:172.21.15.187:3300/0 conn(0x7fb12c0cae20 0x7fb12c0c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7fb12959a700 1 -- 172.21.15.88:0/1717150619 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3527380340 0 0) 0x7fb12c0c2440 con 0x7fb12c0c2060 2023-08-10T10:30:59.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7fb12959a700 1 -- 172.21.15.88:0/1717150619 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1140035b0 con 0x7fb12c0c2060 2023-08-10T10:30:59.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678014430 con 0x7fd680158fd0 2023-08-10T10:30:59.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678014590 con 0x7fd680158fd0 2023-08-10T10:30:59.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678014920 con 0x7fd680158fd0 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f0a933ff700 1 Processor -- start 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f0a933ff700 1 -- start start 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 0x7f0a8c16af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a8c16d730 0x7f0a8c167bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a8c1680f0 0x7f0a8c1fef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c16bb60 con 0x7f0a8c16d730 2023-08-10T10:30:59.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c16b880 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f0a933ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a8c1670d0 con 0x7f0a8c1680f0 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f67f79ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f0158d10 0x7f67f0159190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f67f79ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00c9b10 con 0x7f67f00ccea0 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f67f79ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f00cdf20 con 0x7f67f006ea80 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.059+0000 7f67f79ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f00ca120 con 0x7f67f0158d10 2023-08-10T10:30:59.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f67f4f9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f67f0158d10 0x7f67f0159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f67f5f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f67f00ccea0 0x7f67f0070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39940/0 (socket says 172.21.15.88:39940) 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f67f5f9c700 1 -- 172.21.15.88:0/3103677589 learned_addr learned my addr 172.21.15.88:0/3103677589 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f67f4f9a700 1 --2- 172.21.15.88:0/3103677589 >> v2:172.21.15.88:3300/0 conn(0x7f67f0158d10 0x7f67f0159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41408/0 (socket says 172.21.15.88:41408) 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f67f4f9a700 1 -- 172.21.15.88:0/3103677589 >> v1:172.21.15.187:6789/0 conn(0x7f67f006ea80 legacy=0x7f67f00b1a20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f67f4f9a700 1 -- 172.21.15.88:0/3103677589 >> v1:172.21.15.88:6789/0 conn(0x7f67f00ccea0 legacy=0x7f67f0070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f67f4f9a700 1 -- 172.21.15.88:0/3103677589 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f00b2130 con 0x7f67f0158d10 2023-08-10T10:30:59.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7fb12ad9d700 1 -- 172.21.15.88:0/1717150619 >> v1:172.21.15.187:6789/0 conn(0x7fb12c0c2060 legacy=0x7fb12c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7fb12ad9d700 1 -- 172.21.15.88:0/1717150619 >> v1:172.21.15.88:6789/0 conn(0x7fb12c0710a0 legacy=0x7fb12c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7fb12ad9d700 1 -- 172.21.15.88:0/1717150619 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c0c9d80 con 0x7fb12c0cae20 2023-08-10T10:30:59.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f5ad93ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ad4089170 0x7f5ad406b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f5ad93ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40caa30 con 0x7f5ad406d680 2023-08-10T10:30:59.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f5ad93ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad40ccaf0 con 0x7f5ad40cd150 2023-08-10T10:30:59.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f5ad93ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad40cd680 con 0x7f5ad4089170 2023-08-10T10:30:59.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fb12ad9d700 1 --2- 172.21.15.88:0/1717150619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0cae20 0x7fb12c0c9710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb120009840 tx=0x7fb120009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5e8917e17b05034 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.060+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1788000fc0 con 0x7f17a816b1c0 2023-08-10T10:30:59.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6801f1fa0 con 0x7fd680158fd0 2023-08-10T10:30:59.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6801f2560 con 0x7fd680158fd0 2023-08-10T10:30:59.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f5ad2ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5ad40cd150 0x7f5ad416d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35966/0 (socket says 172.21.15.88:35966) 2023-08-10T10:30:59.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f5ad2ffd700 1 -- 172.21.15.88:0/298144848 learned_addr learned my addr 172.21.15.88:0/298144848 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f67f4f9a700 1 --2- 172.21.15.88:0/3103677589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f0158d10 0x7f67f0159190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009840 tx=0x7f67ec009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76a56ba071e5ffd7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 0x7f0a8c16af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 0x7f0a8c16af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39240/0 (socket says 172.21.15.88:39240) 2023-08-10T10:30:59.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 -- 172.21.15.88:0/726039944 learned_addr learned my addr 172.21.15.88:0/726039944 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9199c700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a8c1680f0 0x7f0a8c1fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 -- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a8c1680f0 msgr2=0x7f0a8c1fef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a8c1680f0 0x7f0a8c1fef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 -- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a8c16d730 msgr2=0x7f0a8c167bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0a8c16d730 0x7f0a8c167bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f0a9119b700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a7c0094a0 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7f0a9119b700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 0x7f0a8c16af50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a88001e70 tx=0x7f0a8800ca60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7f5ad27fc700 1 --2- 172.21.15.88:0/298144848 >> v2:172.21.15.187:3300/0 conn(0x7f5ad4089170 0x7f5ad406b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fb12959a700 1 -- 172.21.15.88:0/1717150619 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011830 con 0x7fb12c0cae20 2023-08-10T10:30:59.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fb12959a700 1 -- 172.21.15.88:0/1717150619 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120011990 con 0x7fb12c0cae20 2023-08-10T10:30:59.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7fb12959a700 1 -- 172.21.15.88:0/1717150619 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120011d20 con 0x7fb12c0cae20 2023-08-10T10:30:59.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7fb1309ff700 1 -- 172.21.15.88:0/1717150619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0cae20 msgr2=0x7fb12c0c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7fb1309ff700 1 --2- 172.21.15.88:0/1717150619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0cae20 0x7fb12c0c9710 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb120009840 tx=0x7fb120009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7f67e7fff700 1 -- 172.21.15.88:0/3103677589 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec004030 con 0x7f67f0158d10 2023-08-10T10:30:59.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7f67e7fff700 1 -- 172.21.15.88:0/3103677589 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec004190 con 0x7f67f0158d10 2023-08-10T10:30:59.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.063+0000 7f67e7fff700 1 -- 172.21.15.88:0/3103677589 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec004520 con 0x7f67f0158d10 2023-08-10T10:30:59.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.061+0000 7f9b4f7fe700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 0x7f9b501ea510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001db0 tx=0x7f9b48001330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f5ad1ffb700 1 -- 172.21.15.88:0/298144848 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095943994 0 0) 0x7f5ad40caa30 con 0x7f5ad406d680 2023-08-10T10:30:59.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f5ad1ffb700 1 -- 172.21.15.88:0/298144848 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5abc0035b0 con 0x7f5ad406d680 2023-08-10T10:30:59.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f5ad27fc700 1 -- 172.21.15.88:0/298144848 >> v1:172.21.15.187:6789/0 conn(0x7f5ad40cd150 legacy=0x7f5ad416d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f5ad27fc700 1 -- 172.21.15.88:0/298144848 >> v1:172.21.15.88:6789/0 conn(0x7f5ad406d680 legacy=0x7f5ad40c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f5ad27fc700 1 -- 172.21.15.88:0/298144848 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4170c70 con 0x7f5ad4089170 2023-08-10T10:30:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f67f79ff700 1 -- 172.21.15.88:0/3103677589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f0158d10 msgr2=0x7f67f0159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f67f79ff700 1 --2- 172.21.15.88:0/3103677589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f0158d10 0x7f67f0159190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f67ec009840 tx=0x7f67ec009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480052e0 con 0x7f9b500b3cf0 2023-08-10T10:30:59.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b48005440 con 0x7f9b500b3cf0 2023-08-10T10:30:59.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b480057f0 con 0x7f9b500b3cf0 2023-08-10T10:30:59.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.062+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f17a4013b40 con 0x7f17a816b1c0 2023-08-10T10:30:59.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f179dffb700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f178c06adb0 0x7f178c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f17a4089570 con 0x7f17a816b1c0 2023-08-10T10:30:59.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b501e96e0 con 0x7f9b500b3cf0 2023-08-10T10:30:59.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7fb1309ff700 1 -- 172.21.15.88:0/1717150619 shutdown_connections 2023-08-10T10:30:59.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7fb1309ff700 1 --2- 172.21.15.88:0/1717150619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0cae20 0x7fb12c0c9710 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7fb1309ff700 1 -- 172.21.15.88:0/1717150619 >> 172.21.15.88:0/1717150619 conn(0x7fb12c0ced50 msgr2=0x7fb12c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6800ccd00 con 0x7fd680158fd0 2023-08-10T10:30:59.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f5ad27fc700 1 --2- 172.21.15.88:0/298144848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 0x7f5ad406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009840 tx=0x7f5ac8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12f0d912b8ed808 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b501eaa50 con 0x7f9b500b3cf0 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88015e30 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88004870 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88004c20 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f67f79ff700 1 -- 172.21.15.88:0/3103677589 shutdown_connections 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f67f79ff700 1 --2- 172.21.15.88:0/3103677589 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f0158d10 0x7f67f0159190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f67f79ff700 1 -- 172.21.15.88:0/3103677589 >> 172.21.15.88:0/3103677589 conn(0x7f67f00ced50 msgr2=0x7f67f00cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a8c1673b0 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f179dffb700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f178c074a10 0x7f178c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f178c077520 con 0x7f178c074a10 2023-08-10T10:30:59.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.064+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17a40543a0 con 0x7f17a816b1c0 2023-08-10T10:30:59.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f17acd9a700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f178c06adb0 0x7f178c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f17add9c700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f178c074a10 0x7f178c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b5006dee0 con 0x7f9b500b3cf0 2023-08-10T10:30:59.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.065+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a8c16b490 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7fb1309ff700 1 -- 172.21.15.88:0/1717150619 shutdown_connections 2023-08-10T10:30:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f5ad1ffb700 1 -- 172.21.15.88:0/298144848 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8004290 con 0x7f5ad4089170 2023-08-10T10:30:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f5ad1ffb700 1 -- 172.21.15.88:0/298144848 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac80043f0 con 0x7f5ad4089170 2023-08-10T10:30:59.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f5ad1ffb700 1 -- 172.21.15.88:0/298144848 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac80038a0 con 0x7f5ad4089170 2023-08-10T10:30:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f67f79ff700 1 -- 172.21.15.88:0/3103677589 shutdown_connections 2023-08-10T10:30:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f17acd9a700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f178c06adb0 0x7f178c06d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17a80a7f80 tx=0x7f1798008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a8c0ccdd0 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7f5ad93ff700 1 -- 172.21.15.88:0/298144848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 msgr2=0x7f5ad406b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7f5ad93ff700 1 --2- 172.21.15.88:0/298144848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 0x7f5ad406b420 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009840 tx=0x7f5ac8009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7f5ad93ff700 1 -- 172.21.15.88:0/298144848 shutdown_connections 2023-08-10T10:30:59.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7f5ad93ff700 1 --2- 172.21.15.88:0/298144848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 0x7f5ad406b420 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7f5ad93ff700 1 -- 172.21.15.88:0/298144848 >> 172.21.15.88:0/298144848 conn(0x7f5ad40cb5f0 msgr2=0x7f5ad40cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.067+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd678014a80 con 0x7fd680158fd0 2023-08-10T10:30:59.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.068+0000 7f17add9c700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f178c074a10 0x7f178c076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fd67cff9700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd66006adb0 0x7fd66006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fd678089620 con 0x7fd680158fd0 2023-08-10T10:30:59.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.066+0000 7fb1309ff700 1 -- 172.21.15.88:0/1717150619 wait complete. 2023-08-10T10:30:59.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fb1309ff700 1 Processor -- start 2023-08-10T10:30:59.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== osd.0 v2:172.21.15.88:6800/707783139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f178c077520 con 0x7f178c074a10 2023-08-10T10:30:59.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fd67cff9700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fd660074a10 0x7fd660076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd660077520 con 0x7fd660074a10 2023-08-10T10:30:59.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd678054450 con 0x7fd680158fd0 2023-08-10T10:30:59.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f5ad93ff700 1 -- 172.21.15.88:0/298144848 shutdown_connections 2023-08-10T10:30:59.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7fd67f7fe700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd66006adb0 0x7fd66006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.069+0000 7fb1309ff700 1 -- start start 2023-08-10T10:30:59.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f5ad93ff700 1 -- 172.21.15.88:0/298144848 wait complete. 2023-08-10T10:30:59.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7fd676ffd700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fd660074a10 0x7fd660076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.068+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9b4800c650 con 0x7f9b500b3cf0 2023-08-10T10:30:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f9b37fff700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9b3c06adb0 0x7f9b3c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9b48089810 con 0x7f9b500b3cf0 2023-08-10T10:30:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f9b37fff700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7f9b3c074a10 0x7f9b3c076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b3c077520 con 0x7f9b3c074a10 2023-08-10T10:30:59.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.070+0000 7f67f79ff700 1 -- 172.21.15.88:0/3103677589 wait complete. 2023-08-10T10:30:59.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.071+0000 7fd676ffd700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fd660074a10 0x7fd660076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.071+0000 7fd67f7fe700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd66006adb0 0x7fd66006d270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c2d0 tx=0x7fd6700018a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.072+0000 7f0c7cdff700 1 Processor -- start 2023-08-10T10:30:59.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.072+0000 7f0c7cdff700 1 -- start start 2023-08-10T10:30:59.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.072+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b48054640 con 0x7f9b500b3cf0 2023-08-10T10:30:59.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.072+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== osd.2 v2:172.21.15.88:6816/2073214128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd660077520 con 0x7fd660074a10 2023-08-10T10:30:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.072+0000 7f9b4e7fc700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7f9b3c074a10 0x7f9b3c076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f9b4effd700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9b3c06adb0 0x7f9b3c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f5ad93ff700 1 Processor -- start 2023-08-10T10:30:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f5ad93ff700 1 -- start start 2023-08-10T10:30:59.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f67f79ff700 1 Processor -- start 2023-08-10T10:30:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f67f79ff700 1 -- start start 2023-08-10T10:30:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f9b4effd700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9b3c06adb0 0x7f9b3c06d270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b40004790 tx=0x7f9b40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.073+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0a8801b020 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c7cdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c780d1c70 0x7f0c7806bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c7cdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0c7806c4d0 0x7f0c780b60a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ad406d680 0x7f5ad416ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 0x7f5ad40b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 0x7f5ad40b1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad416dca0 con 0x7f5ad406d680 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad416def0 con 0x7f5ad4089170 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f5ad93ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad416e1d0 con 0x7f5ad40cd150 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c7cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780ce610 con 0x7f0c7815ced0 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c7cdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7806c940 con 0x7f0c780d1c70 2023-08-10T10:30:59.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c7cdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c780d2120 con 0x7f0c7806c4d0 2023-08-10T10:30:59.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 0x7f5ad40b1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 0x7f5ad40b1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50084/0 (socket says 172.21.15.88:50084) 2023-08-10T10:30:59.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 -- 172.21.15.88:0/2433917828 learned_addr learned my addr 172.21.15.88:0/2433917828 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0c75d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c780d1c70 0x7f0c7806bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0c780d1c70 0x7f0c7806bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41426/0 (socket says 172.21.15.88:41426) 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 -- 172.21.15.88:0/3122473912 learned_addr learned my addr 172.21.15.88:0/3122473912 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 -- 172.21.15.88:0/3122473912 >> v2:172.21.15.187:3300/0 conn(0x7f0c7806c4d0 msgr2=0x7f0c780b60a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/3122473912 >> v2:172.21.15.187:3300/0 conn(0x7f0c7806c4d0 0x7f0c780b60a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 -- 172.21.15.88:0/3122473912 >> v1:172.21.15.88:6789/0 conn(0x7f0c7815ced0 legacy=0x7f0c780cd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0c75d9b700 1 -- 172.21.15.88:0/3122473912 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780ce330 con 0x7f0c780d1c70 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 -- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 msgr2=0x7f5ad40b17f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad4089170 0x7f5ad40b17f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 -- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ad406d680 msgr2=0x7f5ad416ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5ad406d680 0x7f5ad416ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f5ad37fe700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80094a0 con 0x7f5ad40cd150 2023-08-10T10:30:59.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f5ad37fe700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 0x7f5ad40b1d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7a0 tx=0x7f5acc00cb60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/3122473912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c7806bf90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c7806cd00 tx=0x7f0c6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2991ccc7a06de0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f9b4e7fc700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7f9b3c074a10 0x7f9b3c076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc003e30 con 0x7f5ad40cd150 2023-08-10T10:30:59.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5acc005070 con 0x7f5ad40cd150 2023-08-10T10:30:59.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc005420 con 0x7f5ad40cd150 2023-08-10T10:30:59.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f0c7559a700 1 -- 172.21.15.88:0/3122473912 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00b870 con 0x7f0c780d1c70 2023-08-10T10:30:59.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f0c7559a700 1 -- 172.21.15.88:0/3122473912 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c00b9d0 con 0x7f0c780d1c70 2023-08-10T10:30:59.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f0c7559a700 1 -- 172.21.15.88:0/3122473912 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c00bd60 con 0x7f0c780d1c70 2023-08-10T10:30:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.074+0000 7f0a81ffb700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a7006adb0 0x7f0a7006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0a88091b90 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0a81ffb700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7f0a70074a90 0x7f0a70076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a700775a0 con 0x7f0a70074a90 2023-08-10T10:30:59.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a88091f40 con 0x7f0a8c06dbc0 2023-08-10T10:30:59.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7f0a9099a700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a7006adb0 0x7f0a7006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== osd.1 v2:172.21.15.88:6808/4133826760 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9b3c077520 con 0x7f9b3c074a10 2023-08-10T10:30:59.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f0a9199c700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7f0a70074a90 0x7f0a70076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad416e4b0 con 0x7f5ad40cd150 2023-08-10T10:30:59.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad416ea70 con 0x7f5ad40cd150 2023-08-10T10:30:59.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f0c7cdff700 1 -- 172.21.15.88:0/3122473912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 msgr2=0x7f0c7806bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/3122473912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c7806bf90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0c7806cd00 tx=0x7f0c6c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.078+0000 7f0a9199c700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7f0a70074a90 0x7f0a70076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.078+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ad40cdaa0 con 0x7f5ad40cd150 2023-08-10T10:30:59.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.078+0000 7f0a9099a700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a7006adb0 0x7f0a7006d270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009840 tx=0x7f0a7c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 0x7fb12c0ce040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0c2060 0x7fb12c0c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb12c0cae20 0x7fb12c1ff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c8aa0 con 0x7fb12c0cae20 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c54c0 con 0x7fb12c0c2060 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb1309ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0c8240 con 0x7fb12c0710a0 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 0x7fb12c0ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb12a59c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 0x7fb12c0ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50086/0 (socket says 172.21.15.88:50086) 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.075+0000 7fb12a59c700 1 -- 172.21.15.88:0/366881530 learned_addr learned my addr 172.21.15.88:0/366881530 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7fb12a59c700 1 -- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0c2060 msgr2=0x7fb12c0c4f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7fb12a59c700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb12c0c2060 0x7fb12c0c4f80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7fb12a59c700 1 -- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb12c0cae20 msgr2=0x7fb12c1ff1f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7fb12a59c700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb12c0cae20 0x7fb12c1ff1f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.076+0000 7fb12a59c700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1200094a0 con 0x7fb12c0710a0 2023-08-10T10:30:59.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.077+0000 7fb12a59c700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 0x7fb12c0ce040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb12400cbf0 tx=0x7fb12400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006ea80 0x7f67f00c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 0x7f67f01e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67f0158d10 0x7f67f01e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0147840 con 0x7f67f006ea80 2023-08-10T10:30:59.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f014ac30 con 0x7f67f00ccea0 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f67f79ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00c4ec0 con 0x7f67f0158d10 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 0x7f67f01e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 0x7f67f01e30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39252/0 (socket says 172.21.15.88:39252) 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 -- 172.21.15.88:0/246183816 learned_addr learned my addr 172.21.15.88:0/246183816 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f579b700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006ea80 0x7f67f00c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 -- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67f0158d10 msgr2=0x7f67f01e20b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67f0158d10 0x7f67f01e20b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 -- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006ea80 msgr2=0x7f67f00c4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f67f006ea80 0x7f67f00c4820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7f67f4f9a700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67ec0094a0 con 0x7f67f00ccea0 2023-08-10T10:30:59.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400abe0 con 0x7fb12c0710a0 2023-08-10T10:30:59.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400ad40 con 0x7fb12c0710a0 2023-08-10T10:30:59.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb124012600 con 0x7fb12c0710a0 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12c0c84e0 con 0x7fb12c0710a0 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.080+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c163ff0 con 0x7fb12c0710a0 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.081+0000 7f0c7cdff700 1 -- 172.21.15.88:0/3122473912 shutdown_connections 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.081+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/3122473912 >> v2:172.21.15.187:3300/0 conn(0x7f0c7806c4d0 0x7f0c780b60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.081+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/3122473912 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c7806bf90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.081+0000 7f0c7cdff700 1 -- 172.21.15.88:0/3122473912 >> 172.21.15.88:0/3122473912 conn(0x7f0c780d31f0 msgr2=0x7f0c780d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.081+0000 7f67f4f9a700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 0x7f67f01e30b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67f006e0e0 tx=0x7f67ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.079+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== osd.3 v2:172.21.15.88:6824/551215602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0a700775a0 con 0x7f0a70074a90 2023-08-10T10:30:59.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.082+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5acc005580 con 0x7f5ad40cd150 2023-08-10T10:30:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.082+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb12c0ca340 con 0x7fb12c0710a0 2023-08-10T10:30:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.083+0000 7f0c7cdff700 1 -- 172.21.15.88:0/3122473912 shutdown_connections 2023-08-10T10:30:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.083+0000 7f5abb7fe700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5ac006ad30 0x7f5ac006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.084+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5acc0895c0 con 0x7f5ad40cd150 2023-08-10T10:30:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.084+0000 7f5abb7fe700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7f5ac0074a10 0x7f5ac0076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.084+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ac0077520 con 0x7f5ac0074a10 2023-08-10T10:30:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.084+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5acc089930 con 0x7f5ad40cd150 2023-08-10T10:30:59.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.085+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb124012760 con 0x7fb12c0710a0 2023-08-10T10:30:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.083+0000 7f0c7cdff700 1 -- 172.21.15.88:0/3122473912 wait complete. 2023-08-10T10:30:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.086+0000 7f0c7cdff700 1 Processor -- start 2023-08-10T10:30:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.086+0000 7f0c7cdff700 1 -- start start 2023-08-10T10:30:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f5ad27fc700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7f5ac0074a10 0x7f5ac0076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f5ad2ffd700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5ac006ad30 0x7f5ac006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c7806c4d0 0x7f0c780c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c780c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c7815ced0 0x7f0c780cba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c7800 con 0x7f0c780d1c70 2023-08-10T10:30:59.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c6bc0 con 0x7f0c7815ced0 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c780c6e60 con 0x7f0c7806c4d0 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7659c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c7806c4d0 0x7f0c780c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7659c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c7806c4d0 0x7f0c780c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50096/0 (socket says 172.21.15.88:50096) 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c7659c700 1 -- 172.21.15.88:0/1645600851 learned_addr learned my addr 172.21.15.88:0/1645600851 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c780c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.086+0000 7fb11affd700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb10c06adb0 0x7fb10c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.086+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb124089470 con 0x7fb12c0710a0 2023-08-10T10:30:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.087+0000 7fb11affd700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fb10c074a90 0x7fb10c076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.087+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb10c0775a0 con 0x7fb10c074a90 2023-08-10T10:30:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.087+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb12408ba90 con 0x7fb12c0710a0 2023-08-10T10:30:59.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.088+0000 7fb129d9b700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb10c06adb0 0x7fb10c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c76d9d700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c7815ced0 0x7f0c780cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 -- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c7806c4d0 msgr2=0x7f0c780c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c7806c4d0 0x7f0c780c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 -- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c7815ced0 msgr2=0x7f0c780cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c7815ced0 0x7f0c780cba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c009550 con 0x7f0c780d1c70 2023-08-10T10:30:59.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.089+0000 7f0c75d9b700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c780c9140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c016000 tx=0x7f0c6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f5ad2ffd700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5ac006ad30 0x7f5ac006d1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4001670 tx=0x7f5ac4007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011830 con 0x7f0c780d1c70 2023-08-10T10:30:59.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c6c011990 con 0x7f0c780d1c70 2023-08-10T10:30:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c780c7140 con 0x7f0c780d1c70 2023-08-10T10:30:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c6c011d00 con 0x7f0c780d1c70 2023-08-10T10:30:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c781f9a00 con 0x7f0c780d1c70 2023-08-10T10:30:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.091+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0c780d1470 con 0x7f0c780d1c70 2023-08-10T10:30:59.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.093+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0c6c01a420 con 0x7f0c780d1c70 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec022a50 con 0x7f67f00ccea0 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67ec02f070 con 0x7f67f00ccea0 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67ec022df0 con 0x7f67f00ccea0 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f00c51a0 con 0x7f67f00ccea0 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f00c5760 con 0x7f67f00ccea0 2023-08-10T10:30:59.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.093+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f67f00c9d40 con 0x7f67f00ccea0 2023-08-10T10:30:59.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.094+0000 7f5ad27fc700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7f5ac0074a10 0x7f5ac0076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.094+0000 7f0c66ffd700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0c5806ad30 0x7f0c5806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.094+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0c6c08a850 con 0x7f0c780d1c70 2023-08-10T10:30:59.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.090+0000 7fb129d9b700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb10c06adb0 0x7fb10c06d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb11c000f60 tx=0x7fb11c007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.092+0000 7fb12ad9d700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fb10c074a90 0x7fb10c076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.093+0000 7fb12ad9d700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fb10c074a90 0x7fb10c076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.095+0000 7f0c66ffd700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7f0c58074a10 0x7f0c58076e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.095+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0c58077520 con 0x7f0c58074a10 2023-08-10T10:30:59.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.095+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c6c08ce30 con 0x7f0c780d1c70 2023-08-10T10:30:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.095+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f67ec02b430 con 0x7f67f00ccea0 2023-08-10T10:30:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.096+0000 7f0c76d9d700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7f0c58074a10 0x7f0c58076e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.096+0000 7f0c7659c700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0c5806ad30 0x7f0c5806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.096+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== osd.4 v2:172.21.15.187:6800/2556306423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f5ac0077520 con 0x7f5ac0074a10 2023-08-10T10:30:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.095+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== osd.6 v2:172.21.15.187:6816/2271687941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb10c0775a0 con 0x7fb10c074a90 2023-08-10T10:30:59.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f67e5ffb700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f67d406adb0 0x7f67d406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f0c7659c700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0c5806ad30 0x7f0c5806d1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c780c89e0 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f67ec09c190 con 0x7f67f00ccea0 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f67e5ffb700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f67d4074a90 0x7f67d4076ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f67d40775a0 con 0x7f67d4074a90 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.097+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67ec09c540 con 0x7f67f00ccea0 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.098+0000 7f67f5f9c700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f67d4074a90 0x7f67d4076ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.098+0000 7f67f579b700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f67d406adb0 0x7f67d406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.098+0000 7f67f5f9c700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f67d4074a90 0x7f67d4076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.099+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 --> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6800cca20 con 0x7fd660074a10 2023-08-10T10:30:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.100+0000 7fd67cff9700 1 -- 172.21.15.88:0/4192352591 <== osd.2 v2:172.21.15.88:6816/2073214128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd668006860 con 0x7fd660074a10 2023-08-10T10:30:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.099+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== osd.5 v2:172.21.15.187:6824/70482310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f67d40775a0 con 0x7f67d4074a90 2023-08-10T10:30:59.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.100+0000 7f67f579b700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f67d406adb0 0x7f67d406d270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009f60 tx=0x7f67e80094f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fd660074a10 msgr2=0x7fd660076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fd660074a10 0x7fd660076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd66006adb0 msgr2=0x7fd66006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd66006adb0 0x7fd66006d270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd67000c2d0 tx=0x7fd6700018a0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 msgr2=0x7fd680159480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.101+0000 7fd685fff700 1 --2- 172.21.15.88:0/4192352591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd680158fd0 0x7fd680159480 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd6800cab80 tx=0x7fd67800d720 comp rx=0 tx=0).stop 2023-08-10T10:30:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.102+0000 7f0c76d9d700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7f0c58074a10 0x7f0c58076e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.103+0000 7fd67ffff700 1 -- 172.21.15.88:0/4192352591 reap_dead start 2023-08-10T10:30:59.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.103+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 shutdown_connections 2023-08-10T10:30:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.103+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 >> 172.21.15.88:0/4192352591 conn(0x7fd6800cb5f0 msgr2=0x7fd6800cb9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.103+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 shutdown_connections 2023-08-10T10:30:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.103+0000 7fd685fff700 1 -- 172.21.15.88:0/4192352591 wait complete. 2023-08-10T10:30:59.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.105+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== osd.7 v2:172.21.15.187:6808/4116934694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0c58077520 con 0x7f0c58074a10 2023-08-10T10:30:59.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.108+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 --> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1788002d40 con 0x7f178c074a10 2023-08-10T10:30:59.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.111+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 --> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b5006dc00 con 0x7f9b3c074a10 2023-08-10T10:30:59.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.112+0000 7f9b37fff700 1 -- 172.21.15.88:0/3571160174 <== osd.1 v2:172.21.15.88:6808/4133826760 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b4400d040 con 0x7f9b3c074a10 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.112+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7f9b3c074a10 msgr2=0x7f9b3c076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.112+0000 7f9b559ff700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7f9b3c074a10 0x7f9b3c076e50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9b3c06adb0 msgr2=0x7f9b3c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9b3c06adb0 0x7f9b3c06d270 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9b40004790 tx=0x7f9b40008040 comp rx=0 tx=0).stop 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 msgr2=0x7f9b501ea510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 --2- 172.21.15.88:0/3571160174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b500b3cf0 0x7f9b501ea510 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9b48001db0 tx=0x7f9b48001330 comp rx=0 tx=0).stop 2023-08-10T10:30:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b4f7fe700 1 -- 172.21.15.88:0/3571160174 reap_dead start 2023-08-10T10:30:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 shutdown_connections 2023-08-10T10:30:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.113+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 >> 172.21.15.88:0/3571160174 conn(0x7f9b500cb5f0 msgr2=0x7f9b500c9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.114+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 shutdown_connections 2023-08-10T10:30:59.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.114+0000 7f9b559ff700 1 -- 172.21.15.88:0/3571160174 wait complete. 2023-08-10T10:30:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.117+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 --> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a8c0cdaa0 con 0x7f0a70074a90 2023-08-10T10:30:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.114+0000 7f179dffb700 1 -- 172.21.15.88:0/1622771957 <== osd.0 v2:172.21.15.88:6800/707783139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1788002d40 con 0x7f178c074a10 2023-08-10T10:30:59.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.114+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f178c074a10 msgr2=0x7f178c076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.114+0000 7f17af7ff700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f178c074a10 0x7f178c076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.116+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f178c06adb0 msgr2=0x7f178c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.116+0000 7f17af7ff700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f178c06adb0 0x7f178c06d270 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f17a80a7f80 tx=0x7f1798008040 comp rx=0 tx=0).stop 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.116+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 msgr2=0x7f17a80aadd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.116+0000 7f17af7ff700 1 --2- 172.21.15.88:0/1622771957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a816b1c0 0x7f17a80aadd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f17a4007810 tx=0x7f17a4007b20 comp rx=0 tx=0).stop 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.116+0000 7f17add9c700 1 -- 172.21.15.88:0/1622771957 reap_dead start 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.117+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 shutdown_connections 2023-08-10T10:30:59.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.117+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 >> 172.21.15.88:0/1622771957 conn(0x7f17a80cb5f0 msgr2=0x7f17a816d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.118+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 shutdown_connections 2023-08-10T10:30:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.118+0000 7f17af7ff700 1 -- 172.21.15.88:0/1622771957 wait complete. 2023-08-10T10:30:59.188 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.118+0000 7f0a81ffb700 1 -- 172.21.15.88:0/726039944 <== osd.3 v2:172.21.15.88:6824/551215602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a840019a0 con 0x7f0a70074a90 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.119+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7f0a70074a90 msgr2=0x7f0a70076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.119+0000 7f0a933ff700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7f0a70074a90 0x7f0a70076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a7006adb0 msgr2=0x7f0a7006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a7006adb0 0x7f0a7006d270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c009840 tx=0x7f0a7c010000 comp rx=0 tx=0).stop 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 msgr2=0x7f0a8c16af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 --2- 172.21.15.88:0/726039944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a8c06dbc0 0x7f0a8c16af50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0a88001e70 tx=0x7f0a8800ca60 comp rx=0 tx=0).stop 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a9199c700 1 -- 172.21.15.88:0/726039944 reap_dead start 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 shutdown_connections 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.120+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 >> 172.21.15.88:0/726039944 conn(0x7f0a8c0cb5f0 msgr2=0x7f0a8c0c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.121+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 shutdown_connections 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.121+0000 7f0a933ff700 1 -- 172.21.15.88:0/726039944 wait complete. 2023-08-10T10:30:59.190 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.124+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 --> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb12c0ca060 con 0x7fb10c074a90 2023-08-10T10:30:59.191 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:30:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.127+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 --> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ad40ccdd0 con 0x7f5ac0074a10 2023-08-10T10:30:59.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.131+0000 7f5abb7fe700 1 -- 172.21.15.88:0/2433917828 <== osd.4 v2:172.21.15.187:6800/2556306423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5ac8006c60 con 0x7f5ac0074a10 2023-08-10T10:30:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.128+0000 7fb11affd700 1 -- 172.21.15.88:0/366881530 <== osd.6 v2:172.21.15.187:6816/2271687941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb120011b00 con 0x7fb10c074a90 2023-08-10T10:30:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.129+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fb10c074a90 msgr2=0x7fb10c076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.129+0000 7fb1309ff700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fb10c074a90 0x7fb10c076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-10T10:30:59.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 --> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f67f00cdc40 con 0x7f67d4074a90 2023-08-10T10:30:59.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb10c06adb0 msgr2=0x7fb10c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7fb1309ff700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fb10c06adb0 0x7fb10c06d270 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb11c000f60 tx=0x7fb11c007a40 comp rx=0 tx=0).stop 2023-08-10T10:30:59.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 msgr2=0x7fb12c0ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7fb1309ff700 1 --2- 172.21.15.88:0/366881530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb12c0710a0 0x7fb12c0ce040 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb12400cbf0 tx=0x7fb12400a060 comp rx=0 tx=0).stop 2023-08-10T10:30:59.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7f5ac0074a10 msgr2=0x7f5ac0076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7f5ad93ff700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7f5ac0074a10 0x7f5ac0076e50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7f67e5ffb700 1 -- 172.21.15.88:0/246183816 <== osd.5 v2:172.21.15.187:6824/70482310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f67e0001060 con 0x7f67d4074a90 2023-08-10T10:30:59.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.132+0000 7fb12ad9d700 1 -- 172.21.15.88:0/366881530 reap_dead start 2023-08-10T10:30:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 shutdown_connections 2023-08-10T10:30:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 >> 172.21.15.88:0/366881530 conn(0x7fb12c0ced50 msgr2=0x7fb12c0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5ac006ad30 msgr2=0x7f5ac006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5ac006ad30 0x7f5ac006d1f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4001670 tx=0x7f5ac4007ad0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 msgr2=0x7f5ad40b1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 --2- 172.21.15.88:0/2433917828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad40cd150 0x7f5ad40b1d30 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5acc00c7a0 tx=0x7f5acc00cb60 comp rx=0 tx=0).stop 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad37fe700 1 -- 172.21.15.88:0/2433917828 reap_dead start 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 shutdown_connections 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 >> 172.21.15.88:0/2433917828 conn(0x7f5ad40cb5f0 msgr2=0x7f5ad40cde70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 shutdown_connections 2023-08-10T10:30:59.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.133+0000 7fb1309ff700 1 -- 172.21.15.88:0/366881530 wait complete. 2023-08-10T10:30:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f67d4074a90 msgr2=0x7f67d4076ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f67d4074a90 0x7f67d4076ed0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f67d406adb0 msgr2=0x7f67d406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f67d406adb0 0x7f67d406d270 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009f60 tx=0x7f67e80094f0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 msgr2=0x7f67f01e30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 --2- 172.21.15.88:0/246183816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67f00ccea0 0x7f67f01e30b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f67f006e0e0 tx=0x7f67ec004750 comp rx=0 tx=0).stop 2023-08-10T10:30:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f5f9c700 1 -- 172.21.15.88:0/246183816 reap_dead start 2023-08-10T10:30:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 shutdown_connections 2023-08-10T10:30:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f5ad93ff700 1 -- 172.21.15.88:0/2433917828 wait complete. 2023-08-10T10:30:59.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 shutdown_connections 2023-08-10T10:30:59.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.134+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 >> 172.21.15.88:0/246183816 conn(0x7f67f00ced50 msgr2=0x7f67f00cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.135+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 shutdown_connections 2023-08-10T10:30:59.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.135+0000 7f67f79ff700 1 -- 172.21.15.88:0/246183816 wait complete. 2023-08-10T10:30:59.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.138+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 --> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0c780d1190 con 0x7f0c58074a10 2023-08-10T10:30:59.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.140+0000 7f0c66ffd700 1 -- 172.21.15.88:0/1645600851 <== osd.7 v2:172.21.15.187:6808/4116934694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0c70009bf0 con 0x7f0c58074a10 2023-08-10T10:30:59.201 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:30:59.202 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-10T10:30:59.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7f0c58074a10 msgr2=0x7f0c58076e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7f0c58074a10 0x7f0c58076e50 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0c5806ad30 msgr2=0x7f0c5806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0c5806ad30 0x7f0c5806d1f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0c780c89e0 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 msgr2=0x7f0c780c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c7cdff700 1 --2- 172.21.15.88:0/1645600851 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0c780d1c70 0x7f0c780c9140 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0c6c016000 tx=0x7f0c6c004750 comp rx=0 tx=0).stop 2023-08-10T10:30:59.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.145+0000 7f0c76d9d700 1 -- 172.21.15.88:0/1645600851 reap_dead start 2023-08-10T10:30:59.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.146+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 shutdown_connections 2023-08-10T10:30:59.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.146+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 >> 172.21.15.88:0/1645600851 conn(0x7f0c780d31f0 msgr2=0x7f0c780b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.146+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 shutdown_connections 2023-08-10T10:30:59.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.146+0000 7f0c7cdff700 1 -- 172.21.15.88:0/1645600851 wait complete. 2023-08-10T10:30:59.205 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:30:59.205 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-10T10:30:59.206 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:30:59.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-10T10:30:59.207 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:30:59.207 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-10T10:30:59.208 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:30:59.208 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-10T10:30:59.209 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:30:59.209 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-10T10:30:59.210 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:30:59.210 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-10T10:30:59.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.596+0000 7f4ff15ff700 1 Processor -- start 2023-08-10T10:30:59.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.596+0000 7f4ff15ff700 1 -- start start 2023-08-10T10:30:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.598+0000 7f4ff15ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4fec0cd150 0x7f4fec16d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4ff15ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fec06d680 0x7f4fec06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4ff15ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fec16da00 con 0x7f4fec089170 2023-08-10T10:30:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4ff15ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec0cd680 con 0x7f4fec06d680 2023-08-10T10:30:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4ff15ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fec0cad10 con 0x7f4fec0cd150 2023-08-10T10:30:59.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4feaffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4fec0cd150 0x7f4fec16d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4feaffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4fec0cd150 0x7f4fec16d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39274/0 (socket says 172.21.15.88:39274) 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.599+0000 7f4feaffd700 1 -- 172.21.15.88:0/29880124 learned_addr learned my addr 172.21.15.88:0/29880124 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.600+0000 7f4feb7fe700 1 --2- 172.21.15.88:0/29880124 >> v2:172.21.15.88:3300/0 conn(0x7f4fec06d680 0x7f4fec06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.600+0000 7f4feaffd700 1 -- 172.21.15.88:0/29880124 >> v2:172.21.15.88:3300/0 conn(0x7f4fec06d680 msgr2=0x7f4fec06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.600+0000 7f4feaffd700 1 --2- 172.21.15.88:0/29880124 >> v2:172.21.15.88:3300/0 conn(0x7f4fec06d680 0x7f4fec06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.600+0000 7f4feaffd700 1 -- 172.21.15.88:0/29880124 >> v1:172.21.15.187:6789/0 conn(0x7f4fec089170 legacy=0x7f4fec06b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.600+0000 7f4feaffd700 1 -- 172.21.15.88:0/29880124 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fec0ca790 con 0x7f4fec0cd150 2023-08-10T10:30:59.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.601+0000 7f4feaffd700 1 --2- 172.21.15.88:0/29880124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec0cd150 0x7f4fec16d4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0cc310 tx=0x7f4fdc009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91d06172481c23b6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.601+0000 7f5f42dff700 1 Processor -- start 2023-08-10T10:30:59.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.602+0000 7f5f42dff700 1 -- start start 2023-08-10T10:30:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.602+0000 7f4fe9ffb700 1 -- 172.21.15.88:0/29880124 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00b870 con 0x7f4fec0cd150 2023-08-10T10:30:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.602+0000 7f4fe9ffb700 1 -- 172.21.15.88:0/29880124 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fdc00b9d0 con 0x7f4fec0cd150 2023-08-10T10:30:59.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.602+0000 7f4fe9ffb700 1 -- 172.21.15.88:0/29880124 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc00bd60 con 0x7f4fec0cd150 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 -- 172.21.15.88:0/29880124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec0cd150 msgr2=0x7f4fec16d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/29880124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec0cd150 0x7f4fec16d4c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4fec0cc310 tx=0x7f4fdc009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 -- 172.21.15.88:0/29880124 shutdown_connections 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/29880124 >> v2:172.21.15.88:3300/0 conn(0x7f4fec06d680 0x7f4fec06da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/29880124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec0cd150 0x7f4fec16d4c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f4ff15ff700 1 -- 172.21.15.88:0/29880124 >> 172.21.15.88:0/29880124 conn(0x7f4fec0cb5f0 msgr2=0x7f4fec0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.604+0000 7f4ff15ff700 1 -- 172.21.15.88:0/29880124 shutdown_connections 2023-08-10T10:30:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.604+0000 7f4ff15ff700 1 -- 172.21.15.88:0/29880124 wait complete. 2023-08-10T10:30:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f5f42dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5f3c0cc110 0x7f5f3c15c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.603+0000 7f5f42dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5f3c0ca750 0x7f5f3c06cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.604+0000 7f5f42dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c0caf30 con 0x7f5f3c06b650 2023-08-10T10:30:59.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.604+0000 7f5f42dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cc740 con 0x7f5f3c0cc110 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.604+0000 7f5f42dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cca20 con 0x7f5f3c0ca750 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.605+0000 7f5f33fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5f3c0ca750 0x7f5f3c06cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.605+0000 7f5f33fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5f3c0ca750 0x7f5f3c06cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39288/0 (socket says 172.21.15.88:39288) 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.605+0000 7f5f33fff700 1 -- 172.21.15.88:0/967134075 learned_addr learned my addr 172.21.15.88:0/967134075 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.605+0000 7f5f40b9b700 1 --2- 172.21.15.88:0/967134075 >> v2:172.21.15.88:3300/0 conn(0x7f5f3c0cc110 0x7f5f3c15c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.606+0000 7f5f33fff700 1 -- 172.21.15.88:0/967134075 >> v2:172.21.15.88:3300/0 conn(0x7f5f3c0cc110 msgr2=0x7f5f3c15c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.606+0000 7f5f33fff700 1 --2- 172.21.15.88:0/967134075 >> v2:172.21.15.88:3300/0 conn(0x7f5f3c0cc110 0x7f5f3c15c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.606+0000 7f5f33fff700 1 -- 172.21.15.88:0/967134075 >> v1:172.21.15.88:6789/0 conn(0x7f5f3c06b650 legacy=0x7f5f3c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.606+0000 7f5f33fff700 1 -- 172.21.15.88:0/967134075 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0ccd00 con 0x7f5f3c0ca750 2023-08-10T10:30:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f4ff15ff700 1 Processor -- start 2023-08-10T10:30:59.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f5f33fff700 1 --2- 172.21.15.88:0/967134075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c0ca750 0x7f5f3c06cc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c2280 tx=0x7f5f2c009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=140067527cfd6b84 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f4ff15ff700 1 -- start start 2023-08-10T10:30:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fec06d680 0x7f4fec0c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fec0cd150 0x7f4fec0ba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0b5fb0 con 0x7f4fec0cd150 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec088620 con 0x7f4fec089170 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f4ff15ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fec0c6180 con 0x7f4fec06d680 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f5f337fe700 1 -- 172.21.15.88:0/967134075 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c004230 con 0x7f5f3c0ca750 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f5f337fe700 1 -- 172.21.15.88:0/967134075 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c004390 con 0x7f5f3c0ca750 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.607+0000 7f5f337fe700 1 -- 172.21.15.88:0/967134075 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0036a0 con 0x7f5f3c0ca750 2023-08-10T10:30:59.611 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f5f42dff700 1 -- 172.21.15.88:0/967134075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c0ca750 msgr2=0x7f5f3c06cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f5f42dff700 1 --2- 172.21.15.88:0/967134075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c0ca750 0x7f5f3c06cc70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0c2280 tx=0x7f5f2c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f74371ff700 1 Processor -- start 2023-08-10T10:30:59.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.608+0000 7f74371ff700 1 -- start start 2023-08-10T10:30:59.612 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f4fea7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f4fea7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39294/0 (socket says 172.21.15.88:39294) 2023-08-10T10:30:59.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f4fea7fc700 1 -- 172.21.15.88:0/2075848368 learned_addr learned my addr 172.21.15.88:0/2075848368 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f4feaffd700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fec06d680 0x7f4fec0c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f5f42dff700 1 -- 172.21.15.88:0/967134075 shutdown_connections 2023-08-10T10:30:59.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f5f42dff700 1 --2- 172.21.15.88:0/967134075 >> v2:172.21.15.88:3300/0 conn(0x7f5f3c0cc110 0x7f5f3c15c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f5f42dff700 1 --2- 172.21.15.88:0/967134075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c0ca750 0x7f5f3c06cc70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.609+0000 7f5f42dff700 1 -- 172.21.15.88:0/967134075 >> 172.21.15.88:0/967134075 conn(0x7f5f3c0cb5f0 msgr2=0x7f5f3c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f74371ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74300ccea0 0x7f74300cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f74371ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300c9b10 con 0x7f743006ea80 2023-08-10T10:30:59.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 -- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fec06d680 msgr2=0x7f4fec0c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fec06d680 0x7f4fec0c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 -- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fec0cd150 msgr2=0x7f4fec0ba680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fec0cd150 0x7f4fec0ba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 -- 172.21.15.88:0/2075848368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fdc009550 con 0x7f4fec089170 2023-08-10T10:30:59.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f74371ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74300cdf20 con 0x7f7430158f80 2023-08-10T10:30:59.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f74371ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74300ca120 con 0x7f74300ccea0 2023-08-10T10:30:59.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f4fea7fc700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400cbd0 tx=0x7f4fe400cee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f7434f9b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7430158f80 0x7f74300b1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35982/0 (socket says 172.21.15.88:35982) 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f7434f9b700 1 -- 172.21.15.88:0/2636814596 learned_addr learned my addr 172.21.15.88:0/2636814596 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.610+0000 7f742ffff700 1 --2- 172.21.15.88:0/2636814596 >> v2:172.21.15.187:3300/0 conn(0x7f74300ccea0 0x7f74300cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f742f7fe700 1 -- 172.21.15.88:0/2636814596 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2265550316 0 0) 0x7f74300cdf20 con 0x7f7430158f80 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f742f7fe700 1 -- 172.21.15.88:0/2636814596 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f741c0035b0 con 0x7f7430158f80 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f742ffff700 1 -- 172.21.15.88:0/2636814596 >> v1:172.21.15.187:6789/0 conn(0x7f7430158f80 legacy=0x7f74300b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f742ffff700 1 -- 172.21.15.88:0/2636814596 >> v1:172.21.15.88:6789/0 conn(0x7f743006ea80 legacy=0x7f7430070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f742ffff700 1 -- 172.21.15.88:0/2636814596 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300b2130 con 0x7f74300ccea0 2023-08-10T10:30:59.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f9a331ff700 1 Processor -- start 2023-08-10T10:30:59.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4003c00 con 0x7f4fec089170 2023-08-10T10:30:59.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fe4003d60 con 0x7f4fec089170 2023-08-10T10:30:59.618 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fe400ab20 con 0x7f4fec089170 2023-08-10T10:30:59.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f742ffff700 1 --2- 172.21.15.88:0/2636814596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74300ccea0 0x7f74300cd320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7418009840 tx=0x7f7418009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7f348dcaaca890 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f742f7fe700 1 -- 172.21.15.88:0/2636814596 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418004230 con 0x7f74300ccea0 2023-08-10T10:30:59.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f742f7fe700 1 -- 172.21.15.88:0/2636814596 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7418004390 con 0x7f74300ccea0 2023-08-10T10:30:59.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f742f7fe700 1 -- 172.21.15.88:0/2636814596 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74180036c0 con 0x7f74300ccea0 2023-08-10T10:30:59.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.613+0000 7f74371ff700 1 -- 172.21.15.88:0/2636814596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74300ccea0 msgr2=0x7f74300cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.613+0000 7f74371ff700 1 --2- 172.21.15.88:0/2636814596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74300ccea0 0x7f74300cd320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7418009840 tx=0x7f7418009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f74371ff700 1 -- 172.21.15.88:0/2636814596 shutdown_connections 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f74371ff700 1 --2- 172.21.15.88:0/2636814596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74300ccea0 0x7f74300cd320 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7418009840 tx=0x7f7418009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f74371ff700 1 -- 172.21.15.88:0/2636814596 >> 172.21.15.88:0/2636814596 conn(0x7f74300ced50 msgr2=0x7f74300cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f74371ff700 1 -- 172.21.15.88:0/2636814596 shutdown_connections 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f74371ff700 1 -- 172.21.15.88:0/2636814596 wait complete. 2023-08-10T10:30:59.620 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.611+0000 7f5f42dff700 1 -- 172.21.15.88:0/967134075 shutdown_connections 2023-08-10T10:30:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f5f42dff700 1 -- 172.21.15.88:0/967134075 wait complete. 2023-08-10T10:30:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f5f42dff700 1 Processor -- start 2023-08-10T10:30:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.612+0000 7f9a331ff700 1 -- start start 2023-08-10T10:30:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f9a331ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a2c06b650 0x7f9a2c15c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f9a331ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c06af90 con 0x7f9a2c0cc110 2023-08-10T10:30:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f9a331ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a2c0cac50 con 0x7f9a2c0ca750 2023-08-10T10:30:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.614+0000 7f9a331ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2c0caf30 con 0x7f9a2c06b650 2023-08-10T10:30:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f9a2bfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9a2c0ca750 0x7f9a2c06a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35988/0 (socket says 172.21.15.88:35988) 2023-08-10T10:30:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f9a2bfff700 1 -- 172.21.15.88:0/4115360023 learned_addr learned my addr 172.21.15.88:0/4115360023 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fec0b95e0 con 0x7f4fec089170 2023-08-10T10:30:59.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fec0b9e80 con 0x7f4fec089170 2023-08-10T10:30:59.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.616+0000 7f9a2b7fe700 1 -- 172.21.15.88:0/4115360023 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379146070 0 0) 0x7f9a2c0cac50 con 0x7f9a2c0ca750 2023-08-10T10:30:59.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.616+0000 7f9a2b7fe700 1 -- 172.21.15.88:0/4115360023 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a140035b0 con 0x7f9a2c0ca750 2023-08-10T10:30:59.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.616+0000 7f74371ff700 1 Processor -- start 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f74371ff700 1 -- start start 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7430158f80 0x7f74300b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 0x7f74300c8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c5610 con 0x7f743006ea80 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c62a0 con 0x7f7430158f80 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f74371ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74300c91a0 con 0x7f74300c81d0 2023-08-10T10:30:59.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f743579c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 0x7f74300c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f7434f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f7434f9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41506/0 (socket says 172.21.15.88:41506) 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f743579c700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 0x7f74300c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50114/0 (socket says 172.21.15.88:50114) 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f7434f9b700 1 -- 172.21.15.88:0/96779658 learned_addr learned my addr 172.21.15.88:0/96779658 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fec0b99e0 con 0x7f4fec089170 2023-08-10T10:30:59.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4fe400ac80 con 0x7f4fec089170 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.615+0000 7f5f42dff700 1 -- start start 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c06b650 0x7f5f3c0c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0cc110 0x7f5f3c159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c1190 con 0x7f5f3c0cc110 2023-08-10T10:30:59.626 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c0eb0 con 0x7f5f3c06b650 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.617+0000 7f5f42dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0c6280 con 0x7f5f3c0ca750 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f5f33fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50106/0 (socket says 172.21.15.88:50106) 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f5f33fff700 1 -- 172.21.15.88:0/37046887 learned_addr learned my addr 172.21.15.88:0/37046887 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.618+0000 7f5f4139c700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0cc110 0x7f5f3c159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f5f33fff700 1 -- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c06b650 msgr2=0x7f5f3c0c8870 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f5f33fff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c06b650 0x7f5f3c0c8870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f5f33fff700 1 -- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0cc110 msgr2=0x7f5f3c159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f5f33fff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0cc110 0x7f5f3c159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f5f33fff700 1 -- 172.21.15.88:0/37046887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2c009550 con 0x7f5f3c0ca750 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f33fff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0ccb60 tx=0x7f5f2c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.619+0000 7f9a3179c700 1 --2- 172.21.15.88:0/4115360023 >> v2:172.21.15.88:3300/0 conn(0x7f9a2c06b650 0x7f9a2c15c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f9a3179c700 1 -- 172.21.15.88:0/4115360023 >> v1:172.21.15.187:6789/0 conn(0x7f9a2c0ca750 legacy=0x7f9a2c06a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f9a3179c700 1 -- 172.21.15.88:0/4115360023 >> v1:172.21.15.88:6789/0 conn(0x7f9a2c0cc110 legacy=0x7f9a2c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f9a3179c700 1 -- 172.21.15.88:0/4115360023 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2c0cc740 con 0x7f9a2c06b650 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f9a3179c700 1 --2- 172.21.15.88:0/4115360023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c06b650 0x7f9a2c15c630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009840 tx=0x7f9a20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae957decf6a96dc7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0045d0 con 0x7f5f3c0ca750 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f2c011630 con 0x7f5f3c0ca750 2023-08-10T10:30:59.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c0119e0 con 0x7f5f3c0ca750 2023-08-10T10:30:59.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c0c6560 con 0x7f5f3c0ca750 2023-08-10T10:30:59.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.620+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c0c72a0 con 0x7f5f3c0ca750 2023-08-10T10:30:59.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f4fd37fe700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 0x7f4fd806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f4fe4089730 con 0x7f4fec089170 2023-08-10T10:30:59.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f9a2b7fe700 1 -- 172.21.15.88:0/4115360023 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a20004290 con 0x7f9a2c06b650 2023-08-10T10:30:59.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f9a2b7fe700 1 -- 172.21.15.88:0/4115360023 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a200043f0 con 0x7f9a2c06b650 2023-08-10T10:30:59.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f9a2b7fe700 1 -- 172.21.15.88:0/4115360023 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a200038a0 con 0x7f9a2c06b650 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 -- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 msgr2=0x7f74300c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 0x7f74300c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 -- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7430158f80 msgr2=0x7f74300b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7430158f80 0x7f74300b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 -- 172.21.15.88:0/96779658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180094a0 con 0x7f743006ea80 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.621+0000 7f7434f9b700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f742800c4d0 tx=0x7f742800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428005d70 con 0x7f743006ea80 2023-08-10T10:30:59.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74280070d0 con 0x7f743006ea80 2023-08-10T10:30:59.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428007440 con 0x7f743006ea80 2023-08-10T10:30:59.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74300c5ce0 con 0x7f743006ea80 2023-08-10T10:30:59.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74300c1580 con 0x7f743006ea80 2023-08-10T10:30:59.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7f42507ff700 1 Processor -- start 2023-08-10T10:30:59.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7f9a331ff700 1 -- 172.21.15.88:0/4115360023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c06b650 msgr2=0x7f9a2c15c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7f9a331ff700 1 --2- 172.21.15.88:0/4115360023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c06b650 0x7f9a2c15c630 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009840 tx=0x7f9a20009b50 comp rx=0 tx=0).stop 2023-08-10T10:30:59.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.622+0000 7efd1adff700 1 Processor -- start 2023-08-10T10:30:59.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7efd1adff700 1 -- start start 2023-08-10T10:30:59.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c0052f0 con 0x7f5f3c0ca750 2023-08-10T10:30:59.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7f4feaffd700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 0x7f4fd806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.624+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743004ecc0 con 0x7f743006ea80 2023-08-10T10:30:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f4feaffd700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 0x7f4fd806d270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000c00 tx=0x7f4fdc01d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f9a331ff700 1 -- 172.21.15.88:0/4115360023 shutdown_connections 2023-08-10T10:30:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f9a331ff700 1 --2- 172.21.15.88:0/4115360023 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c06b650 0x7f9a2c15c630 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f9a331ff700 1 -- 172.21.15.88:0/4115360023 >> 172.21.15.88:0/4115360023 conn(0x7f9a2c0cb5f0 msgr2=0x7f9a2c0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.623+0000 7f37e29ff700 1 Processor -- start 2023-08-10T10:30:59.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.624+0000 7f37e29ff700 1 -- start start 2023-08-10T10:30:59.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f9a331ff700 1 -- 172.21.15.88:0/4115360023 shutdown_connections 2023-08-10T10:30:59.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f2c022070 con 0x7f5f3c0ca750 2023-08-10T10:30:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.624+0000 7f42507ff700 1 -- start start 2023-08-10T10:30:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f42507ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f424806cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f42507ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f42480ca750 0x7f424806d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f42507ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424815ca10 con 0x7f42480cc110 2023-08-10T10:30:59.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f42507ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480cac50 con 0x7f42480ca750 2023-08-10T10:30:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f42507ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42480caf30 con 0x7f424815c630 2023-08-10T10:30:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424ed9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f42480cc110 0x7f424806a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39990/0 (socket says 172.21.15.88:39990) 2023-08-10T10:30:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424ed9c700 1 -- 172.21.15.88:0/2666416965 learned_addr learned my addr 172.21.15.88:0/2666416965 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f37e29ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f37dc1619f0 0x7f37dc0c9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f37e29ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc06d650 con 0x7f37dc161610 2023-08-10T10:30:59.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f37e29ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37dc06b990 con 0x7f37dc0cd860 2023-08-10T10:30:59.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.626+0000 7f37e29ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37dc06d920 con 0x7f37dc1619f0 2023-08-10T10:30:59.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f37db7fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f37dc0cd860 0x7f37dc0c9780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:35998/0 (socket says 172.21.15.88:35998) 2023-08-10T10:30:59.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f37db7fe700 1 -- 172.21.15.88:0/2696172401 learned_addr learned my addr 172.21.15.88:0/2696172401 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:30:59.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4fe4054560 con 0x7f4fec089170 2023-08-10T10:30:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424dd9a700 1 --2- 172.21.15.88:0/2666416965 >> v2:172.21.15.187:3300/0 conn(0x7f42480ca750 0x7f424806d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424e59b700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f424806cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424dd9a700 1 -- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 msgr2=0x7f424806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424dd9a700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f424806cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424dd9a700 1 -- 172.21.15.88:0/2666416965 >> v1:172.21.15.88:6789/0 conn(0x7f42480cc110 legacy=0x7f424806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f424dd9a700 1 -- 172.21.15.88:0/2666416965 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42480cc740 con 0x7f42480ca750 2023-08-10T10:30:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f5f317fa700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 0x7f5f2806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.627+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f2c08b020 con 0x7f5f3c0ca750 2023-08-10T10:30:59.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.625+0000 7f9a331ff700 1 -- 172.21.15.88:0/4115360023 wait complete. 2023-08-10T10:30:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7428017020 con 0x7f743006ea80 2023-08-10T10:30:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f742d7fa700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 0x7f741006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f742808cd00 con 0x7f743006ea80 2023-08-10T10:30:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f742ffff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 0x7f741006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f742ffff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 0x7f741006d2a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f743006e450 tx=0x7f7418009f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f9a331ff700 1 Processor -- start 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f9a331ff700 1 -- start start 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c0ca750 0x7f9a2c0c6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a2c0cc110 0x7f9a2c14f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c66b0 con 0x7f9a2c0ca750 2023-08-10T10:30:59.644 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c1f6f50 con 0x7f9a2c06b650 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7f9a331ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2c0c6930 con 0x7f9a2c0cc110 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f9a30f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f9a30f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39360/0 (socket says 172.21.15.88:39360) 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f9a30f9b700 1 -- 172.21.15.88:0/1848249824 learned_addr learned my addr 172.21.15.88:0/1848249824 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f424dd9a700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480ca750 0x7f424806d1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4240009d90 tx=0x7f424000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5931fc5fdc9975d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f424d599700 1 -- 172.21.15.88:0/2666416965 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f424000e070 con 0x7f42480ca750 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f424d599700 1 -- 172.21.15.88:0/2666416965 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f424000bb20 con 0x7f42480ca750 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f424d599700 1 -- 172.21.15.88:0/2666416965 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4240012430 con 0x7f42480ca750 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f42507ff700 1 -- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480ca750 msgr2=0x7f424806d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f42507ff700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480ca750 0x7f424806d1b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4240009d90 tx=0x7f424000b330 comp rx=0 tx=0).stop 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828089981 0 0) 0x7f37dc06d650 con 0x7f37dc161610 2023-08-10T10:30:59.646 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.628+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c40035b0 con 0x7f37dc161610 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758470493 0 0) 0x7f37dc06b990 con 0x7f37dc0cd860 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37dc06d650 con 0x7f37dc0cd860 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044192057 0 0) 0x7f37dc06d650 con 0x7f37dc0cd860 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 >> v2:172.21.15.88:3300/0 conn(0x7f37dc1619f0 msgr2=0x7f37dc0c9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 --2- 172.21.15.88:0/2696172401 >> v2:172.21.15.88:3300/0 conn(0x7f37dc1619f0 0x7f37dc0c9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 >> v1:172.21.15.88:6789/0 conn(0x7f37dc161610 legacy=0x7f37dc0cd150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.647 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc06dc00 con 0x7f37dc0cd860 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f37d0001670 con 0x7f37dc0cd860 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 >> v1:172.21.15.187:6789/0 conn(0x7f37dc0cd860 legacy=0x7f37dc0c9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37c4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37c4004850 0x7f37c4004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37c4005330 0x7f37c400ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc06d920 con 0x7f37c4003be0 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c400c280 con 0x7f37c4005330 2023-08-10T10:30:59.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.629+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c400c440 con 0x7f37c4004850 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37c4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37e0f9c700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37c4005330 0x7f37c400ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 -- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37c4004850 msgr2=0x7f37c4004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37c4004850 0x7f37c4004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 -- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37c4005330 msgr2=0x7f37c400ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37c4005330 0x7f37c400ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f37dbfff700 1 -- 172.21.15.88:0/2696172401 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc06d650 con 0x7f37c4003be0 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd1adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd1adff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efd141619f0 0x7efd140cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd1adff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1406d650 con 0x7efd1406b420 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd1adff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1406b990 con 0x7efd141619f0 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd1adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd1406d920 con 0x7efd14161610 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd18b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd18b9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50146/0 (socket says 172.21.15.88:50146) 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd18b9b700 1 -- 172.21.15.88:0/1200742649 learned_addr learned my addr 172.21.15.88:0/1200742649 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.630+0000 7efd0bfff700 1 --2- 172.21.15.88:0/1200742649 >> v2:172.21.15.88:3300/0 conn(0x7efd141619f0 0x7efd140cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7efd18b9b700 1 -- 172.21.15.88:0/1200742649 >> v2:172.21.15.88:3300/0 conn(0x7efd141619f0 msgr2=0x7efd140cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7efd18b9b700 1 --2- 172.21.15.88:0/1200742649 >> v2:172.21.15.88:3300/0 conn(0x7efd141619f0 0x7efd140cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7efd18b9b700 1 -- 172.21.15.88:0/1200742649 >> v1:172.21.15.187:6789/0 conn(0x7efd1406b420 legacy=0x7efd1406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7efd18b9b700 1 -- 172.21.15.88:0/1200742649 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1406dc00 con 0x7efd14161610 2023-08-10T10:30:59.651 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7efd18b9b700 1 --2- 172.21.15.88:0/1200742649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd100098f0 tx=0x7efd10009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=15e83bb6abb04006 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a2bfff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c0ca750 0x7f9a2c0c6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f37e0f9c700 1 -- 172.21.15.88:0/2696172401 reap_dead start 2023-08-10T10:30:59.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f37dbfff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37c4003fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001950 tx=0x7f37c4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96fb9efc675615f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a30f9b700 1 -- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a2c0cc110 msgr2=0x7f9a2c14f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a30f9b700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a2c0cc110 0x7f9a2c14f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a30f9b700 1 -- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c0ca750 msgr2=0x7f9a2c0c6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a30f9b700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c0ca750 0x7f9a2c0c6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f9a30f9b700 1 -- 172.21.15.88:0/1848249824 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a200094a0 con 0x7f9a2c06b650 2023-08-10T10:30:59.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f5f40b9b700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 0x7f5f2806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a30f9b700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400ba50 tx=0x7f9a2400be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7efd0b7fe700 1 -- 172.21.15.88:0/1200742649 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd10004230 con 0x7efd14161610 2023-08-10T10:30:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7efd0b7fe700 1 -- 172.21.15.88:0/1200742649 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd10004390 con 0x7efd14161610 2023-08-10T10:30:59.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7efd0b7fe700 1 -- 172.21.15.88:0/1200742649 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd100036a0 con 0x7efd14161610 2023-08-10T10:30:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f42507ff700 1 -- 172.21.15.88:0/2666416965 shutdown_connections 2023-08-10T10:30:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f42507ff700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f424806cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f42507ff700 1 --2- 172.21.15.88:0/2666416965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480ca750 0x7f424806d1b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f42507ff700 1 -- 172.21.15.88:0/2666416965 >> 172.21.15.88:0/2666416965 conn(0x7f42480cb5f0 msgr2=0x7f42480cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f2c0bd330 con 0x7f5f3c0ca750 2023-08-10T10:30:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f5f40b9b700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 0x7f5f2806d270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009dd0 tx=0x7f5f38009790 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2400cae0 con 0x7f9a2c06b650 2023-08-10T10:30:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2400cc40 con 0x7f9a2c06b650 2023-08-10T10:30:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24014440 con 0x7f9a2c06b650 2023-08-10T10:30:59.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2c0c6c10 con 0x7f9a2c06b650 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2c0c71d0 con 0x7f9a2c06b650 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 -- 172.21.15.88:0/1200742649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 msgr2=0x7efd140cd150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 --2- 172.21.15.88:0/1200742649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd100098f0 tx=0x7efd10009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 -- 172.21.15.88:0/1200742649 shutdown_connections 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 --2- 172.21.15.88:0/1200742649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd14161610 0x7efd140cd150 secure :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7efd100098f0 tx=0x7efd10009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:59.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 --2- 172.21.15.88:0/1200742649 >> v2:172.21.15.88:3300/0 conn(0x7efd141619f0 0x7efd140cd690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.633+0000 7efd1adff700 1 -- 172.21.15.88:0/1200742649 >> 172.21.15.88:0/1200742649 conn(0x7efd140cb5f0 msgr2=0x7efd140cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.631+0000 7f10e21ff700 1 Processor -- start 2023-08-10T10:30:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.632+0000 7f10e21ff700 1 -- start start 2023-08-10T10:30:59.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.634+0000 7f42507ff700 1 -- 172.21.15.88:0/2666416965 shutdown_connections 2023-08-10T10:30:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc001440 con 0x7f37c4003be0 2023-08-10T10:30:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc0052d0 con 0x7f37c4003be0 2023-08-10T10:30:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f37daffd700 1 -- 172.21.15.88:0/2696172401 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc003680 con 0x7f37c4003be0 2023-08-10T10:30:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f37e29ff700 1 -- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 msgr2=0x7f37c4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f37e29ff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37c4003fe0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f37cc001950 tx=0x7f37c4005880 comp rx=0 tx=0).stop 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f10e21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f10e21ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f10dc1615b0 0x7f10dc0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f10e21ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc0cf810 con 0x7f10dc0d2a30 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f10e21ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0d27e0 con 0x7f10dc1615b0 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f10e21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc06b7c0 con 0x7f10dc1611d0 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.636+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.636+0000 7f10db7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50156/0 (socket says 172.21.15.88:50156) 2023-08-10T10:30:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.636+0000 7f10db7fe700 1 -- 172.21.15.88:0/3661035614 learned_addr learned my addr 172.21.15.88:0/3661035614 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f10daffd700 1 --2- 172.21.15.88:0/3661035614 >> v2:172.21.15.88:3300/0 conn(0x7f10dc1615b0 0x7f10dc0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7efd1adff700 1 -- 172.21.15.88:0/1200742649 shutdown_connections 2023-08-10T10:30:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7efd1adff700 1 -- 172.21.15.88:0/1200742649 wait complete. 2023-08-10T10:30:59.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7efd1adff700 1 Processor -- start 2023-08-10T10:30:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f10db7fe700 1 -- 172.21.15.88:0/3661035614 >> v2:172.21.15.88:3300/0 conn(0x7f10dc1615b0 msgr2=0x7f10dc0cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:30:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f10db7fe700 1 --2- 172.21.15.88:0/3661035614 >> v2:172.21.15.88:3300/0 conn(0x7f10dc1615b0 0x7f10dc0cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f10db7fe700 1 -- 172.21.15.88:0/3661035614 >> v1:172.21.15.88:6789/0 conn(0x7f10dc0d2a30 legacy=0x7f10dc06bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f10db7fe700 1 -- 172.21.15.88:0/3661035614 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc06baa0 con 0x7f10dc1611d0 2023-08-10T10:30:59.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a24006d50 con 0x7f9a2c06b650 2023-08-10T10:30:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7f10db7fe700 1 --2- 172.21.15.88:0/3661035614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10d00098f0 tx=0x7f10d0009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=706393f37181211 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a2c04ecc0 con 0x7f9a2c06b650 2023-08-10T10:30:59.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7efd1adff700 1 -- start start 2023-08-10T10:30:59.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7f9a297fa700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 0x7f9a1806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.635+0000 7f42507ff700 1 -- 172.21.15.88:0/2666416965 wait complete. 2023-08-10T10:30:59.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a24089300 con 0x7f9a2c06b650 2023-08-10T10:30:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f37e29ff700 1 -- 172.21.15.88:0/2696172401 shutdown_connections 2023-08-10T10:30:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f37e29ff700 1 --2- 172.21.15.88:0/2696172401 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37c4003fe0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f37e29ff700 1 -- 172.21.15.88:0/2696172401 >> 172.21.15.88:0/2696172401 conn(0x7f37dc0cb5f0 msgr2=0x7f37dc0cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f10da7fc700 1 -- 172.21.15.88:0/3661035614 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000b8a0 con 0x7f10dc1611d0 2023-08-10T10:30:59.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f10da7fc700 1 -- 172.21.15.88:0/3661035614 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d000ba00 con 0x7f10dc1611d0 2023-08-10T10:30:59.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f10da7fc700 1 -- 172.21.15.88:0/3661035614 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d000bd90 con 0x7f10dc1611d0 2023-08-10T10:30:59.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7428057aa0 con 0x7f743006ea80 2023-08-10T10:30:59.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f9a2bfff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 0x7f9a1806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f37e29ff700 1 -- 172.21.15.88:0/2696172401 shutdown_connections 2023-08-10T10:30:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f37e29ff700 1 -- 172.21.15.88:0/2696172401 wait complete. 2023-08-10T10:30:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.637+0000 7f42507ff700 1 Processor -- start 2023-08-10T10:30:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.638+0000 7f42507ff700 1 -- start start 2023-08-10T10:30:59.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.639+0000 7f42507ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f424e59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f424e59b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41572/0 (socket says 172.21.15.88:41572) 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7f42507ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 0x7f42480898d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.641+0000 7f424dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 0x7f42480898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd1406b420 0x7efd14162bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd141619f0 0x7efd1415d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140c5de0 con 0x7efd1406b420 2023-08-10T10:30:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd1415fcf0 con 0x7efd1415f300 2023-08-10T10:30:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.640+0000 7efd1adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd14161e90 con 0x7efd141619f0 2023-08-10T10:30:59.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.641+0000 7f424dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 0x7f42480898d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39376/0 (socket says 172.21.15.88:39376) 2023-08-10T10:30:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.641+0000 7f9a2bfff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 0x7f9a1806d270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c150800 tx=0x7f9a1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.641+0000 7f10e21ff700 1 -- 172.21.15.88:0/3661035614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 msgr2=0x7f10dc0cd9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.641+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3661035614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f10d00098f0 tx=0x7f10d0009c00 comp rx=0 tx=0).stop 2023-08-10T10:30:59.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39392/0 (socket says 172.21.15.88:39392) 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 -- 172.21.15.88:0/1337941597 learned_addr learned my addr 172.21.15.88:0/1337941597 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f42507ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f42481585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f42507ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248200080 con 0x7f42480ca750 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f42507ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42480c3a70 con 0x7f42480cc110 2023-08-10T10:30:59.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f42507ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4248089e10 con 0x7f424815c630 2023-08-10T10:30:59.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f424e59b700 1 -- 172.21.15.88:0/931829645 learned_addr learned my addr 172.21.15.88:0/931829645 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f10e21ff700 1 -- 172.21.15.88:0/3661035614 shutdown_connections 2023-08-10T10:30:59.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3661035614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc1611d0 0x7f10dc0cd9e0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3661035614 >> v2:172.21.15.88:3300/0 conn(0x7f10dc1615b0 0x7f10dc0cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7f10e21ff700 1 -- 172.21.15.88:0/3661035614 >> 172.21.15.88:0/3661035614 conn(0x7f10dc0d31f0 msgr2=0x7f10dc0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:30:59.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd0bfff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd141619f0 0x7efd1415d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 -- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd141619f0 msgr2=0x7efd1415d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd141619f0 0x7efd1415d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 -- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd1406b420 msgr2=0x7efd14162bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd1406b420 0x7efd14162bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.642+0000 7efd1939c700 1 -- 172.21.15.88:0/1337941597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd10009550 con 0x7efd1415f300 2023-08-10T10:30:59.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7efd1939c700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00c7a0 tx=0x7efd0c00cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f37e29ff700 1 Processor -- start 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 -- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 msgr2=0x7f42481585b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f42481585b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 -- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 msgr2=0x7f42480898d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 0x7f42480898d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 -- 172.21.15.88:0/931829645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4240009a70 con 0x7f42480ca750 2023-08-10T10:30:59.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f424e59b700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4244012b50 tx=0x7f4244012f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.643+0000 7f37e29ff700 1 -- start start 2023-08-10T10:30:59.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244010900 con 0x7f42480ca750 2023-08-10T10:30:59.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4244013040 con 0x7f42480ca750 2023-08-10T10:30:59.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4244010c60 con 0x7f42480ca750 2023-08-10T10:30:59.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4248202c70 con 0x7f42480ca750 2023-08-10T10:30:59.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c003e10 con 0x7efd1415f300 2023-08-10T10:30:59.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c005070 con 0x7efd1415f300 2023-08-10T10:30:59.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c005420 con 0x7efd1415f300 2023-08-10T10:30:59.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.644+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4248203230 con 0x7f42480ca750 2023-08-10T10:30:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.645+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a240540a0 con 0x7f9a2c06b650 2023-08-10T10:30:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.645+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd1415d5c0 con 0x7efd1415f300 2023-08-10T10:30:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.645+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd141620e0 con 0x7efd1415f300 2023-08-10T10:30:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.645+0000 7f10e21ff700 1 -- 172.21.15.88:0/3661035614 shutdown_connections 2023-08-10T10:30:59.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.645+0000 7f10e21ff700 1 -- 172.21.15.88:0/3661035614 wait complete. 2023-08-10T10:30:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37dc0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 0x7f37dc1fa540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 0x7f37dc0c3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc1faf30 con 0x7f37c4003be0 2023-08-10T10:30:59.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c53a0 con 0x7f37dc1faa80 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.646+0000 7f37e29ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37dc0c55b0 con 0x7f37dc1f8030 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.647+0000 7f37e0f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 0x7f37dc0c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.647+0000 7f37e0f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 0x7f37dc0c3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39394/0 (socket says 172.21.15.88:39394) 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.647+0000 7f37e0f9c700 1 -- 172.21.15.88:0/3187177896 learned_addr learned my addr 172.21.15.88:0/3187177896 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.647+0000 7f37db7fe700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 0x7f37dc1fa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.647+0000 7f37dbfff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37dc0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 -- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 msgr2=0x7f37dc0c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 0x7f37dc0c3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 -- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 msgr2=0x7f37dc0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37dc0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 -- 172.21.15.88:0/3187177896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37dc0c2670 con 0x7f37dc1f8030 2023-08-10T10:30:59.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1404ecc0 con 0x7efd1415f300 2023-08-10T10:30:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f10e21ff700 1 Processor -- start 2023-08-10T10:30:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f10e21ff700 1 -- start start 2023-08-10T10:30:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f37db7fe700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 0x7f37dc1fa540 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f37dc063d60 tx=0x7f37d000ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0004c80 con 0x7f37dc1f8030 2023-08-10T10:30:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d0004de0 con 0x7f37dc1f8030 2023-08-10T10:30:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0007310 con 0x7f37dc1f8030 2023-08-10T10:30:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37dc0c2950 con 0x7f37dc1f8030 2023-08-10T10:30:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37dc0c2f10 con 0x7f37dc1f8030 2023-08-10T10:30:59.683 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.648+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f424804ecc0 con 0x7f42480ca750 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc0d2a30 0x7f10dc14d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc1611d0 0x7f10dc0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0b3b80 con 0x7f10dc1615b0 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc0b32b0 con 0x7f10dc1611d0 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.649+0000 7f10e21ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1f7370 con 0x7f10dc0d2a30 2023-08-10T10:30:59.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.650+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.650+0000 7f10dbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41606/0 (socket says 172.21.15.88:41606) 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.650+0000 7f10dbfff700 1 -- 172.21.15.88:0/3423681954 learned_addr learned my addr 172.21.15.88:0/3423681954 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 -- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc0d2a30 msgr2=0x7f10dc14d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc0d2a30 0x7f10dc14d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 -- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc1611d0 msgr2=0x7f10dc0c6b40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc1611d0 0x7f10dc0c6b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:30:59.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 -- 172.21.15.88:0/3423681954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d0009550 con 0x7f10dc1615b0 2023-08-10T10:30:59.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f10dbfff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c420 tx=0x7f10cc00c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.651+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37dc04ecc0 con 0x7f37dc1f8030 2023-08-10T10:30:59.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.652+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f37d0007470 con 0x7f37dc1f8030 2023-08-10T10:30:59.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.654+0000 7f37d8ff9700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 0x7f37c806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.654+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f37d0088e00 con 0x7f37dc1f8030 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.654+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4244018480 con 0x7f42480ca750 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.656+0000 7f423effd700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 0x7f422c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.656+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f424408d5f0 con 0x7f42480ca750 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.653+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efd0c006ba0 con 0x7efd1415f300 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.655+0000 7efd097fa700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 0x7efd0006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.655+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efd0c089170 con 0x7efd1415f300 2023-08-10T10:30:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.657+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efd0c053f30 con 0x7efd1415f300 2023-08-10T10:30:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.658+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f37d0053ba0 con 0x7f37dc1f8030 2023-08-10T10:30:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.658+0000 7f37dbfff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 0x7f37c806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.659+0000 7f37dbfff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 0x7f37c806d270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06e140 tx=0x7f37cc007f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0050d0 con 0x7f10dc1615b0 2023-08-10T10:30:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc005230 con 0x7f10dc1615b0 2023-08-10T10:30:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc006860 con 0x7f10dc1615b0 2023-08-10T10:30:59.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7efd18b9b700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 0x7efd0006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc159850 con 0x7f10dc1615b0 2023-08-10T10:30:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.660+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc0b37a0 con 0x7f10dc1615b0 2023-08-10T10:30:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.661+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4244058420 con 0x7f42480ca750 2023-08-10T10:30:59.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.661+0000 7efd18b9b700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 0x7efd0006d1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd14066b80 tx=0x7efd10010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.665+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f10cc0069c0 con 0x7f10dc1615b0 2023-08-10T10:30:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.666+0000 7f10c3fff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 0x7f10c406d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:30:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.667+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f10cc099950 con 0x7f10dc1615b0 2023-08-10T10:30:59.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.667+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc04ecc0 con 0x7f10dc1615b0 2023-08-10T10:30:59.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.668+0000 7f424dd9a700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 0x7f422c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.669+0000 7f424dd9a700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 0x7f422c06d270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4240014040 tx=0x7f4240011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.669+0000 7f10db7fe700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 0x7f10c406d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:30:59.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.670+0000 7f10db7fe700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 0x7f10c406d320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:30:59.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:30:59.680+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f10cc0645e0 con 0x7f10dc1615b0 2023-08-10T10:31:00.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.074+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4fec04ecc0 con 0x7f4fec089170 2023-08-10T10:31:00.079 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:31:00.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.075+0000 7f4fd37fe700 1 -- 172.21.15.88:0/2075848368 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4fe4057b80 con 0x7f4fec089170 2023-08-10T10:31:00.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.079+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 msgr2=0x7f4fd806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.079+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 0x7f4fd806d270 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc000c00 tx=0x7f4fdc01d040 comp rx=0 tx=0).stop 2023-08-10T10:31:00.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.079+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 msgr2=0x7f4fec0b25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.079+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4fe400cbd0 tx=0x7f4fe400cee0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 shutdown_connections 2023-08-10T10:31:00.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fec0cd150 0x7f4fec0ba680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4fd806adb0 0x7f4fd806d270 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fec06d680 0x7f4fec0c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 --2- 172.21.15.88:0/2075848368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fec089170 0x7f4fec0b25b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 >> 172.21.15.88:0/2075848368 conn(0x7f4fec0cb5f0 msgr2=0x7f4fec15f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 shutdown_connections 2023-08-10T10:31:00.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.080+0000 7f4ff15ff700 1 -- 172.21.15.88:0/2075848368 wait complete. 2023-08-10T10:31:00.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.088+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f7430071440 con 0x7f743006ea80 2023-08-10T10:31:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.089+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f1c0055a0 con 0x7f5f3c0ca750 2023-08-10T10:31:00.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.089+0000 7f742d7fa700 1 -- 172.21.15.88:0/96779658 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f742801f090 con 0x7f743006ea80 2023-08-10T10:31:00.091 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:00.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.091+0000 7f5f317fa700 1 -- 172.21.15.88:0/37046887 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f2c055e50 con 0x7f5f3c0ca750 2023-08-10T10:31:00.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.094+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 msgr2=0x7f741006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.094+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 0x7f741006d2a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f743006e450 tx=0x7f7418009f90 comp rx=0 tx=0).stop 2023-08-10T10:31:00.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.094+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 msgr2=0x7f74300c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.094+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f742800c4d0 tx=0x7f742800c890 comp rx=0 tx=0).stop 2023-08-10T10:31:00.096 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 shutdown_connections 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f741006ade0 0x7f741006d2a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74300c81d0 0x7f74300c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f743006ea80 0x7f74300c50d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 --2- 172.21.15.88:0/96779658 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7430158f80 0x7f74300b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 >> 172.21.15.88:0/96779658 conn(0x7f74300ced50 msgr2=0x7f7430070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 msgr2=0x7f5f2806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 0x7f5f2806d270 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009dd0 tx=0x7f5f38009790 comp rx=0 tx=0).stop 2023-08-10T10:31:00.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 msgr2=0x7f5f3c0c6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.095+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c0ccb60 tx=0x7f5f2c004750 comp rx=0 tx=0).stop 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.096+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 shutdown_connections 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.096+0000 7f74371ff700 1 -- 172.21.15.88:0/96779658 wait complete. 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 shutdown_connections 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5f3c0cc110 0x7f5f3c159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f3c06b650 0x7f5f3c0c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f2806adb0 0x7f5f2806d270 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 --2- 172.21.15.88:0/37046887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f3c0ca750 0x7f5f3c0c6d60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 >> 172.21.15.88:0/37046887 conn(0x7f5f3c0cb5f0 msgr2=0x7f5f3c071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.098+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 shutdown_connections 2023-08-10T10:31:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.098+0000 7f5f42dff700 1 -- 172.21.15.88:0/37046887 wait complete. 2023-08-10T10:31:00.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.097+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9a2c06cec0 con 0x7f9a2c06b650 2023-08-10T10:31:00.104 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:00.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.100+0000 7f9a297fa700 1 -- 172.21.15.88:0/1848249824 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a240576c0 con 0x7f9a2c06b650 2023-08-10T10:31:00.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f42480c6010 con 0x7f42480ca750 2023-08-10T10:31:00.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 msgr2=0x7f9a1806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 0x7f9a1806d270 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c150800 tx=0x7f9a1c009040 comp rx=0 tx=0).stop 2023-08-10T10:31:00.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 msgr2=0x7f9a2c14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9a2400ba50 tx=0x7f9a2400be10 comp rx=0 tx=0).stop 2023-08-10T10:31:00.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 shutdown_connections 2023-08-10T10:31:00.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a1806adb0 0x7f9a1806d270 secure :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c150800 tx=0x7f9a1c009040 comp rx=0 tx=0).stop 2023-08-10T10:31:00.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.105+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a2c0cc110 0x7f9a2c14f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a2c06b650 0x7f9a2c14fc40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f9a331ff700 1 --2- 172.21.15.88:0/1848249824 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a2c0ca750 0x7f9a2c0c6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 >> 172.21.15.88:0/1848249824 conn(0x7f9a2c0cb5f0 msgr2=0x7f9a2c150920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 shutdown_connections 2023-08-10T10:31:00.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f9a331ff700 1 -- 172.21.15.88:0/1848249824 wait complete. 2023-08-10T10:31:00.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7f423effd700 1 -- 172.21.15.88:0/931829645 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f424405ba40 con 0x7f42480ca750 2023-08-10T10:31:00.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.106+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efd140ccf30 con 0x7efd1415f300 2023-08-10T10:31:00.110 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:31:00.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.107+0000 7efd097fa700 1 -- 172.21.15.88:0/1337941597 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efd0c017090 con 0x7efd1415f300 2023-08-10T10:31:00.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 msgr2=0x7f422c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 0x7f422c06d270 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4240014040 tx=0x7f4240011000 comp rx=0 tx=0).stop 2023-08-10T10:31:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 msgr2=0x7f42481ffb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4244012b50 tx=0x7f4244012f10 comp rx=0 tx=0).stop 2023-08-10T10:31:00.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 shutdown_connections 2023-08-10T10:31:00.113 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:31:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f422c06adb0 0x7f422c06d270 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f424815c630 0x7f42481585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f42480ca750 0x7f42481ffb40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 --2- 172.21.15.88:0/931829645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42480cc110 0x7f42480898d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.111+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 >> 172.21.15.88:0/931829645 conn(0x7f42480cb5f0 msgr2=0x7f424815a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.112+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f37dc06d0c0 con 0x7f37dc1f8030 2023-08-10T10:31:00.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2023-08-10T10:31:00.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.112+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 shutdown_connections 2023-08-10T10:31:00.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.112+0000 7f42507ff700 1 -- 172.21.15.88:0/931829645 wait complete. 2023-08-10T10:31:00.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 msgr2=0x7efd0006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 0x7efd0006d1f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd14066b80 tx=0x7efd10010000 comp rx=0 tx=0).stop 2023-08-10T10:31:00.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 msgr2=0x7efd1415f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd0c00c7a0 tx=0x7efd0c00cb60 comp rx=0 tx=0).stop 2023-08-10T10:31:00.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7f37d8ff9700 1 -- 172.21.15.88:0/3187177896 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f37d0018090 con 0x7f37dc1f8030 2023-08-10T10:31:00.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 shutdown_connections 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd1415f300 0x7efd1415f7b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efd1406b420 0x7efd14162bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efd0006ad30 0x7efd0006d1f0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efd14066b80 tx=0x7efd10010000 comp rx=0 tx=0).stop 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 --2- 172.21.15.88:0/1337941597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd141619f0 0x7efd1415d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.113+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 >> 172.21.15.88:0/1337941597 conn(0x7efd140cb5f0 msgr2=0x7efd140b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.118 INFO:teuthology.orchestra.run.smithi088.stdout:55834574856 2023-08-10T10:31:00.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.114+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 shutdown_connections 2023-08-10T10:31:00.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.114+0000 7efd1adff700 1 -- 172.21.15.88:0/1337941597 wait complete. 2023-08-10T10:31:00.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.118+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 msgr2=0x7f37c806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.118+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 0x7f37c806d270 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f37dc06e140 tx=0x7f37cc007f90 comp rx=0 tx=0).stop 2023-08-10T10:31:00.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.118+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 msgr2=0x7f37dc1fa540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.118+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 0x7f37dc1fa540 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f37dc063d60 tx=0x7f37d000ca10 comp rx=0 tx=0).stop 2023-08-10T10:31:00.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 shutdown_connections 2023-08-10T10:31:00.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37dc1faa80 0x7f37dc0c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37c4003be0 0x7f37dc0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f37c806adb0 0x7f37c806d270 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 --2- 172.21.15.88:0/3187177896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37dc1f8030 0x7f37dc1fa540 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 >> 172.21.15.88:0/3187177896 conn(0x7f37dc0cb5f0 msgr2=0x7f37dc071760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 shutdown_connections 2023-08-10T10:31:00.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.125+0000 7f37e29ff700 1 -- 172.21.15.88:0/3187177896 wait complete. 2023-08-10T10:31:00.132 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.1 2023-08-10T10:31:00.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-08-10T10:31:00.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.129+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f10dc0b3cc0 con 0x7f10dc1615b0 2023-08-10T10:31:00.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.131+0000 7f10c3fff700 1 -- 172.21.15.88:0/3423681954 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10dc0b3cc0 con 0x7f10dc1615b0 2023-08-10T10:31:00.133 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:00.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.133+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 msgr2=0x7f10c406d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.133+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 0x7f10c406d320 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f10d0000c00 tx=0x7f10d0010000 comp rx=0 tx=0).stop 2023-08-10T10:31:00.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.133+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 msgr2=0x7f10dc0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:00.135 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.133+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c420 tx=0x7f10cc00c7e0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 shutdown_connections 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10dc1615b0 0x7f10dc0c7080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f10c406ae60 0x7f10c406d320 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10dc0d2a30 0x7f10dc14d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 --2- 172.21.15.88:0/3423681954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10dc1611d0 0x7f10dc0c6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:00.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 >> 172.21.15.88:0/3423681954 conn(0x7f10dc0d31f0 msgr2=0x7f10dc162cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:00.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 shutdown_connections 2023-08-10T10:31:00.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:00.134+0000 7f10e21ff700 1 -- 172.21.15.88:0/3423681954 wait complete. 2023-08-10T10:31:00.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.3 2023-08-10T10:31:00.142 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-08-10T10:31:00.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2023-08-10T10:31:00.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-08-10T10:31:00.160 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.7 2023-08-10T10:31:01.117 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-10T10:31:01.133 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-10T10:31:01.134 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-10T10:31:01.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-10T10:31:01.143 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-10T10:31:01.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-10T10:31:01.158 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-10T10:31:01.160 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-10T10:31:01.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.451+0000 7f9a5bfff700 1 Processor -- start 2023-08-10T10:31:01.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.451+0000 7f9a5bfff700 1 -- start start 2023-08-10T10:31:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.452+0000 7f9a5bfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a5415c630 0x7f9a5406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a540ca750 0x7f9a5406d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5406b650 0x7f9a5406a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a5415ca10 con 0x7f9a540ca750 2023-08-10T10:31:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5bfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a540cac50 con 0x7f9a5415c630 2023-08-10T10:31:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5bfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540caf30 con 0x7f9a5406b650 2023-08-10T10:31:01.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5959a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a540ca750 0x7f9a5406d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5959a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a540ca750 0x7f9a5406d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41610/0 (socket says 172.21.15.88:41610) 2023-08-10T10:31:01.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a5959a700 1 -- 172.21.15.88:0/433123603 learned_addr learned my addr 172.21.15.88:0/433123603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.453+0000 7f9a59d9b700 1 --2- 172.21.15.88:0/433123603 >> v2:172.21.15.187:3300/0 conn(0x7f9a5415c630 0x7f9a5406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.454+0000 7f9a5959a700 1 -- 172.21.15.88:0/433123603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5406b650 msgr2=0x7f9a5406a170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.454+0000 7f9a5959a700 1 --2- 172.21.15.88:0/433123603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5406b650 0x7f9a5406a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.454+0000 7f9a5959a700 1 -- 172.21.15.88:0/433123603 >> v2:172.21.15.187:3300/0 conn(0x7f9a5415c630 msgr2=0x7f9a5406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.454+0000 7f9a5959a700 1 --2- 172.21.15.88:0/433123603 >> v2:172.21.15.187:3300/0 conn(0x7f9a5415c630 0x7f9a5406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.454+0000 7f9a5959a700 1 -- 172.21.15.88:0/433123603 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a540cc740 con 0x7f9a540ca750 2023-08-10T10:31:01.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.455+0000 7f9a5959a700 1 --2- 172.21.15.88:0/433123603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a540ca750 0x7f9a5406d1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a540cb540 tx=0x7f9a4c009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3904131290f0b8a1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.455+0000 7f9a58d99700 1 -- 172.21.15.88:0/433123603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00dd00 con 0x7f9a540ca750 2023-08-10T10:31:01.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.455+0000 7f9a58d99700 1 -- 172.21.15.88:0/433123603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a4c0092e0 con 0x7f9a540ca750 2023-08-10T10:31:01.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.455+0000 7f9a58d99700 1 -- 172.21.15.88:0/433123603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c00e670 con 0x7f9a540ca750 2023-08-10T10:31:01.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.456+0000 7f9a5bfff700 1 -- 172.21.15.88:0/433123603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a540ca750 msgr2=0x7f9a5406d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.456+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/433123603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a540ca750 0x7f9a5406d1b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a540cb540 tx=0x7f9a4c009eb0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 -- 172.21.15.88:0/433123603 shutdown_connections 2023-08-10T10:31:01.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/433123603 >> v2:172.21.15.187:3300/0 conn(0x7f9a5415c630 0x7f9a5406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.472 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/433123603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5406b650 0x7f9a5406a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/433123603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a540ca750 0x7f9a5406d1b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 -- 172.21.15.88:0/433123603 >> 172.21.15.88:0/433123603 conn(0x7f9a540cb5f0 msgr2=0x7f9a540cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 -- 172.21.15.88:0/433123603 shutdown_connections 2023-08-10T10:31:01.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.464+0000 7f9a5bfff700 1 -- 172.21.15.88:0/433123603 wait complete. 2023-08-10T10:31:01.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.467+0000 7f9a5bfff700 1 Processor -- start 2023-08-10T10:31:01.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.468+0000 7f9a5bfff700 1 -- start start 2023-08-10T10:31:01.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a540ca750 0x7f9a540c6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5415c630 0x7f9a540c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a541f6060 con 0x7f9a5406b650 2023-08-10T10:31:01.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540c5c40 con 0x7f9a540ca750 2023-08-10T10:31:01.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.470+0000 7f9a5bfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a540c6aa0 con 0x7f9a5415c630 2023-08-10T10:31:01.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.471+0000 7f9a59d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.471+0000 7f9a59d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41612/0 (socket says 172.21.15.88:41612) 2023-08-10T10:31:01.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.471+0000 7f9a59d9b700 1 -- 172.21.15.88:0/3853961691 learned_addr learned my addr 172.21.15.88:0/3853961691 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.471+0000 7f9a5a59c700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5415c630 0x7f9a540c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.472+0000 7f9a59d9b700 1 -- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5415c630 msgr2=0x7f9a540c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.472+0000 7f9a59d9b700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5415c630 0x7f9a540c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.472+0000 7f9a59d9b700 1 -- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a540ca750 msgr2=0x7f9a540c6f30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:31:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.472+0000 7f9a59d9b700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a540ca750 0x7f9a540c6f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.472+0000 7f9a59d9b700 1 -- 172.21.15.88:0/3853961691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c009830 con 0x7f9a5406b650 2023-08-10T10:31:01.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.473+0000 7f9a59d9b700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400d800 tx=0x7f9a4400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.476+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a440125f0 con 0x7f9a5406b650 2023-08-10T10:31:01.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.476+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a44012750 con 0x7f9a5406b650 2023-08-10T10:31:01.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.476+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a44012ae0 con 0x7f9a5406b650 2023-08-10T10:31:01.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.476+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a540c5e90 con 0x7f9a5406b650 2023-08-10T10:31:01.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.476+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a540c6450 con 0x7f9a5406b650 2023-08-10T10:31:01.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.481+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a44012c40 con 0x7f9a5406b650 2023-08-10T10:31:01.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.482+0000 7f9a4a7fc700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 0x7f9a3806d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.482+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f9a44089ba0 con 0x7f9a5406b650 2023-08-10T10:31:01.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.483+0000 7f9a5959a700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 0x7f9a3806d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.486+0000 7f9a5959a700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 0x7f9a3806d240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a541e55c0 tx=0x7f9a4c012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.486+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a3c0052f0 con 0x7f9a5406b650 2023-08-10T10:31:01.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.497+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a440548b0 con 0x7f9a5406b650 2023-08-10T10:31:01.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.507+0000 7f3c8e3ff700 1 Processor -- start 2023-08-10T10:31:01.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.508+0000 7f3c8e3ff700 1 -- start start 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.509+0000 7f3c8e3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c88089170 0x7f3c8806d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.510+0000 7f3c8e3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c8806bb10 con 0x7f3c880cd3c0 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.510+0000 7f3c8e3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c880ccf10 con 0x7f3c8816a2b0 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.510+0000 7f3c8e3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c8806b550 con 0x7f3c88089170 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.510+0000 7f3c8c99c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c88089170 0x7f3c8806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c877fe700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3c8816a2b0 0x7f3c8806cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:36008/0 (socket says 172.21.15.88:36008) 2023-08-10T10:31:01.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c877fe700 1 -- 172.21.15.88:0/4293217287 learned_addr learned my addr 172.21.15.88:0/4293217287 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c86ffd700 1 -- 172.21.15.88:0/4293217287 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119381403 0 0) 0x7f3c880ccf10 con 0x7f3c8816a2b0 2023-08-10T10:31:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c86ffd700 1 -- 172.21.15.88:0/4293217287 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c700035b0 con 0x7f3c8816a2b0 2023-08-10T10:31:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c8c99c700 1 -- 172.21.15.88:0/4293217287 >> v1:172.21.15.187:6789/0 conn(0x7f3c8816a2b0 legacy=0x7f3c8806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c8c99c700 1 -- 172.21.15.88:0/4293217287 >> v1:172.21.15.88:6789/0 conn(0x7f3c880cd3c0 legacy=0x7f3c88169ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.511+0000 7f3c8c99c700 1 -- 172.21.15.88:0/4293217287 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8806b830 con 0x7f3c88089170 2023-08-10T10:31:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.513+0000 7f3c8c99c700 1 --2- 172.21.15.88:0/4293217287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c8806d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000bfa0 tx=0x7f3c8000d330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=844ea8967f041243 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.514+0000 7f3c86ffd700 1 -- 172.21.15.88:0/4293217287 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80010070 con 0x7f3c88089170 2023-08-10T10:31:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.514+0000 7f3c86ffd700 1 -- 172.21.15.88:0/4293217287 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c80003a20 con 0x7f3c88089170 2023-08-10T10:31:01.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.514+0000 7f3c86ffd700 1 -- 172.21.15.88:0/4293217287 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c80003db0 con 0x7f3c88089170 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.515+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/4293217287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 msgr2=0x7f3c8806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.515+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/4293217287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c8806d380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000bfa0 tx=0x7f3c8000d330 comp rx=0 tx=0).stop 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.515+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/4293217287 shutdown_connections 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.515+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/4293217287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c8806d380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.515+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/4293217287 >> 172.21.15.88:0/4293217287 conn(0x7f3c880cb5f0 msgr2=0x7f3c880cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.516+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/4293217287 shutdown_connections 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.516+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/4293217287 wait complete. 2023-08-10T10:31:01.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.518+0000 7f3c8e3ff700 1 Processor -- start 2023-08-10T10:31:01.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.518+0000 7f3c8e3ff700 1 -- start start 2023-08-10T10:31:01.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c88203ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c8816a2b0 0x7f3c88088600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88203ff0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88165a20 con 0x7f3c88089170 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.520+0000 7f3c8e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c88165d00 con 0x7f3c8816a2b0 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.521+0000 7f3c87fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c88203ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.522+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.522+0000 7f3c877fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41628/0 (socket says 172.21.15.88:41628) 2023-08-10T10:31:01.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.522+0000 7f3c877fe700 1 -- 172.21.15.88:0/2951716605 learned_addr learned my addr 172.21.15.88:0/2951716605 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 -- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c8816a2b0 msgr2=0x7f3c88088600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:31:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c8816a2b0 0x7f3c88088600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 -- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 msgr2=0x7f3c88203ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c88203ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 -- 172.21.15.88:0/2951716605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c8000bc80 con 0x7f3c880cd3c0 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.523+0000 7f3c877fe700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00ba30 tx=0x7f3c7c00bdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c00cce0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c7c00ce40 con 0x7f3c880cd3c0 2023-08-10T10:31:01.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c7c015690 con 0x7f3c880cd3c0 2023-08-10T10:31:01.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7fe58afff700 1 Processor -- start 2023-08-10T10:31:01.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c88165fe0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c881665a0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.524+0000 7fe58afff700 1 -- start start 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.526+0000 7fe58afff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe5840c2060 0x7fe5840c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.526+0000 7fe58afff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe584165940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.526+0000 7fe58afff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840cd1a0 con 0x7fe5840cae20 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.526+0000 7fe58afff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5840caa00 con 0x7fe5840c2060 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.526+0000 7fe58afff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe584165e80 con 0x7fe5840710a0 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.527+0000 7fe588d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe5840c2060 0x7fe5840c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.527+0000 7fe588d9b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe5840c2060 0x7fe5840c9710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39436/0 (socket says 172.21.15.88:39436) 2023-08-10T10:31:01.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.527+0000 7fe588d9b700 1 -- 172.21.15.88:0/2611647522 learned_addr learned my addr 172.21.15.88:0/2611647522 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.528+0000 7fe588d9b700 1 -- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 msgr2=0x7fe584165940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.528+0000 7fe588d9b700 1 --2- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe584165940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.528+0000 7fe588d9b700 1 -- 172.21.15.88:0/2611647522 >> v1:172.21.15.187:6789/0 conn(0x7fe5840cae20 legacy=0x7fe584070990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.528+0000 7fe588d9b700 1 -- 172.21.15.88:0/2611647522 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840c2440 con 0x7fe5840c2060 2023-08-10T10:31:01.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.529+0000 7fe588d9b700 1 --2- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840c2060 0x7fe5840c9710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5740098f0 tx=0x7fe574009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b1690ba0095b343 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.529+0000 7fe5837fe700 1 -- 172.21.15.88:0/2611647522 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574004230 con 0x7fe5840c2060 2023-08-10T10:31:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.529+0000 7fe5837fe700 1 -- 172.21.15.88:0/2611647522 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574004390 con 0x7fe5840c2060 2023-08-10T10:31:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.529+0000 7fe5837fe700 1 -- 172.21.15.88:0/2611647522 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5740036a0 con 0x7fe5840c2060 2023-08-10T10:31:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.530+0000 7fe58afff700 1 -- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840c2060 msgr2=0x7fe5840c9710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.532 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.530+0000 7fe58afff700 1 --2- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840c2060 0x7fe5840c9710 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5740098f0 tx=0x7fe574009c00 comp rx=0 tx=0).stop 2023-08-10T10:31:01.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.531+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c8806e360 con 0x7f3c880cd3c0 2023-08-10T10:31:01.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.531+0000 7fe58afff700 1 -- 172.21.15.88:0/2611647522 shutdown_connections 2023-08-10T10:31:01.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.531+0000 7fe58afff700 1 --2- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe584165940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.531+0000 7fe58afff700 1 --2- 172.21.15.88:0/2611647522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840c2060 0x7fe5840c9710 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.531+0000 7fe58afff700 1 -- 172.21.15.88:0/2611647522 >> 172.21.15.88:0/2611647522 conn(0x7fe5840ced50 msgr2=0x7fe5840cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.532+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3c7c012070 con 0x7f3c880cd3c0 2023-08-10T10:31:01.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.533+0000 7fe58afff700 1 -- 172.21.15.88:0/2611647522 shutdown_connections 2023-08-10T10:31:01.540 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.534+0000 7fe58afff700 1 -- 172.21.15.88:0/2611647522 wait complete. 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7fe58afff700 1 Processor -- start 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7fe58afff700 1 -- start start 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe5840c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 0x7fe58406a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cae20 0x7fe58406ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840b2500 con 0x7fe5840c2060 2023-08-10T10:31:01.541 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840c8a50 con 0x7fe5840cae20 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe58afff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840b1980 con 0x7fe5840710a0 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.534+0000 7fe5bf1ff700 1 Processor -- start 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.534+0000 7fe5bf1ff700 1 -- start start 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7fe5bf1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7fe5bf1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe5b8070990 0x7fe5b8070e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.542 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7fe5bf1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b80c9b10 con 0x7fe5b8158f80 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7fe5bf1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b80ca120 con 0x7fe5b8070990 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7fe5bf1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8071360 con 0x7fe5b80ccea0 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7fe5b7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7fe5b7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50246/0 (socket says 172.21.15.88:50246) 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7fe5b7fff700 1 -- 172.21.15.88:0/199943606 learned_addr learned my addr 172.21.15.88:0/199943606 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe5b7fff700 1 -- 172.21.15.88:0/199943606 >> v2:172.21.15.88:3300/0 conn(0x7fe5b8070990 msgr2=0x7fe5b8070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.543 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe5b7fff700 1 --2- 172.21.15.88:0/199943606 >> v2:172.21.15.88:3300/0 conn(0x7fe5b8070990 0x7fe5b8070e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe5b7fff700 1 -- 172.21.15.88:0/199943606 >> v1:172.21.15.187:6789/0 conn(0x7fe5b8158f80 legacy=0x7fe5b80b1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.538+0000 7fe5b7fff700 1 -- 172.21.15.88:0/199943606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b80cdf20 con 0x7fe5b80ccea0 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.533+0000 7f3c84ff9700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 0x7f3c7406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.533+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3c7c0896a0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.536+0000 7f3c87fff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 0x7f3c7406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.544 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.537+0000 7f3c87fff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 0x7f3c7406d270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c880c4580 tx=0x7f3c78009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.539+0000 7fe588d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe5840c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.540+0000 7fe588d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe5840c8510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50252/0 (socket says 172.21.15.88:50252) 2023-08-10T10:31:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.540+0000 7fe588d9b700 1 -- 172.21.15.88:0/115650933 learned_addr learned my addr 172.21.15.88:0/115650933 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.540+0000 7f9504bff700 1 Processor -- start 2023-08-10T10:31:01.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.540+0000 7fe583fff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 0x7fe58406a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.540+0000 7f9504bff700 1 -- start start 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.541+0000 7fe583fff700 1 -- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 msgr2=0x7fe5840c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.541+0000 7fe583fff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe5840c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.541+0000 7fe583fff700 1 -- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cae20 msgr2=0x7fe58406ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.541+0000 7fe583fff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cae20 0x7fe58406ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.541+0000 7fe583fff700 1 -- 172.21.15.88:0/115650933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009550 con 0x7fe5840c2060 2023-08-10T10:31:01.547 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.542+0000 7fe583fff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 0x7fe58406a930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00bdf0 tx=0x7fe57c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.542+0000 7fe5b7fff700 1 --2- 172.21.15.88:0/199943606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80088f0 tx=0x7fe5a800d330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f54357d7db6eba27 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3c7c0544d0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.548 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00cc90 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00cdf0 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c014640 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5840b1c60 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.543+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5840b2220 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5840c6710 con 0x7fe5840c2060 2023-08-10T10:31:01.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f48b5fff700 1 Processor -- start 2023-08-10T10:31:01.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f9504bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f950006b650 0x7f950006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f9504bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000caf30 con 0x7f95000cc110 2023-08-10T10:31:01.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f9504bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95000cc740 con 0x7f95000ca750 2023-08-10T10:31:01.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f9504bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95000cca20 con 0x7f950006b650 2023-08-10T10:31:01.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.545+0000 7f48b5fff700 1 -- start start 2023-08-10T10:31:01.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.546+0000 7f94fe59c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f95000cc110 0x7f950006aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40018/0 (socket says 172.21.15.88:40018) 2023-08-10T10:31:01.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.546+0000 7f94fe59c700 1 -- 172.21.15.88:0/984192257 learned_addr learned my addr 172.21.15.88:0/984192257 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:01.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.546+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693914792 0 0) 0x7f95000caf30 con 0x7f95000cc110 2023-08-10T10:31:01.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.546+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94e80035b0 con 0x7f95000cc110 2023-08-10T10:31:01.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f48b5fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f48b00c2060 0x7f48b00c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f48b5fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f48b00cae20 0x7f48b0165940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f48b5fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b00cd1a0 con 0x7f48b0070990 2023-08-10T10:31:01.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f48b5fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b00caa00 con 0x7f48b00c2060 2023-08-10T10:31:01.552 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f48b5fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b0165e80 con 0x7f48b00cae20 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2414882136 0 0) 0x7f94e80035b0 con 0x7f95000cc110 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f950006b650 msgr2=0x7f950006a170 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f950006b650 0x7f950006a170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 >> v1:172.21.15.187:6789/0 conn(0x7f95000ca750 legacy=0x7f950015c3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000ccd00 con 0x7f95000cc110 2023-08-10T10:31:01.553 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f94f0001670 con 0x7f95000cc110 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 >> v1:172.21.15.88:6789/0 conn(0x7f95000cc110 legacy=0x7f950006aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e8003a30 0x7f94e8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e8004850 0x7f94e8004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e8005210 0x7f94e800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000cca20 con 0x7f94e8005210 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e800c140 con 0x7f94e8003a30 2023-08-10T10:31:01.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e800c300 con 0x7f94e8004850 2023-08-10T10:31:01.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7fec3adff700 1 Processor -- start 2023-08-10T10:31:01.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7fec3adff700 1 -- start start 2023-08-10T10:31:01.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f94fe59c700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e8003a30 0x7f94e8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f48b00cae20 0x7f48b0165940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f48b00cae20 0x7f48b0165940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39450/0 (socket says 172.21.15.88:39450) 2023-08-10T10:31:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 -- 172.21.15.88:0/2647190420 learned_addr learned my addr 172.21.15.88:0/2647190420 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 -- 172.21.15.88:0/2647190420 >> v2:172.21.15.88:3300/0 conn(0x7f48b00c2060 msgr2=0x7f48b00c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 --2- 172.21.15.88:0/2647190420 >> v2:172.21.15.88:3300/0 conn(0x7f48b00c2060 0x7f48b00c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 -- 172.21.15.88:0/2647190420 >> v1:172.21.15.88:6789/0 conn(0x7f48b0070990 legacy=0x7f48b0070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.548+0000 7f48aeffd700 1 -- 172.21.15.88:0/2647190420 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b00c2440 con 0x7f48b00cae20 2023-08-10T10:31:01.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e8004850 0x7f94e8004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f48aeffd700 1 --2- 172.21.15.88:0/2647190420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00cae20 0x7f48b0165940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48b00b4ce0 tx=0x7f48a4009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=930428e6a0242879 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f48ae7fc700 1 -- 172.21.15.88:0/2647190420 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4004230 con 0x7f48b00cae20 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f48ae7fc700 1 -- 172.21.15.88:0/2647190420 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a4004390 con 0x7f48b00cae20 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f48ae7fc700 1 -- 172.21.15.88:0/2647190420 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a40036a0 con 0x7f48b00cae20 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.547+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe57c01d3b0 con 0x7fe5840c2060 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7fe5817fa700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 0x7fe57006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.558 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe57c089520 con 0x7fe5840c2060 2023-08-10T10:31:01.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 -- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e8003a30 msgr2=0x7f94e8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e8003a30 0x7f94e8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 -- 172.21.15.88:0/984192257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e8005210 msgr2=0x7f94e800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f94e8005210 0x7f94e800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.549+0000 7f94fdd9b700 1 -- 172.21.15.88:0/984192257 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95000ccd00 con 0x7f94e8004850 2023-08-10T10:31:01.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fa865bff700 1 Processor -- start 2023-08-10T10:31:01.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 -- 172.21.15.88:0/2647190420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00cae20 msgr2=0x7f48b0165940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 --2- 172.21.15.88:0/2647190420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00cae20 0x7f48b0165940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f48b00b4ce0 tx=0x7f48a4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 -- 172.21.15.88:0/2647190420 shutdown_connections 2023-08-10T10:31:01.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 --2- 172.21.15.88:0/2647190420 >> v2:172.21.15.88:3300/0 conn(0x7f48b00c2060 0x7f48b00c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 --2- 172.21.15.88:0/2647190420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00cae20 0x7f48b0165940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 -- 172.21.15.88:0/2647190420 >> 172.21.15.88:0/2647190420 conn(0x7f48b00ced50 msgr2=0x7f48b00cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f94fdd9b700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e8004850 0x7f94e8004cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009860 tx=0x7f94e8005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e08454ba9daaee6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f48b5fff700 1 -- 172.21.15.88:0/2647190420 shutdown_connections 2023-08-10T10:31:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fec3adff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec340cc110 0x7fec3415c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fec3adff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec340caf30 con 0x7fec3406d380 2023-08-10T10:31:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fec3adff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec340cc740 con 0x7fec340ca750 2023-08-10T10:31:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fec3adff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec340cca20 con 0x7fec340cc110 2023-08-10T10:31:01.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4011620 con 0x7f94e8004850 2023-08-10T10:31:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f4011780 con 0x7f94e8004850 2023-08-10T10:31:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f94fd59a700 1 -- 172.21.15.88:0/984192257 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f4011b30 con 0x7f94e8004850 2023-08-10T10:31:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7fec33fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fec340ca750 0x7fec3406cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:36052/0 (socket says 172.21.15.88:36052) 2023-08-10T10:31:01.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7fec33fff700 1 -- 172.21.15.88:0/3068224306 learned_addr learned my addr 172.21.15.88:0/3068224306 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f48b5fff700 1 -- 172.21.15.88:0/2647190420 wait complete. 2023-08-10T10:31:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f9504bff700 1 -- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e8004850 msgr2=0x7f94e8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f9504bff700 1 --2- 172.21.15.88:0/984192257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e8004850 0x7f94e8004cd0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f94f4009860 tx=0x7f94e8005880 comp rx=0 tx=0).stop 2023-08-10T10:31:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.551+0000 7f94fed9d700 1 -- 172.21.15.88:0/984192257 reap_dead start 2023-08-10T10:31:01.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7f9504bff700 1 -- 172.21.15.88:0/984192257 shutdown_connections 2023-08-10T10:31:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7f9504bff700 1 -- 172.21.15.88:0/984192257 >> 172.21.15.88:0/984192257 conn(0x7f95000cb5f0 msgr2=0x7f95000cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.550+0000 7fa865bff700 1 -- start start 2023-08-10T10:31:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fa865bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 0x7fa86015c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fa865bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa86006b650 0x7fa86006a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fa865bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8600cac50 con 0x7fa8600ca750 2023-08-10T10:31:01.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fa865bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8600caf30 con 0x7fa86006b650 2023-08-10T10:31:01.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fa865bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cc740 con 0x7fa8600cc110 2023-08-10T10:31:01.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fec337fe700 1 -- 172.21.15.88:0/3068224306 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826699015 0 0) 0x7fec340cc740 con 0x7fec340ca750 2023-08-10T10:31:01.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fec337fe700 1 -- 172.21.15.88:0/3068224306 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec1c0035b0 con 0x7fec340ca750 2023-08-10T10:31:01.566 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fa856ffd700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fa8600ca750 0x7fa86006a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:36060/0 (socket says 172.21.15.88:36060) 2023-08-10T10:31:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fa856ffd700 1 -- 172.21.15.88:0/727907560 learned_addr learned my addr 172.21.15.88:0/727907560 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.552+0000 7fe588d9b700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 0x7fe57006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fe588d9b700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 0x7fe57006d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe574009c40 tx=0x7fe574008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.567 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7f48b5fff700 1 Processor -- start 2023-08-10T10:31:01.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.553+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 0x7fa86015c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002063614 0 0) 0x7fa8600cac50 con 0x7fa8600ca750 2023-08-10T10:31:01.568 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa84c0035b0 con 0x7fa8600ca750 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1814130350 0 0) 0x7fa84c0035b0 con 0x7fa8600ca750 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 msgr2=0x7fa86015c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 0x7fa86015c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 >> v2:172.21.15.88:3300/0 conn(0x7fa86006b650 msgr2=0x7fa86006a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 --2- 172.21.15.88:0/727907560 >> v2:172.21.15.88:3300/0 conn(0x7fa86006b650 0x7fa86006a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600cca20 con 0x7fa8600ca750 2023-08-10T10:31:01.569 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fa850001670 con 0x7fa8600ca750 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 >> v1:172.21.15.187:6789/0 conn(0x7fa8600ca750 legacy=0x7fa86006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c003a00 0x7fa84c003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa84c004850 0x7fa84c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 0x7fa84c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600caf30 con 0x7fa84c004850 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600cc740 con 0x7fa84c003a00 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c00baf0 con 0x7fa8600cc110 2023-08-10T10:31:01.570 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c003a00 0x7fa84c003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7f9504bff700 1 -- 172.21.15.88:0/984192257 shutdown_connections 2023-08-10T10:31:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa856ffd700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa84c004850 0x7fa84c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 -- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 msgr2=0x7fa84c005210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-08-10T10:31:01.571 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8600cc110 0x7fa84c005210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 -- 172.21.15.88:0/727907560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa84c004850 msgr2=0x7fa84c004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa84c004850 0x7fa84c004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7fa85f7fe700 1 -- 172.21.15.88:0/727907560 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8600cca20 con 0x7fa84c003a00 2023-08-10T10:31:01.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7f9504bff700 1 -- 172.21.15.88:0/984192257 wait complete. 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.554+0000 7f48b5fff700 1 -- start start 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7f48b5fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0070990 0x7f48b015e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.555+0000 7f48b5fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c2060 0x7f48b00b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48b5fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48b5fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b3db0 con 0x7f48b0070990 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48b5fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b1810 con 0x7f48b00c2060 2023-08-10T10:31:01.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48b5fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00b4ac0 con 0x7f48b00cae20 2023-08-10T10:31:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48affff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48affff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50304/0 (socket says 172.21.15.88:50304) 2023-08-10T10:31:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48affff700 1 -- 172.21.15.88:0/3564075769 learned_addr learned my addr 172.21.15.88:0/3564075769 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7f48af7fe700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0070990 0x7f48b015e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7fec38b9b700 1 --2- 172.21.15.88:0/3068224306 >> v2:172.21.15.88:3300/0 conn(0x7fec340cc110 0x7fec3415c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c003a00 0x7fa84c003e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa848009b30 tx=0x7fa84c005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60ac6d0c2da654e0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800e6c0 con 0x7fa84c003a00 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84800e820 con 0x7fa84c003a00 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.556+0000 7fa85effd700 1 -- 172.21.15.88:0/727907560 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800eb90 con 0x7fa84c003a00 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7f48affff700 1 -- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c2060 msgr2=0x7f48b00b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7f48affff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c2060 0x7f48b00b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7f48affff700 1 -- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0070990 msgr2=0x7f48b015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7f48affff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0070990 0x7f48b015e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7f48affff700 1 -- 172.21.15.88:0/3564075769 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009550 con 0x7f48b00cae20 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f48affff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48a000b3e0 tx=0x7f48a000b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7fec38b9b700 1 -- 172.21.15.88:0/3068224306 >> v1:172.21.15.187:6789/0 conn(0x7fec340ca750 legacy=0x7fec3406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7fec38b9b700 1 -- 172.21.15.88:0/3068224306 >> v1:172.21.15.88:6789/0 conn(0x7fec3406d380 legacy=0x7fec340cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7fec38b9b700 1 -- 172.21.15.88:0/3068224306 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec340ccd00 con 0x7fec340cc110 2023-08-10T10:31:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7fa865bff700 1 -- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c003a00 msgr2=0x7fa84c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.557+0000 7fa865bff700 1 --2- 172.21.15.88:0/727907560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c003a00 0x7fa84c003e20 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa848009b30 tx=0x7fa84c005880 comp rx=0 tx=0).stop 2023-08-10T10:31:01.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f9504bff700 1 Processor -- start 2023-08-10T10:31:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a000bea0 con 0x7f48b00cae20 2023-08-10T10:31:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a0011830 con 0x7f48b00cae20 2023-08-10T10:31:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0011be0 con 0x7f48b00cae20 2023-08-10T10:31:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00b1a60 con 0x7f48b00cae20 2023-08-10T10:31:01.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7fec38b9b700 1 --2- 172.21.15.88:0/3068224306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec3415c3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d90 tx=0x7fec2400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fd85eeb6d206214 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00b42c0 con 0x7f48b00cae20 2023-08-10T10:31:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.558+0000 7f9504bff700 1 -- start start 2023-08-10T10:31:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 0x7f95000c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9500146930 0x7f9500146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95000c3030 con 0x7f950013d010 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950013d9d0 con 0x7f95000c8760 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f9504bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95001494b0 con 0x7f9500146930 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f94fed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f94fed9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41728/0 (socket says 172.21.15.88:41728) 2023-08-10T10:31:01.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.559+0000 7f94fed9d700 1 -- 172.21.15.88:0/1972914740 learned_addr learned my addr 172.21.15.88:0/1972914740 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b004ecc0 con 0x7f48b00cae20 2023-08-10T10:31:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fe59c700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 0x7f95000c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 -- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9500146930 msgr2=0x7f9500146db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:31:01.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fe5b77fe700 1 -- 172.21.15.88:0/199943606 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8010070 con 0x7fe5b80ccea0 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fe5b77fe700 1 -- 172.21.15.88:0/199943606 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800d980 con 0x7fe5b80ccea0 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fe5b77fe700 1 -- 172.21.15.88:0/199943606 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800dd10 con 0x7fe5b80ccea0 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9500146930 0x7f9500146db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 -- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 msgr2=0x7f95000c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 0x7f95000c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 -- 172.21.15.88:0/1972914740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9500149790 con 0x7f950013d010 2023-08-10T10:31:01.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fa85ffff700 1 -- 172.21.15.88:0/727907560 reap_dead start 2023-08-10T10:31:01.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fa865bff700 1 -- 172.21.15.88:0/727907560 shutdown_connections 2023-08-10T10:31:01.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fa865bff700 1 -- 172.21.15.88:0/727907560 >> 172.21.15.88:0/727907560 conn(0x7fa8600cb5f0 msgr2=0x7fa8600cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fe59c700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 0x7f95000c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:01.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fec337fe700 1 -- 172.21.15.88:0/3068224306 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec2400e070 con 0x7fec340cc110 2023-08-10T10:31:01.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fec337fe700 1 -- 172.21.15.88:0/3068224306 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec2400bb20 con 0x7fec340cc110 2023-08-10T10:31:01.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fec337fe700 1 -- 172.21.15.88:0/3068224306 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec24012430 con 0x7fec340cc110 2023-08-10T10:31:01.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7fa865bff700 1 -- 172.21.15.88:0/727907560 shutdown_connections 2023-08-10T10:31:01.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.560+0000 7f94fed9d700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f950006ba30 tx=0x7f94f800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe5840c6710 con 0x7fe5840c2060 2023-08-10T10:31:01.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7fa865bff700 1 -- 172.21.15.88:0/727907560 wait complete. 2023-08-10T10:31:01.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7fec3adff700 1 -- 172.21.15.88:0/3068224306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 msgr2=0x7fec3415c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7fec3adff700 1 --2- 172.21.15.88:0/3068224306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec3415c3c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fec24009d90 tx=0x7fec2400b330 comp rx=0 tx=0).stop 2023-08-10T10:31:01.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8007480 con 0x7f950013d010 2023-08-10T10:31:01.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f80075e0 con 0x7f950013d010 2023-08-10T10:31:01.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8007990 con 0x7f950013d010 2023-08-10T10:31:01.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fec3adff700 1 -- 172.21.15.88:0/3068224306 shutdown_connections 2023-08-10T10:31:01.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fec3adff700 1 --2- 172.21.15.88:0/3068224306 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec3415c3c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fec3adff700 1 -- 172.21.15.88:0/3068224306 >> 172.21.15.88:0/3068224306 conn(0x7fec340cb5f0 msgr2=0x7fec340cba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/199943606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 msgr2=0x7fe5b80cd320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/199943606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe5a80088f0 tx=0x7fe5a800d330 comp rx=0 tx=0).stop 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/199943606 shutdown_connections 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/199943606 >> v2:172.21.15.88:3300/0 conn(0x7fe5b8070990 0x7fe5b8070e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/199943606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80cd320 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.562+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/199943606 >> 172.21.15.88:0/199943606 conn(0x7fe5b80ced50 msgr2=0x7fe5b80cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9500149a70 con 0x7f950013d010 2023-08-10T10:31:01.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.561+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95001490d0 con 0x7f950013d010 2023-08-10T10:31:01.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.563+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95000c3480 con 0x7f950013d010 2023-08-10T10:31:01.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.563+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f48a0011d40 con 0x7f48b00cae20 2023-08-10T10:31:01.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7f4897fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 0x7f489c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f48a0089cf0 con 0x7f48b00cae20 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7f48af7fe700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 0x7f489c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.564+0000 7fa865bff700 1 Processor -- start 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.564+0000 7fa865bff700 1 -- start start 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 0x7fa86014ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8601504e0 0x7fa8600c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c8fb0 con 0x7fa860141e10 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8600c5c40 con 0x7fa8600c8b30 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa865bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601509f0 con 0x7fa8601504e0 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.565+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:39492/0 (socket says 172.21.15.88:39492) 2023-08-10T10:31:01.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fa85ffff700 1 -- 172.21.15.88:0/2437790187 learned_addr learned my addr 172.21.15.88:0/2437790187 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fa856ffd700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8601504e0 0x7fa8600c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/199943606 shutdown_connections 2023-08-10T10:31:01.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fec3adff700 1 -- 172.21.15.88:0/3068224306 shutdown_connections 2023-08-10T10:31:01.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f94f801b3b0 con 0x7f950013d010 2023-08-10T10:31:01.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f48a0054a90 con 0x7f48b00cae20 2023-08-10T10:31:01.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.566+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 0x7fa86014ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7fa85f7fe700 1 -- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8601504e0 msgr2=0x7fa8600c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8601504e0 0x7fa8600c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7fa85f7fe700 1 -- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 msgr2=0x7fa8601f1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7fa85f7fe700 1 -- 172.21.15.88:0/2437790187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa860150cd0 con 0x7fa860141e10 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.568+0000 7fa85f7fe700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 0x7fa86014ffa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa848019000 tx=0x7fa8480047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.567+0000 7f94eeffd700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 0x7f94e006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.568+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f94f8089200 con 0x7f950013d010 2023-08-10T10:31:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.568+0000 7f94fe59c700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 0x7f94e006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.569+0000 7f48af7fe700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 0x7f489c06d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48a800a400 tx=0x7f48a800d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.569+0000 7f94fe59c700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 0x7f94e006d1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94f00048d0 tx=0x7f94f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.570+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/199943606 wait complete. 2023-08-10T10:31:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.573+0000 7fe5bf1ff700 1 Processor -- start 2023-08-10T10:31:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.573+0000 7fe5bf1ff700 1 -- start start 2023-08-10T10:31:01.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5b8070990 0x7fe5b80b3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8088cc0 con 0x7fe5b8158f80 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8088fa0 con 0x7fe5b8070990 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.575+0000 7fe5bf1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b8089280 con 0x7fe5b80ccea0 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fe5bd79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fe5bd79c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41746/0 (socket says 172.21.15.88:41746) 2023-08-10T10:31:01.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fe5bd79c700 1 -- 172.21.15.88:0/545444255 learned_addr learned my addr 172.21.15.88:0/545444255 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fa85ffff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:31:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f95000c3480 con 0x7f950013d010 2023-08-10T10:31:01.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa848021070 con 0x7fa860141e10 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa848004370 con 0x7fa860141e10 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84800e6c0 con 0x7fa860141e10 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860150fb0 con 0x7fa860141e10 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 -- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 msgr2=0x7fe5b80c5ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80c5ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 -- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5b8070990 msgr2=0x7fe5b80b3ef0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5b8070990 0x7fe5b80b3ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.574+0000 7fec3adff700 1 -- 172.21.15.88:0/3068224306 wait complete. 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fec3adff700 1 Processor -- start 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.576+0000 7fec3adff700 1 -- start start 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 0x7fec34142c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec340ca750 0x7fec3415ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec340c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec340c5c40 con 0x7fec340cc110 2023-08-10T10:31:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec34143570 con 0x7fec340ca750 2023-08-10T10:31:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fec3adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec34143850 con 0x7fec3406d380 2023-08-10T10:31:01.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 -- 172.21.15.88:0/545444255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a80085d0 con 0x7fe5b8158f80 2023-08-10T10:31:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fe5bd79c700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b970 tx=0x7fe5b000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fec3939c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec340c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fec3939c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec340c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:41754/0 (socket says 172.21.15.88:41754) 2023-08-10T10:31:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fec3939c700 1 -- 172.21.15.88:0/2602915690 learned_addr learned my addr 172.21.15.88:0/2602915690 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:01.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.579+0000 7fec38b9b700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 0x7fec34142c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.582+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b0010dc0 con 0x7fe5b8158f80 2023-08-10T10:31:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.582+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5b0018440 con 0x7fe5b8158f80 2023-08-10T10:31:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.582+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b00187f0 con 0x7fe5b8158f80 2023-08-10T10:31:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.582+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b8089560 con 0x7fe5b8158f80 2023-08-10T10:31:01.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.582+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b80b4610 con 0x7fe5b8158f80 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 -- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec340ca750 msgr2=0x7fec3415ae20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec340ca750 0x7fec3415ae20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 -- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 msgr2=0x7fec340c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec340c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 -- 172.21.15.88:0/2602915690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24009a70 con 0x7fec3406d380 2023-08-10T10:31:01.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fec38b9b700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 0x7fec34142c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec24016000 tx=0x7fec24004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.577+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa86014f200 con 0x7fa860141e10 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.578+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600c8f10 con 0x7fa860141e10 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.580+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa848025070 con 0x7fa860141e10 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.581+0000 7fa85cff9700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 0x7fa84006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.583+0000 7fa856ffd700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 0x7fa84006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.584+0000 7fa856ffd700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 0x7fa84006d1f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa86015b480 tx=0x7fa850007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.586+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5980052f0 con 0x7fe5b8158f80 2023-08-10T10:31:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.586+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa84805cff0 con 0x7fa860141e10 2023-08-10T10:31:01.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.587+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240098f0 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.587+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec24012640 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.587+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec240129f0 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.590+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec34143b30 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.590+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec341431b0 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.591+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3404ecc0 con 0x7fec3406d380 2023-08-10T10:31:01.607 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.598+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe5b0022440 con 0x7fe5b8158f80 2023-08-10T10:31:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.600+0000 7fe5b57fa700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 0x7fe5a406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.600+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fe5b008df10 con 0x7fe5b8158f80 2023-08-10T10:31:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.594+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fec24012b50 con 0x7fec3406d380 2023-08-10T10:31:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.595+0000 7fec317fa700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 0x7fec2006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:01.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.595+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fec2408bbb0 con 0x7fec3406d380 2023-08-10T10:31:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.599+0000 7fec33fff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 0x7fec2006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.595+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa84808f060 con 0x7fa860141e10 2023-08-10T10:31:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.600+0000 7fe5bcf9b700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 0x7fe5a406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:01.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.602+0000 7fe5bcf9b700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 0x7fe5a406d270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac001740 tx=0x7fe5ac007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.602+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fec24056b00 con 0x7fec3406d380 2023-08-10T10:31:01.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.602+0000 7fec33fff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 0x7fec2006d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec28007fd0 tx=0x7fec28007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:01.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.603+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe5b0058d40 con 0x7fe5b8158f80 2023-08-10T10:31:01.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.937+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f9a3c0055a0 con 0x7f9a5406b650 2023-08-10T10:31:01.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.938+0000 7f9a4a7fc700 1 -- 172.21.15.88:0/3853961691 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9a44057ed0 con 0x7f9a5406b650 2023-08-10T10:31:01.942 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:01.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.942+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 msgr2=0x7f9a3806d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.942+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 0x7f9a3806d240 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a541e55c0 tx=0x7f9a4c012000 comp rx=0 tx=0).stop 2023-08-10T10:31:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.942+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 msgr2=0x7f9a541f5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.942+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a4400d800 tx=0x7f9a4400db10 comp rx=0 tx=0).stop 2023-08-10T10:31:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 shutdown_connections 2023-08-10T10:31:01.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a3806ad80 0x7f9a3806d240 secure :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9a541e55c0 tx=0x7f9a4c012000 comp rx=0 tx=0).stop 2023-08-10T10:31:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a5415c630 0x7f9a540c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a5406b650 0x7f9a541f5b20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 --2- 172.21.15.88:0/3853961691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a540ca750 0x7f9a540c6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.943+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 >> 172.21.15.88:0/3853961691 conn(0x7f9a540cb5f0 msgr2=0x7f9a540b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.944+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 shutdown_connections 2023-08-10T10:31:01.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.944+0000 7f9a5bfff700 1 -- 172.21.15.88:0/3853961691 wait complete. 2023-08-10T10:31:01.977 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-08-10T10:31:01.977 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:01.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.991+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fe5840c6710 con 0x7fe5840c2060 2023-08-10T10:31:01.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.991+0000 7fe5817fa700 1 -- 172.21.15.88:0/115650933 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5840c6710 con 0x7fe5840c2060 2023-08-10T10:31:01.993 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.994+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 msgr2=0x7fe57006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.994+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 0x7fe57006d270 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe574009c40 tx=0x7fe574008030 comp rx=0 tx=0).stop 2023-08-10T10:31:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.994+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 msgr2=0x7fe58406a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.994+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 0x7fe58406a930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00bdf0 tx=0x7fe57c009f70 comp rx=0 tx=0).stop 2023-08-10T10:31:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 shutdown_connections 2023-08-10T10:31:01.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cae20 0x7fe58406ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe57006adb0 0x7fe57006d270 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe574009c40 tx=0x7fe574008030 comp rx=0 tx=0).stop 2023-08-10T10:31:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840710a0 0x7fe5840c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 --2- 172.21.15.88:0/115650933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5840c2060 0x7fe58406a930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 >> 172.21.15.88:0/115650933 conn(0x7fe5840ced50 msgr2=0x7fe5840cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:01.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3c8804ecc0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.995+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 shutdown_connections 2023-08-10T10:31:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.996+0000 7fe58afff700 1 -- 172.21.15.88:0/115650933 wait complete. 2023-08-10T10:31:01.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.996+0000 7f3c84ff9700 1 -- 172.21.15.88:0/2951716605 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3c7c057af0 con 0x7f3c880cd3c0 2023-08-10T10:31:01.999 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:31:02.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.999+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 msgr2=0x7f3c7406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.999+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 0x7f3c7406d270 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3c880c4580 tx=0x7f3c78009040 comp rx=0 tx=0).stop 2023-08-10T10:31:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.999+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 msgr2=0x7f3c88166b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:01.999+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3c7c00ba30 tx=0x7f3c7c00bdf0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 shutdown_connections 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3c7406adb0 0x7f3c7406d270 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c8816a2b0 0x7f3c88088600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c88089170 0x7f3c88203ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 --2- 172.21.15.88:0/2951716605 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3c880cd3c0 0x7f3c88166b40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 >> 172.21.15.88:0/2951716605 conn(0x7f3c880cb5f0 msgr2=0x7f3c8806cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.000+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 shutdown_connections 2023-08-10T10:31:02.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.002+0000 7f3c8e3ff700 1 -- 172.21.15.88:0/2951716605 wait complete. 2023-08-10T10:31:02.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.013+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f95000c3480 con 0x7f950013d010 2023-08-10T10:31:02.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.013+0000 7f94eeffd700 1 -- 172.21.15.88:0/1972914740 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f95000c3480 con 0x7f950013d010 2023-08-10T10:31:02.016 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:31:02.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.016+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f48b0071b60 con 0x7f48b00cae20 2023-08-10T10:31:02.018 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-08-10T10:31:02.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.017+0000 7f4897fff700 1 -- 172.21.15.88:0/3564075769 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f48a00580b0 con 0x7f48b00cae20 2023-08-10T10:31:02.019 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:02.019 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.017+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 msgr2=0x7f94e006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.017+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 0x7f94e006d1f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f94f00048d0 tx=0x7f94f0009040 comp rx=0 tx=0).stop 2023-08-10T10:31:02.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.017+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 msgr2=0x7f950013d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.017+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f950006ba30 tx=0x7f94f800cbd0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 shutdown_connections 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950013d010 0x7f950013d490 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95000c8760 0x7f95000c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f94e006ad30 0x7f94e006d1f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 --2- 172.21.15.88:0/1972914740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9500146930 0x7f9500146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 >> 172.21.15.88:0/1972914740 conn(0x7f95000cb5f0 msgr2=0x7f950014ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 shutdown_connections 2023-08-10T10:31:02.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.018+0000 7f9504bff700 1 -- 172.21.15.88:0/1972914740 wait complete. 2023-08-10T10:31:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 msgr2=0x7f489c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 0x7f489c06d270 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48a800a400 tx=0x7f48a800d040 comp rx=0 tx=0).stop 2023-08-10T10:31:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 msgr2=0x7f48b00b3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f48a000b3e0 tx=0x7f48a000b6f0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 shutdown_connections 2023-08-10T10:31:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f489c06adb0 0x7f489c06d270 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b00cae20 0x7f48b00b3870 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f48b0070990 0x7f48b015e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 --2- 172.21.15.88:0/3564075769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c2060 0x7f48b00b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 >> 172.21.15.88:0/3564075769 conn(0x7f48b00ced50 msgr2=0x7f48b00cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 shutdown_connections 2023-08-10T10:31:02.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.021+0000 7f48b5fff700 1 -- 172.21.15.88:0/3564075769 wait complete. 2023-08-10T10:31:02.032 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-08-10T10:31:02.032 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.036+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe598005870 con 0x7fe5b8158f80 2023-08-10T10:31:02.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.037+0000 7fe5b57fa700 1 -- 172.21.15.88:0/545444255 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5b001d020 con 0x7fe5b8158f80 2023-08-10T10:31:02.038 INFO:teuthology.orchestra.run.smithi088.stdout:55834574859 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 msgr2=0x7fe5a406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 0x7fe5a406d270 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac001740 tx=0x7fe5ac007a40 comp rx=0 tx=0).stop 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 msgr2=0x7fe5b8153720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5b000b970 tx=0x7fe5b000bd30 comp rx=0 tx=0).stop 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 shutdown_connections 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5b8158f80 0x7fe5b8153720 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5b8070990 0x7fe5b80b3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe5a406adb0 0x7fe5a406d270 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 --2- 172.21.15.88:0/545444255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5b80ccea0 0x7fe5b80c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.039+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 >> 172.21.15.88:0/545444255 conn(0x7fe5b80ced50 msgr2=0x7fe5b80b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.040+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 shutdown_connections 2023-08-10T10:31:02.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.040+0000 7fe5bf1ff700 1 -- 172.21.15.88:0/545444255 wait complete. 2023-08-10T10:31:02.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.043+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa86004ecc0 con 0x7fa860141e10 2023-08-10T10:31:02.045 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.044+0000 7fa85cff9700 1 -- 172.21.15.88:0/2437790187 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa84802c090 con 0x7fa860141e10 2023-08-10T10:31:02.046 INFO:teuthology.orchestra.run.smithi088.stdout:55834574857 2023-08-10T10:31:02.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 msgr2=0x7fa84006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 0x7fa84006d1f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa86015b480 tx=0x7fa850007040 comp rx=0 tx=0).stop 2023-08-10T10:31:02.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 msgr2=0x7fa86014ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 0x7fa86014ffa0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa848019000 tx=0x7fa8480047c0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 shutdown_connections 2023-08-10T10:31:02.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8600c8b30 0x7fa8601f1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa860141e10 0x7fa86014ffa0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa84006ad30 0x7fa84006d1f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 --2- 172.21.15.88:0/2437790187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8601504e0 0x7fa8600c85f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 >> 172.21.15.88:0/2437790187 conn(0x7fa8600cb5f0 msgr2=0x7fa86015a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 shutdown_connections 2023-08-10T10:31:02.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.047+0000 7fa865bff700 1 -- 172.21.15.88:0/2437790187 wait complete. 2023-08-10T10:31:02.051 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2023-08-10T10:31:02.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.049+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fec34143990 con 0x7fec3406d380 2023-08-10T10:31:02.051 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.050+0000 7fec317fa700 1 -- 172.21.15.88:0/2602915690 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec34143990 con 0x7fec3406d380 2023-08-10T10:31:02.052 INFO:teuthology.orchestra.run.smithi088.stdout:55834574858 2023-08-10T10:31:02.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.052+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 msgr2=0x7fec2006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.054 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.052+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 0x7fec2006d270 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fec28007fd0 tx=0x7fec28007980 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.052+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 msgr2=0x7fec34142c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.052+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 0x7fec34142c70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fec24016000 tx=0x7fec24004ad0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 shutdown_connections 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec340cc110 0x7fec340c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec2006adb0 0x7fec2006d270 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec3406d380 0x7fec34142c70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 --2- 172.21.15.88:0/2602915690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec340ca750 0x7fec3415ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 >> 172.21.15.88:0/2602915690 conn(0x7fec340cb5f0 msgr2=0x7fec3415a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 shutdown_connections 2023-08-10T10:31:02.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.053+0000 7fec3adff700 1 -- 172.21.15.88:0/2602915690 wait complete. 2023-08-10T10:31:02.056 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-08-10T10:31:02.056 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-08-10T10:31:02.063 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-08-10T10:31:02.070 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-08-10T10:31:02.074 DEBUG:teuthology.parallel:result is None 2023-08-10T10:31:02.074 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-10T10:31:02.074 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:31:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.308+0000 7f37a1bff700 1 Processor -- start 2023-08-10T10:31:02.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.308+0000 7f37a1bff700 1 -- start start 2023-08-10T10:31:02.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f37a1bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f379c15cf20 0x7f379c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f37a1bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f379c0b5210 0x7f379c0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f37a1bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379c15e590 con 0x7f379c0b8870 2023-08-10T10:31:02.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f37a1bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0cde30 con 0x7f379c15cf20 2023-08-10T10:31:02.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f37a1bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379c0b8e30 con 0x7f379c0b5210 2023-08-10T10:31:02.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f379affd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f379c0b8870 0x7f379c0b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58008/0 (socket says 172.21.15.88:58008) 2023-08-10T10:31:02.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f379affd700 1 -- 172.21.15.88:0/894146728 learned_addr learned my addr 172.21.15.88:0/894146728 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f379b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f379c15cf20 0x7f379c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.309+0000 7f379bfff700 1 --2- 172.21.15.88:0/894146728 >> v2:172.21.15.187:3300/0 conn(0x7f379c0b5210 0x7f379c0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379b7fe700 1 -- 172.21.15.88:0/894146728 >> v2:172.21.15.187:3300/0 conn(0x7f379c0b5210 msgr2=0x7f379c0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379b7fe700 1 --2- 172.21.15.88:0/894146728 >> v2:172.21.15.187:3300/0 conn(0x7f379c0b5210 0x7f379c0d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379b7fe700 1 -- 172.21.15.88:0/894146728 >> v1:172.21.15.88:6789/0 conn(0x7f379c0b8870 legacy=0x7f379c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379b7fe700 1 -- 172.21.15.88:0/894146728 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c0ce010 con 0x7f379c15cf20 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379a7fc700 1 -- 172.21.15.88:0/894146728 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976793723 0 0) 0x7f379c15e590 con 0x7f379c0b8870 2023-08-10T10:31:02.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379b7fe700 1 --2- 172.21.15.88:0/894146728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15e050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f379c0cd840 tx=0x7f378c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff8ab977db18955 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379a7fc700 1 -- 172.21.15.88:0/894146728 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c011830 con 0x7f379c15cf20 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379a7fc700 1 -- 172.21.15.88:0/894146728 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378c011990 con 0x7f379c15cf20 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.310+0000 7f379a7fc700 1 -- 172.21.15.88:0/894146728 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378c011d20 con 0x7f379c15cf20 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 -- 172.21.15.88:0/894146728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 msgr2=0x7f379c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 --2- 172.21.15.88:0/894146728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15e050 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f379c0cd840 tx=0x7f378c009b20 comp rx=0 tx=0).stop 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 -- 172.21.15.88:0/894146728 shutdown_connections 2023-08-10T10:31:02.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 --2- 172.21.15.88:0/894146728 >> v2:172.21.15.187:3300/0 conn(0x7f379c0b5210 0x7f379c0d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 --2- 172.21.15.88:0/894146728 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15e050 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 -- 172.21.15.88:0/894146728 >> 172.21.15.88:0/894146728 conn(0x7f379c0d3080 msgr2=0x7f379c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 -- 172.21.15.88:0/894146728 shutdown_connections 2023-08-10T10:31:02.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.311+0000 7f37a1bff700 1 -- 172.21.15.88:0/894146728 wait complete. 2023-08-10T10:31:02.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.313+0000 7f37a1bff700 1 Processor -- start 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.313+0000 7f37a1bff700 1 -- start start 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f379c0b5210 0x7f379c0c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f379c0b8870 0x7f379c0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c14e480 con 0x7f379c15cf20 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0cd110 con 0x7f379c0b8870 2023-08-10T10:31:02.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f37a1bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f379c0c68f0 con 0x7f379c0b5210 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50366/0 (socket says 172.21.15.88:50366) 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 -- 172.21.15.88:0/4222903777 learned_addr learned my addr 172.21.15.88:0/4222903777 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379b7fe700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f379c0b5210 0x7f379c0c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379affd700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f379c0b8870 0x7f379c0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 -- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f379c0b5210 msgr2=0x7f379c0c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f379c0b5210 0x7f379c0c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 -- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f379c0b8870 msgr2=0x7f379c0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f379c0b8870 0x7f379c0cba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.314+0000 7f379bfff700 1 -- 172.21.15.88:0/4222903777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f378c0094a0 con 0x7f379c15cf20 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f379bfff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f379400efc0 tx=0x7f379400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400ca90 con 0x7f379c15cf20 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379400f040 con 0x7f379c15cf20 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379400ce50 con 0x7f379c15cf20 2023-08-10T10:31:02.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c0cc500 con 0x7f379c15cf20 2023-08-10T10:31:02.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.315+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c0ccac0 con 0x7f379c15cf20 2023-08-10T10:31:02.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.316+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c1480f0 con 0x7f379c15cf20 2023-08-10T10:31:02.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.317+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3794014480 con 0x7f379c15cf20 2023-08-10T10:31:02.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.318+0000 7f3783fff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 0x7f378806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.319+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f379408a300 con 0x7f379c15cf20 2023-08-10T10:31:02.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.319+0000 7f379b7fe700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 0x7f378806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.319+0000 7f379b7fe700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 0x7f378806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f378c0090b0 tx=0x7f378c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.324 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.323+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f37940550b0 con 0x7f379c15cf20 2023-08-10T10:31:02.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.519+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f379c0ce5d0 con 0x7f378806ace0 2023-08-10T10:31:02.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.529+0000 7f3783fff700 1 -- 172.21.15.88:0/4222903777 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367406 (secure 0 0 0) 0x7f378c011b00 con 0x7f378806ace0 2023-08-10T10:31:02.535 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:02.537 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 msgr2=0x7f378806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 0x7f378806d1a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f378c0090b0 tx=0x7f378c01c040 comp rx=0 tx=0).stop 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 msgr2=0x7f379c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f379400efc0 tx=0x7f379400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 shutdown_connections 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f379c15cf20 0x7f379c15b590 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f378806ace0 0x7f378806d1a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.538 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f379c0b5210 0x7f379c0c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 --2- 172.21.15.88:0/4222903777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f379c0b8870 0x7f379c0cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 >> 172.21.15.88:0/4222903777 conn(0x7f379c0d3080 msgr2=0x7f379c15ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 shutdown_connections 2023-08-10T10:31:02.539 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.534+0000 7f37a1bff700 1 -- 172.21.15.88:0/4222903777 wait complete. 2023-08-10T10:31:02.539 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:31:02.553 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-08-10T10:31:01.539485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010856"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369311+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:30:39.369311+0000","last_peered":"2023-08-10T10:30:39.369311+0000","last_clean":"2023-08-10T10:30:39.369311+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:30:39.369311+0000","last_undegraded":"2023-08-10T10:30:39.369311+0000","last_fullsized":"2023-08-10T10:30:39.369311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:15:52.847844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983931+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:30:39.983931+0000","last_peered":"2023-08-10T10:30:39.983931+0000","last_clean":"2023-08-10T10:30:39.983931+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:30:39.983931+0000","last_undegraded":"2023-08-10T10:30:39.983931+0000","last_fullsized":"2023-08-10T10:30:39.983931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371111+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:30:39.371111+0000","last_peered":"2023-08-10T10:30:39.371111+0000","last_clean":"2023-08-10T10:30:39.371111+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:30:39.371111+0000","last_undegraded":"2023-08-10T10:30:39.371111+0000","last_fullsized":"2023-08-10T10:30:39.371111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:07.275147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984157+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:30:39.984157+0000","last_peered":"2023-08-10T10:30:39.984157+0000","last_clean":"2023-08-10T10:30:39.984157+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:30:39.984157+0000","last_undegraded":"2023-08-10T10:30:39.984157+0000","last_fullsized":"2023-08-10T10:30:39.984157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:45.483566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983455+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:30:39.983455+0000","last_peered":"2023-08-10T10:30:39.983455+0000","last_clean":"2023-08-10T10:30:39.983455+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:30:39.983455+0000","last_undegraded":"2023-08-10T10:30:39.983455+0000","last_fullsized":"2023-08-10T10:30:39.983455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371199+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:30:39.371199+0000","last_peered":"2023-08-10T10:30:39.371199+0000","last_clean":"2023-08-10T10:30:39.371199+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:30:39.371199+0000","last_undegraded":"2023-08-10T10:30:39.371199+0000","last_fullsized":"2023-08-10T10:30:39.371199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:29.585173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370548+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:30:39.370548+0000","last_peered":"2023-08-10T10:30:39.370548+0000","last_clean":"2023-08-10T10:30:39.370548+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:30:39.370548+0000","last_undegraded":"2023-08-10T10:30:39.370548+0000","last_fullsized":"2023-08-10T10:30:39.370548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983193+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:30:39.983193+0000","last_peered":"2023-08-10T10:30:39.983193+0000","last_clean":"2023-08-10T10:30:39.983193+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:30:39.983193+0000","last_undegraded":"2023-08-10T10:30:39.983193+0000","last_fullsized":"2023-08-10T10:30:39.983193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982871+0000","last_change":"2023-08-10T10:30:34.342831+0000","last_active":"2023-08-10T10:30:39.982871+0000","last_peered":"2023-08-10T10:30:39.982871+0000","last_clean":"2023-08-10T10:30:39.982871+0000","last_became_active":"2023-08-10T10:30:34.341582+0000","last_became_peered":"2023-08-10T10:30:34.341582+0000","last_unstale":"2023-08-10T10:30:39.982871+0000","last_undegraded":"2023-08-10T10:30:39.982871+0000","last_fullsized":"2023-08-10T10:30:39.982871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984422+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:30:39.984422+0000","last_peered":"2023-08-10T10:30:39.984422+0000","last_clean":"2023-08-10T10:30:39.984422+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:30:39.984422+0000","last_undegraded":"2023-08-10T10:30:39.984422+0000","last_fullsized":"2023-08-10T10:30:39.984422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370892+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:30:39.370892+0000","last_peered":"2023-08-10T10:30:39.370892+0000","last_clean":"2023-08-10T10:30:39.370892+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:30:39.370892+0000","last_undegraded":"2023-08-10T10:30:39.370892+0000","last_fullsized":"2023-08-10T10:30:39.370892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:25.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369176+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:30:39.369176+0000","last_peered":"2023-08-10T10:30:39.369176+0000","last_clean":"2023-08-10T10:30:39.369176+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:30:39.369176+0000","last_undegraded":"2023-08-10T10:30:39.369176+0000","last_fullsized":"2023-08-10T10:30:39.369176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:21.255854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369378+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:30:39.369378+0000","last_peered":"2023-08-10T10:30:39.369378+0000","last_clean":"2023-08-10T10:30:39.369378+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:30:39.369378+0000","last_undegraded":"2023-08-10T10:30:39.369378+0000","last_fullsized":"2023-08-10T10:30:39.369378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:14.864006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983136+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:30:39.983136+0000","last_peered":"2023-08-10T10:30:39.983136+0000","last_clean":"2023-08-10T10:30:39.983136+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:30:39.983136+0000","last_undegraded":"2023-08-10T10:30:39.983136+0000","last_fullsized":"2023-08-10T10:30:39.983136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369966+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:30:39.369966+0000","last_peered":"2023-08-10T10:30:39.369966+0000","last_clean":"2023-08-10T10:30:39.369966+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:30:39.369966+0000","last_undegraded":"2023-08-10T10:30:39.369966+0000","last_fullsized":"2023-08-10T10:30:39.369966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370894+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:30:39.370894+0000","last_peered":"2023-08-10T10:30:39.370894+0000","last_clean":"2023-08-10T10:30:39.370894+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:30:39.370894+0000","last_undegraded":"2023-08-10T10:30:39.370894+0000","last_fullsized":"2023-08-10T10:30:39.370894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982953+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:30:39.982953+0000","last_peered":"2023-08-10T10:30:39.982953+0000","last_clean":"2023-08-10T10:30:39.982953+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:30:39.982953+0000","last_undegraded":"2023-08-10T10:30:39.982953+0000","last_fullsized":"2023-08-10T10:30:39.982953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370539+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:30:39.370539+0000","last_peered":"2023-08-10T10:30:39.370539+0000","last_clean":"2023-08-10T10:30:39.370539+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:30:39.370539+0000","last_undegraded":"2023-08-10T10:30:39.370539+0000","last_fullsized":"2023-08-10T10:30:39.370539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:56.660087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369083+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:30:39.369083+0000","last_peered":"2023-08-10T10:30:39.369083+0000","last_clean":"2023-08-10T10:30:39.369083+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:30:39.369083+0000","last_undegraded":"2023-08-10T10:30:39.369083+0000","last_fullsized":"2023-08-10T10:30:39.369083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:22.279579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371337+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:30:39.371337+0000","last_peered":"2023-08-10T10:30:39.371337+0000","last_clean":"2023-08-10T10:30:39.371337+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:30:39.371337+0000","last_undegraded":"2023-08-10T10:30:39.371337+0000","last_fullsized":"2023-08-10T10:30:39.371337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370272+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:30:39.370272+0000","last_peered":"2023-08-10T10:30:39.370272+0000","last_clean":"2023-08-10T10:30:39.370272+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:30:39.370272+0000","last_undegraded":"2023-08-10T10:30:39.370272+0000","last_fullsized":"2023-08-10T10:30:39.370272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982720+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:30:39.982720+0000","last_peered":"2023-08-10T10:30:39.982720+0000","last_clean":"2023-08-10T10:30:39.982720+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:30:39.982720+0000","last_undegraded":"2023-08-10T10:30:39.982720+0000","last_fullsized":"2023-08-10T10:30:39.982720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983043+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:30:39.983043+0000","last_peered":"2023-08-10T10:30:39.983043+0000","last_clean":"2023-08-10T10:30:39.983043+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:30:39.983043+0000","last_undegraded":"2023-08-10T10:30:39.983043+0000","last_fullsized":"2023-08-10T10:30:39.983043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370537+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:30:39.370537+0000","last_peered":"2023-08-10T10:30:39.370537+0000","last_clean":"2023-08-10T10:30:39.370537+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:30:39.370537+0000","last_undegraded":"2023-08-10T10:30:39.370537+0000","last_fullsized":"2023-08-10T10:30:39.370537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872983+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:30:39.872983+0000","last_peered":"2023-08-10T10:30:39.872983+0000","last_clean":"2023-08-10T10:30:39.872983+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:30:39.872983+0000","last_undegraded":"2023-08-10T10:30:39.872983+0000","last_fullsized":"2023-08-10T10:30:39.872983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873160+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:30:39.873160+0000","last_peered":"2023-08-10T10:30:39.873160+0000","last_clean":"2023-08-10T10:30:39.873160+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:30:39.873160+0000","last_undegraded":"2023-08-10T10:30:39.873160+0000","last_fullsized":"2023-08-10T10:30:39.873160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984432+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:30:39.984432+0000","last_peered":"2023-08-10T10:30:39.984432+0000","last_clean":"2023-08-10T10:30:39.984432+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:30:39.984432+0000","last_undegraded":"2023-08-10T10:30:39.984432+0000","last_fullsized":"2023-08-10T10:30:39.984432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371835+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:30:39.371835+0000","last_peered":"2023-08-10T10:30:39.371835+0000","last_clean":"2023-08-10T10:30:39.371835+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:30:39.371835+0000","last_undegraded":"2023-08-10T10:30:39.371835+0000","last_fullsized":"2023-08-10T10:30:39.371835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:03.982064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370925+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:30:39.370925+0000","last_peered":"2023-08-10T10:30:39.370925+0000","last_clean":"2023-08-10T10:30:39.370925+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:30:39.370925+0000","last_undegraded":"2023-08-10T10:30:39.370925+0000","last_fullsized":"2023-08-10T10:30:39.370925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:32.438438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983791+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:30:39.983791+0000","last_peered":"2023-08-10T10:30:39.983791+0000","last_clean":"2023-08-10T10:30:39.983791+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:30:39.983791+0000","last_undegraded":"2023-08-10T10:30:39.983791+0000","last_fullsized":"2023-08-10T10:30:39.983791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983622+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:30:39.983622+0000","last_peered":"2023-08-10T10:30:39.983622+0000","last_clean":"2023-08-10T10:30:39.983622+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:30:39.983622+0000","last_undegraded":"2023-08-10T10:30:39.983622+0000","last_fullsized":"2023-08-10T10:30:39.983622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:07.717850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872457+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:30:39.872457+0000","last_peered":"2023-08-10T10:30:39.872457+0000","last_clean":"2023-08-10T10:30:39.872457+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:30:39.872457+0000","last_undegraded":"2023-08-10T10:30:39.872457+0000","last_fullsized":"2023-08-10T10:30:39.872457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:40.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983295+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:30:39.983295+0000","last_peered":"2023-08-10T10:30:39.983295+0000","last_clean":"2023-08-10T10:30:39.983295+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:30:39.983295+0000","last_undegraded":"2023-08-10T10:30:39.983295+0000","last_fullsized":"2023-08-10T10:30:39.983295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983451+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:30:39.983451+0000","last_peered":"2023-08-10T10:30:39.983451+0000","last_clean":"2023-08-10T10:30:39.983451+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:30:39.983451+0000","last_undegraded":"2023-08-10T10:30:39.983451+0000","last_fullsized":"2023-08-10T10:30:39.983451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:25.693202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983147+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:30:39.983147+0000","last_peered":"2023-08-10T10:30:39.983147+0000","last_clean":"2023-08-10T10:30:39.983147+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:30:39.983147+0000","last_undegraded":"2023-08-10T10:30:39.983147+0000","last_fullsized":"2023-08-10T10:30:39.983147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983947+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:30:39.983947+0000","last_peered":"2023-08-10T10:30:39.983947+0000","last_clean":"2023-08-10T10:30:39.983947+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:30:39.983947+0000","last_undegraded":"2023-08-10T10:30:39.983947+0000","last_fullsized":"2023-08-10T10:30:39.983947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:18.306807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983456+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:30:39.983456+0000","last_peered":"2023-08-10T10:30:39.983456+0000","last_clean":"2023-08-10T10:30:39.983456+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:30:39.983456+0000","last_undegraded":"2023-08-10T10:30:39.983456+0000","last_fullsized":"2023-08-10T10:30:39.983456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:22.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983003+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:30:39.983003+0000","last_peered":"2023-08-10T10:30:39.983003+0000","last_clean":"2023-08-10T10:30:39.983003+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:30:39.983003+0000","last_undegraded":"2023-08-10T10:30:39.983003+0000","last_fullsized":"2023-08-10T10:30:39.983003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983092+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:30:39.983092+0000","last_peered":"2023-08-10T10:30:39.983092+0000","last_clean":"2023-08-10T10:30:39.983092+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:30:39.983092+0000","last_undegraded":"2023-08-10T10:30:39.983092+0000","last_fullsized":"2023-08-10T10:30:39.983092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369849+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:30:39.369849+0000","last_peered":"2023-08-10T10:30:39.369849+0000","last_clean":"2023-08-10T10:30:39.369849+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:30:39.369849+0000","last_undegraded":"2023-08-10T10:30:39.369849+0000","last_fullsized":"2023-08-10T10:30:39.369849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984181+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:30:39.984181+0000","last_peered":"2023-08-10T10:30:39.984181+0000","last_clean":"2023-08-10T10:30:39.984181+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:30:39.984181+0000","last_undegraded":"2023-08-10T10:30:39.984181+0000","last_fullsized":"2023-08-10T10:30:39.984181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983153+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:30:39.983153+0000","last_peered":"2023-08-10T10:30:39.983153+0000","last_clean":"2023-08-10T10:30:39.983153+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:30:39.983153+0000","last_undegraded":"2023-08-10T10:30:39.983153+0000","last_fullsized":"2023-08-10T10:30:39.983153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984063+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:30:39.984063+0000","last_peered":"2023-08-10T10:30:39.984063+0000","last_clean":"2023-08-10T10:30:39.984063+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:30:39.984063+0000","last_undegraded":"2023-08-10T10:30:39.984063+0000","last_fullsized":"2023-08-10T10:30:39.984063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371870+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:30:39.371870+0000","last_peered":"2023-08-10T10:30:39.371870+0000","last_clean":"2023-08-10T10:30:39.371870+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:30:39.371870+0000","last_undegraded":"2023-08-10T10:30:39.371870+0000","last_fullsized":"2023-08-10T10:30:39.371870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:45.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872782+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:30:39.872782+0000","last_peered":"2023-08-10T10:30:39.872782+0000","last_clean":"2023-08-10T10:30:39.872782+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:30:39.872782+0000","last_undegraded":"2023-08-10T10:30:39.872782+0000","last_fullsized":"2023-08-10T10:30:39.872782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872553+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:30:39.872553+0000","last_peered":"2023-08-10T10:30:39.872553+0000","last_clean":"2023-08-10T10:30:39.872553+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:30:39.872553+0000","last_undegraded":"2023-08-10T10:30:39.872553+0000","last_fullsized":"2023-08-10T10:30:39.872553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:24.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:52.633741+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:30:52.633741+0000","last_peered":"2023-08-10T10:30:52.633741+0000","last_clean":"2023-08-10T10:30:52.633741+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:30:52.633741+0000","last_undegraded":"2023-08-10T10:30:52.633741+0000","last_fullsized":"2023-08-10T10:30:52.633741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:37.081141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371788+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:30:39.371788+0000","last_peered":"2023-08-10T10:30:39.371788+0000","last_clean":"2023-08-10T10:30:39.371788+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:30:39.371788+0000","last_undegraded":"2023-08-10T10:30:39.371788+0000","last_fullsized":"2023-08-10T10:30:39.371788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:24.614492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984518+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:30:39.984518+0000","last_peered":"2023-08-10T10:30:39.984518+0000","last_clean":"2023-08-10T10:30:39.984518+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:30:39.984518+0000","last_undegraded":"2023-08-10T10:30:39.984518+0000","last_fullsized":"2023-08-10T10:30:39.984518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370136+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:30:39.370136+0000","last_peered":"2023-08-10T10:30:39.370136+0000","last_clean":"2023-08-10T10:30:39.370136+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:30:39.370136+0000","last_undegraded":"2023-08-10T10:30:39.370136+0000","last_fullsized":"2023-08-10T10:30:39.370136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984177+0000","last_change":"2023-08-10T10:30:34.333045+0000","last_active":"2023-08-10T10:30:39.984177+0000","last_peered":"2023-08-10T10:30:39.984177+0000","last_clean":"2023-08-10T10:30:39.984177+0000","last_became_active":"2023-08-10T10:30:34.332756+0000","last_became_peered":"2023-08-10T10:30:34.332756+0000","last_unstale":"2023-08-10T10:30:39.984177+0000","last_undegraded":"2023-08-10T10:30:39.984177+0000","last_fullsized":"2023-08-10T10:30:39.984177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:28.964743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984070+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:30:39.984070+0000","last_peered":"2023-08-10T10:30:39.984070+0000","last_clean":"2023-08-10T10:30:39.984070+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:30:39.984070+0000","last_undegraded":"2023-08-10T10:30:39.984070+0000","last_fullsized":"2023-08-10T10:30:39.984070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982553+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:30:39.982553+0000","last_peered":"2023-08-10T10:30:39.982553+0000","last_clean":"2023-08-10T10:30:39.982553+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:30:39.982553+0000","last_undegraded":"2023-08-10T10:30:39.982553+0000","last_fullsized":"2023-08-10T10:30:39.982553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:12.238493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984332+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:30:39.984332+0000","last_peered":"2023-08-10T10:30:39.984332+0000","last_clean":"2023-08-10T10:30:39.984332+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:30:39.984332+0000","last_undegraded":"2023-08-10T10:30:39.984332+0000","last_fullsized":"2023-08-10T10:30:39.984332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:30:39.983925+0000","last_peered":"2023-08-10T10:30:39.983925+0000","last_clean":"2023-08-10T10:30:39.983925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:30:39.983925+0000","last_undegraded":"2023-08-10T10:30:39.983925+0000","last_fullsized":"2023-08-10T10:30:39.983925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370418+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:30:39.370418+0000","last_peered":"2023-08-10T10:30:39.370418+0000","last_clean":"2023-08-10T10:30:39.370418+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.370418+0000","last_undegraded":"2023-08-10T10:30:39.370418+0000","last_fullsized":"2023-08-10T10:30:39.370418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983299+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:30:39.983299+0000","last_peered":"2023-08-10T10:30:39.983299+0000","last_clean":"2023-08-10T10:30:39.983299+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:30:39.983299+0000","last_undegraded":"2023-08-10T10:30:39.983299+0000","last_fullsized":"2023-08-10T10:30:39.983299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:25.632086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983777+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:30:39.983777+0000","last_peered":"2023-08-10T10:30:39.983777+0000","last_clean":"2023-08-10T10:30:39.983777+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:30:39.983777+0000","last_undegraded":"2023-08-10T10:30:39.983777+0000","last_fullsized":"2023-08-10T10:30:39.983777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983006+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:30:39.983006+0000","last_peered":"2023-08-10T10:30:39.983006+0000","last_clean":"2023-08-10T10:30:39.983006+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:30:39.983006+0000","last_undegraded":"2023-08-10T10:30:39.983006+0000","last_fullsized":"2023-08-10T10:30:39.983006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:25.545777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984046+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:30:39.984046+0000","last_peered":"2023-08-10T10:30:39.984046+0000","last_clean":"2023-08-10T10:30:39.984046+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:30:39.984046+0000","last_undegraded":"2023-08-10T10:30:39.984046+0000","last_fullsized":"2023-08-10T10:30:39.984046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:12.376679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371191+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:30:39.371191+0000","last_peered":"2023-08-10T10:30:39.371191+0000","last_clean":"2023-08-10T10:30:39.371191+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:30:39.371191+0000","last_undegraded":"2023-08-10T10:30:39.371191+0000","last_fullsized":"2023-08-10T10:30:39.371191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:53.760062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371171+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:30:39.371171+0000","last_peered":"2023-08-10T10:30:39.371171+0000","last_clean":"2023-08-10T10:30:39.371171+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.371171+0000","last_undegraded":"2023-08-10T10:30:39.371171+0000","last_fullsized":"2023-08-10T10:30:39.371171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:34.188865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983055+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:30:39.983055+0000","last_peered":"2023-08-10T10:30:39.983055+0000","last_clean":"2023-08-10T10:30:39.983055+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:30:39.983055+0000","last_undegraded":"2023-08-10T10:30:39.983055+0000","last_fullsized":"2023-08-10T10:30:39.983055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:13.245170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368831+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:30:39.368831+0000","last_peered":"2023-08-10T10:30:39.368831+0000","last_clean":"2023-08-10T10:30:39.368831+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:30:39.368831+0000","last_undegraded":"2023-08-10T10:30:39.368831+0000","last_fullsized":"2023-08-10T10:30:39.368831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:29.757505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370481+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:30:39.370481+0000","last_peered":"2023-08-10T10:30:39.370481+0000","last_clean":"2023-08-10T10:30:39.370481+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:30:39.370481+0000","last_undegraded":"2023-08-10T10:30:39.370481+0000","last_fullsized":"2023-08-10T10:30:39.370481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371233+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:30:39.371233+0000","last_peered":"2023-08-10T10:30:39.371233+0000","last_clean":"2023-08-10T10:30:39.371233+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:30:39.371233+0000","last_undegraded":"2023-08-10T10:30:39.371233+0000","last_fullsized":"2023-08-10T10:30:39.371233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:49.770265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369037+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:30:39.369037+0000","last_peered":"2023-08-10T10:30:39.369037+0000","last_clean":"2023-08-10T10:30:39.369037+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:30:39.369037+0000","last_undegraded":"2023-08-10T10:30:39.369037+0000","last_fullsized":"2023-08-10T10:30:39.369037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:31.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371929+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:30:39.371929+0000","last_peered":"2023-08-10T10:30:39.371929+0000","last_clean":"2023-08-10T10:30:39.371929+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:30:39.371929+0000","last_undegraded":"2023-08-10T10:30:39.371929+0000","last_fullsized":"2023-08-10T10:30:39.371929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:07.689076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983438+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:30:39.983438+0000","last_peered":"2023-08-10T10:30:39.983438+0000","last_clean":"2023-08-10T10:30:39.983438+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:30:39.983438+0000","last_undegraded":"2023-08-10T10:30:39.983438+0000","last_fullsized":"2023-08-10T10:30:39.983438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:28:12.535150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369073+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:30:39.369073+0000","last_peered":"2023-08-10T10:30:39.369073+0000","last_clean":"2023-08-10T10:30:39.369073+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:30:39.369073+0000","last_undegraded":"2023-08-10T10:30:39.369073+0000","last_fullsized":"2023-08-10T10:30:39.369073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:39.562819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983698+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:30:39.983698+0000","last_peered":"2023-08-10T10:30:39.983698+0000","last_clean":"2023-08-10T10:30:39.983698+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:30:39.983698+0000","last_undegraded":"2023-08-10T10:30:39.983698+0000","last_fullsized":"2023-08-10T10:30:39.983698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983097+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:30:39.983097+0000","last_peered":"2023-08-10T10:30:39.983097+0000","last_clean":"2023-08-10T10:30:39.983097+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:30:39.983097+0000","last_undegraded":"2023-08-10T10:30:39.983097+0000","last_fullsized":"2023-08-10T10:30:39.983097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369182+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:30:39.369182+0000","last_peered":"2023-08-10T10:30:39.369182+0000","last_clean":"2023-08-10T10:30:39.369182+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:30:39.369182+0000","last_undegraded":"2023-08-10T10:30:39.369182+0000","last_fullsized":"2023-08-10T10:30:39.369182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:12.307358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983784+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:30:39.983784+0000","last_peered":"2023-08-10T10:30:39.983784+0000","last_clean":"2023-08-10T10:30:39.983784+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:30:39.983784+0000","last_undegraded":"2023-08-10T10:30:39.983784+0000","last_fullsized":"2023-08-10T10:30:39.983784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:20.631743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371024+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:30:39.371024+0000","last_peered":"2023-08-10T10:30:39.371024+0000","last_clean":"2023-08-10T10:30:39.371024+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:30:39.371024+0000","last_undegraded":"2023-08-10T10:30:39.371024+0000","last_fullsized":"2023-08-10T10:30:39.371024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:42.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872669+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:30:39.872669+0000","last_peered":"2023-08-10T10:30:39.872669+0000","last_clean":"2023-08-10T10:30:39.872669+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:30:39.872669+0000","last_undegraded":"2023-08-10T10:30:39.872669+0000","last_fullsized":"2023-08-10T10:30:39.872669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:17.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983630+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:30:39.983630+0000","last_peered":"2023-08-10T10:30:39.983630+0000","last_clean":"2023-08-10T10:30:39.983630+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:30:39.983630+0000","last_undegraded":"2023-08-10T10:30:39.983630+0000","last_fullsized":"2023-08-10T10:30:39.983630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:25.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370188+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:30:39.370188+0000","last_peered":"2023-08-10T10:30:39.370188+0000","last_clean":"2023-08-10T10:30:39.370188+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:30:39.370188+0000","last_undegraded":"2023-08-10T10:30:39.370188+0000","last_fullsized":"2023-08-10T10:30:39.370188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:46.308677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983978+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:30:39.983978+0000","last_peered":"2023-08-10T10:30:39.983978+0000","last_clean":"2023-08-10T10:30:39.983978+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:30:39.983978+0000","last_undegraded":"2023-08-10T10:30:39.983978+0000","last_fullsized":"2023-08-10T10:30:39.983978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:54.599910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370824+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:30:39.370824+0000","last_peered":"2023-08-10T10:30:39.370824+0000","last_clean":"2023-08-10T10:30:39.370824+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:30:39.370824+0000","last_undegraded":"2023-08-10T10:30:39.370824+0000","last_fullsized":"2023-08-10T10:30:39.370824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:45.246627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370711+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:30:39.370711+0000","last_peered":"2023-08-10T10:30:39.370711+0000","last_clean":"2023-08-10T10:30:39.370711+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:30:39.370711+0000","last_undegraded":"2023-08-10T10:30:39.370711+0000","last_fullsized":"2023-08-10T10:30:39.370711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370373+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:30:39.370373+0000","last_peered":"2023-08-10T10:30:39.370373+0000","last_clean":"2023-08-10T10:30:39.370373+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:30:39.370373+0000","last_undegraded":"2023-08-10T10:30:39.370373+0000","last_fullsized":"2023-08-10T10:30:39.370373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982981+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:30:39.982981+0000","last_peered":"2023-08-10T10:30:39.982981+0000","last_clean":"2023-08-10T10:30:39.982981+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:30:39.982981+0000","last_undegraded":"2023-08-10T10:30:39.982981+0000","last_fullsized":"2023-08-10T10:30:39.982981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873270+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:30:39.873270+0000","last_peered":"2023-08-10T10:30:39.873270+0000","last_clean":"2023-08-10T10:30:39.873270+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:30:39.873270+0000","last_undegraded":"2023-08-10T10:30:39.873270+0000","last_fullsized":"2023-08-10T10:30:39.873270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982968+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:30:39.982968+0000","last_peered":"2023-08-10T10:30:39.982968+0000","last_clean":"2023-08-10T10:30:39.982968+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:30:39.982968+0000","last_undegraded":"2023-08-10T10:30:39.982968+0000","last_fullsized":"2023-08-10T10:30:39.982968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872875+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:30:39.872875+0000","last_peered":"2023-08-10T10:30:39.872875+0000","last_clean":"2023-08-10T10:30:39.872875+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:30:39.872875+0000","last_undegraded":"2023-08-10T10:30:39.872875+0000","last_fullsized":"2023-08-10T10:30:39.872875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984191+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:30:39.984191+0000","last_peered":"2023-08-10T10:30:39.984191+0000","last_clean":"2023-08-10T10:30:39.984191+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:30:39.984191+0000","last_undegraded":"2023-08-10T10:30:39.984191+0000","last_fullsized":"2023-08-10T10:30:39.984191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872443+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:30:39.872443+0000","last_peered":"2023-08-10T10:30:39.872443+0000","last_clean":"2023-08-10T10:30:39.872443+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:30:39.872443+0000","last_undegraded":"2023-08-10T10:30:39.872443+0000","last_fullsized":"2023-08-10T10:30:39.872443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:22.886580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982829+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:30:39.982829+0000","last_peered":"2023-08-10T10:30:39.982829+0000","last_clean":"2023-08-10T10:30:39.982829+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:30:39.982829+0000","last_undegraded":"2023-08-10T10:30:39.982829+0000","last_fullsized":"2023-08-10T10:30:39.982829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983219+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:30:39.983219+0000","last_peered":"2023-08-10T10:30:39.983219+0000","last_clean":"2023-08-10T10:30:39.983219+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:30:39.983219+0000","last_undegraded":"2023-08-10T10:30:39.983219+0000","last_fullsized":"2023-08-10T10:30:39.983219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:00.831050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371933+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:30:39.371933+0000","last_peered":"2023-08-10T10:30:39.371933+0000","last_clean":"2023-08-10T10:30:39.371933+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:30:39.371933+0000","last_undegraded":"2023-08-10T10:30:39.371933+0000","last_fullsized":"2023-08-10T10:30:39.371933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:13.886565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872839+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:30:39.872839+0000","last_peered":"2023-08-10T10:30:39.872839+0000","last_clean":"2023-08-10T10:30:39.872839+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:30:39.872839+0000","last_undegraded":"2023-08-10T10:30:39.872839+0000","last_fullsized":"2023-08-10T10:30:39.872839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369614+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:30:39.369614+0000","last_peered":"2023-08-10T10:30:39.369614+0000","last_clean":"2023-08-10T10:30:39.369614+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:30:39.369614+0000","last_undegraded":"2023-08-10T10:30:39.369614+0000","last_fullsized":"2023-08-10T10:30:39.369614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:31.264771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368880+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:30:39.368880+0000","last_peered":"2023-08-10T10:30:39.368880+0000","last_clean":"2023-08-10T10:30:39.368880+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:30:39.368880+0000","last_undegraded":"2023-08-10T10:30:39.368880+0000","last_fullsized":"2023-08-10T10:30:39.368880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.879507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872450+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:30:39.872450+0000","last_peered":"2023-08-10T10:30:39.872450+0000","last_clean":"2023-08-10T10:30:39.872450+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:30:39.872450+0000","last_undegraded":"2023-08-10T10:30:39.872450+0000","last_fullsized":"2023-08-10T10:30:39.872450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:27.225030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873190+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:30:39.873190+0000","last_peered":"2023-08-10T10:30:39.873190+0000","last_clean":"2023-08-10T10:30:39.873190+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:30:39.873190+0000","last_undegraded":"2023-08-10T10:30:39.873190+0000","last_fullsized":"2023-08-10T10:30:39.873190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370168+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:30:39.370168+0000","last_peered":"2023-08-10T10:30:39.370168+0000","last_clean":"2023-08-10T10:30:39.370168+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:30:39.370168+0000","last_undegraded":"2023-08-10T10:30:39.370168+0000","last_fullsized":"2023-08-10T10:30:39.370168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:08.726944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983289+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:30:39.983289+0000","last_peered":"2023-08-10T10:30:39.983289+0000","last_clean":"2023-08-10T10:30:39.983289+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:30:39.983289+0000","last_undegraded":"2023-08-10T10:30:39.983289+0000","last_fullsized":"2023-08-10T10:30:39.983289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370088+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:30:39.370088+0000","last_peered":"2023-08-10T10:30:39.370088+0000","last_clean":"2023-08-10T10:30:39.370088+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:30:39.370088+0000","last_undegraded":"2023-08-10T10:30:39.370088+0000","last_fullsized":"2023-08-10T10:30:39.370088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:57.539627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983688+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:30:39.983688+0000","last_peered":"2023-08-10T10:30:39.983688+0000","last_clean":"2023-08-10T10:30:39.983688+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:30:39.983688+0000","last_undegraded":"2023-08-10T10:30:39.983688+0000","last_fullsized":"2023-08-10T10:30:39.983688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983836+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:30:39.983836+0000","last_peered":"2023-08-10T10:30:39.983836+0000","last_clean":"2023-08-10T10:30:39.983836+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:30:39.983836+0000","last_undegraded":"2023-08-10T10:30:39.983836+0000","last_fullsized":"2023-08-10T10:30:39.983836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:55.787159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983619+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:30:39.983619+0000","last_peered":"2023-08-10T10:30:39.983619+0000","last_clean":"2023-08-10T10:30:39.983619+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:30:39.983619+0000","last_undegraded":"2023-08-10T10:30:39.983619+0000","last_fullsized":"2023-08-10T10:30:39.983619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370678+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:30:39.370678+0000","last_peered":"2023-08-10T10:30:39.370678+0000","last_clean":"2023-08-10T10:30:39.370678+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:30:39.370678+0000","last_undegraded":"2023-08-10T10:30:39.370678+0000","last_fullsized":"2023-08-10T10:30:39.370678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982478+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:30:39.982478+0000","last_peered":"2023-08-10T10:30:39.982478+0000","last_clean":"2023-08-10T10:30:39.982478+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:30:39.982478+0000","last_undegraded":"2023-08-10T10:30:39.982478+0000","last_fullsized":"2023-08-10T10:30:39.982478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:02.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982630+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:30:39.982630+0000","last_peered":"2023-08-10T10:30:39.982630+0000","last_clean":"2023-08-10T10:30:39.982630+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:30:39.982630+0000","last_undegraded":"2023-08-10T10:30:39.982630+0000","last_fullsized":"2023-08-10T10:30:39.982630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984052+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:30:39.984052+0000","last_peered":"2023-08-10T10:30:39.984052+0000","last_clean":"2023-08-10T10:30:39.984052+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:30:39.984052+0000","last_undegraded":"2023-08-10T10:30:39.984052+0000","last_fullsized":"2023-08-10T10:30:39.984052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:59.078823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371781+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:30:39.371781+0000","last_peered":"2023-08-10T10:30:39.371781+0000","last_clean":"2023-08-10T10:30:39.371781+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:30:39.371781+0000","last_undegraded":"2023-08-10T10:30:39.371781+0000","last_fullsized":"2023-08-10T10:30:39.371781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:06.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873008+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:30:39.873008+0000","last_peered":"2023-08-10T10:30:39.873008+0000","last_clean":"2023-08-10T10:30:39.873008+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:30:39.873008+0000","last_undegraded":"2023-08-10T10:30:39.873008+0000","last_fullsized":"2023-08-10T10:30:39.873008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983910+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:30:39.983910+0000","last_peered":"2023-08-10T10:30:39.983910+0000","last_clean":"2023-08-10T10:30:39.983910+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:30:39.983910+0000","last_undegraded":"2023-08-10T10:30:39.983910+0000","last_fullsized":"2023-08-10T10:30:39.983910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371390+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:30:39.371390+0000","last_peered":"2023-08-10T10:30:39.371390+0000","last_clean":"2023-08-10T10:30:39.371390+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:30:39.371390+0000","last_undegraded":"2023-08-10T10:30:39.371390+0000","last_fullsized":"2023-08-10T10:30:39.371390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984167+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:30:39.984167+0000","last_peered":"2023-08-10T10:30:39.984167+0000","last_clean":"2023-08-10T10:30:39.984167+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:30:39.984167+0000","last_undegraded":"2023-08-10T10:30:39.984167+0000","last_fullsized":"2023-08-10T10:30:39.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:55.653411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873193+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:30:39.873193+0000","last_peered":"2023-08-10T10:30:39.873193+0000","last_clean":"2023-08-10T10:30:39.873193+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:30:39.873193+0000","last_undegraded":"2023-08-10T10:30:39.873193+0000","last_fullsized":"2023-08-10T10:30:39.873193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:44.518583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982243+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:30:39.982243+0000","last_peered":"2023-08-10T10:30:39.982243+0000","last_clean":"2023-08-10T10:30:39.982243+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:30:39.982243+0000","last_undegraded":"2023-08-10T10:30:39.982243+0000","last_fullsized":"2023-08-10T10:30:39.982243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982179+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:30:39.982179+0000","last_peered":"2023-08-10T10:30:39.982179+0000","last_clean":"2023-08-10T10:30:39.982179+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:30:39.982179+0000","last_undegraded":"2023-08-10T10:30:39.982179+0000","last_fullsized":"2023-08-10T10:30:39.982179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983789+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:30:39.983789+0000","last_peered":"2023-08-10T10:30:39.983789+0000","last_clean":"2023-08-10T10:30:39.983789+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:30:39.983789+0000","last_undegraded":"2023-08-10T10:30:39.983789+0000","last_fullsized":"2023-08-10T10:30:39.983789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:50:24.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982789+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:30:39.982789+0000","last_peered":"2023-08-10T10:30:39.982789+0000","last_clean":"2023-08-10T10:30:39.982789+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:30:39.982789+0000","last_undegraded":"2023-08-10T10:30:39.982789+0000","last_fullsized":"2023-08-10T10:30:39.982789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:04.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370966+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:30:39.370966+0000","last_peered":"2023-08-10T10:30:39.370966+0000","last_clean":"2023-08-10T10:30:39.370966+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:30:39.370966+0000","last_undegraded":"2023-08-10T10:30:39.370966+0000","last_fullsized":"2023-08-10T10:30:39.370966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:05.482062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872971+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:30:39.872971+0000","last_peered":"2023-08-10T10:30:39.872971+0000","last_clean":"2023-08-10T10:30:39.872971+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:30:39.872971+0000","last_undegraded":"2023-08-10T10:30:39.872971+0000","last_fullsized":"2023-08-10T10:30:39.872971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983288+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:30:39.983288+0000","last_peered":"2023-08-10T10:30:39.983288+0000","last_clean":"2023-08-10T10:30:39.983288+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:30:39.983288+0000","last_undegraded":"2023-08-10T10:30:39.983288+0000","last_fullsized":"2023-08-10T10:30:39.983288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369221+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:30:39.369221+0000","last_peered":"2023-08-10T10:30:39.369221+0000","last_clean":"2023-08-10T10:30:39.369221+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:30:39.369221+0000","last_undegraded":"2023-08-10T10:30:39.369221+0000","last_fullsized":"2023-08-10T10:30:39.369221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:55:31.891569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370491+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:30:39.370491+0000","last_peered":"2023-08-10T10:30:39.370491+0000","last_clean":"2023-08-10T10:30:39.370491+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:30:39.370491+0000","last_undegraded":"2023-08-10T10:30:39.370491+0000","last_fullsized":"2023-08-10T10:30:39.370491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:10.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983827+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:30:39.983827+0000","last_peered":"2023-08-10T10:30:39.983827+0000","last_clean":"2023-08-10T10:30:39.983827+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:30:39.983827+0000","last_undegraded":"2023-08-10T10:30:39.983827+0000","last_fullsized":"2023-08-10T10:30:39.983827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.372064+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:30:39.372064+0000","last_peered":"2023-08-10T10:30:39.372064+0000","last_clean":"2023-08-10T10:30:39.372064+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:30:39.372064+0000","last_undegraded":"2023-08-10T10:30:39.372064+0000","last_fullsized":"2023-08-10T10:30:39.372064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983306+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:30:39.983306+0000","last_peered":"2023-08-10T10:30:39.983306+0000","last_clean":"2023-08-10T10:30:39.983306+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:30:39.983306+0000","last_undegraded":"2023-08-10T10:30:39.983306+0000","last_fullsized":"2023-08-10T10:30:39.983306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984069+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:30:39.984069+0000","last_peered":"2023-08-10T10:30:39.984069+0000","last_clean":"2023-08-10T10:30:39.984069+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:30:39.984069+0000","last_undegraded":"2023-08-10T10:30:39.984069+0000","last_fullsized":"2023-08-10T10:30:39.984069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370682+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:30:39.370682+0000","last_peered":"2023-08-10T10:30:39.370682+0000","last_clean":"2023-08-10T10:30:39.370682+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:30:39.370682+0000","last_undegraded":"2023-08-10T10:30:39.370682+0000","last_fullsized":"2023-08-10T10:30:39.370682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370384+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:30:39.370384+0000","last_peered":"2023-08-10T10:30:39.370384+0000","last_clean":"2023-08-10T10:30:39.370384+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:30:39.370384+0000","last_undegraded":"2023-08-10T10:30:39.370384+0000","last_fullsized":"2023-08-10T10:30:39.370384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983703+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:30:39.983703+0000","last_peered":"2023-08-10T10:30:39.983703+0000","last_clean":"2023-08-10T10:30:39.983703+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:30:39.983703+0000","last_undegraded":"2023-08-10T10:30:39.983703+0000","last_fullsized":"2023-08-10T10:30:39.983703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983297+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:30:39.983297+0000","last_peered":"2023-08-10T10:30:39.983297+0000","last_clean":"2023-08-10T10:30:39.983297+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:30:39.983297+0000","last_undegraded":"2023-08-10T10:30:39.983297+0000","last_fullsized":"2023-08-10T10:30:39.983297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872672+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:30:39.872672+0000","last_peered":"2023-08-10T10:30:39.872672+0000","last_clean":"2023-08-10T10:30:39.872672+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:30:39.872672+0000","last_undegraded":"2023-08-10T10:30:39.872672+0000","last_fullsized":"2023-08-10T10:30:39.872672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:07.784753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983138+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:30:39.983138+0000","last_peered":"2023-08-10T10:30:39.983138+0000","last_clean":"2023-08-10T10:30:39.983138+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:30:39.983138+0000","last_undegraded":"2023-08-10T10:30:39.983138+0000","last_fullsized":"2023-08-10T10:30:39.983138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:49.538451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370654+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:30:39.370654+0000","last_peered":"2023-08-10T10:30:39.370654+0000","last_clean":"2023-08-10T10:30:39.370654+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:30:39.370654+0000","last_undegraded":"2023-08-10T10:30:39.370654+0000","last_fullsized":"2023-08-10T10:30:39.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984216+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:30:39.984216+0000","last_peered":"2023-08-10T10:30:39.984216+0000","last_clean":"2023-08-10T10:30:39.984216+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:30:39.984216+0000","last_undegraded":"2023-08-10T10:30:39.984216+0000","last_fullsized":"2023-08-10T10:30:39.984216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:58:25.947292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983467+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:30:39.983467+0000","last_peered":"2023-08-10T10:30:39.983467+0000","last_clean":"2023-08-10T10:30:39.983467+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:30:39.983467+0000","last_undegraded":"2023-08-10T10:30:39.983467+0000","last_fullsized":"2023-08-10T10:30:39.983467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371344+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:30:39.371344+0000","last_peered":"2023-08-10T10:30:39.371344+0000","last_clean":"2023-08-10T10:30:39.371344+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:30:39.371344+0000","last_undegraded":"2023-08-10T10:30:39.371344+0000","last_fullsized":"2023-08-10T10:30:39.371344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.149063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983858+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:30:39.983858+0000","last_peered":"2023-08-10T10:30:39.983858+0000","last_clean":"2023-08-10T10:30:39.983858+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:30:39.983858+0000","last_undegraded":"2023-08-10T10:30:39.983858+0000","last_fullsized":"2023-08-10T10:30:39.983858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873013+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:30:39.873013+0000","last_peered":"2023-08-10T10:30:39.873013+0000","last_clean":"2023-08-10T10:30:39.873013+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:30:39.873013+0000","last_undegraded":"2023-08-10T10:30:39.873013+0000","last_fullsized":"2023-08-10T10:30:39.873013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:31:02.562 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:31:02.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.789+0000 7f1a2e3ff700 1 Processor -- start 2023-08-10T10:31:02.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.789+0000 7f1a2e3ff700 1 -- start start 2023-08-10T10:31:02.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2e3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a280b8870 0x7f1a280b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2e3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1a280b5040 0x7f1a280d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2e3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280b8e30 con 0x7f1a2815cf20 2023-08-10T10:31:02.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2e3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280cde30 con 0x7f1a280b8870 2023-08-10T10:31:02.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2e3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280b54b0 con 0x7f1a280b5040 2023-08-10T10:31:02.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a1ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1a280b8870 0x7f1a280b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a27fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1a2815cf20 0x7f1a2815e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58012/0 (socket says 172.21.15.88:58012) 2023-08-10T10:31:02.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a27fff700 1 -- 172.21.15.88:0/1709819054 learned_addr learned my addr 172.21.15.88:0/1709819054 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:02.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.790+0000 7f1a2c99c700 1 --2- 172.21.15.88:0/1709819054 >> v2:172.21.15.187:3300/0 conn(0x7f1a280b5040 0x7f1a280d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a1ffff700 1 -- 172.21.15.88:0/1709819054 >> v2:172.21.15.187:3300/0 conn(0x7f1a280b5040 msgr2=0x7f1a280d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:02.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a1ffff700 1 --2- 172.21.15.88:0/1709819054 >> v2:172.21.15.187:3300/0 conn(0x7f1a280b5040 0x7f1a280d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a1ffff700 1 -- 172.21.15.88:0/1709819054 >> v1:172.21.15.88:6789/0 conn(0x7f1a2815cf20 legacy=0x7f1a2815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a1ffff700 1 -- 172.21.15.88:0/1709819054 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280ce010 con 0x7f1a280b8870 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a277fe700 1 -- 172.21.15.88:0/1709819054 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1788617057 0 0) 0x7f1a280b8e30 con 0x7f1a2815cf20 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a1ffff700 1 --2- 172.21.15.88:0/1709819054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b8870 0x7f1a280b4b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1a280cd840 tx=0x7f1a10009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76747336d4a034a6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a277fe700 1 -- 172.21.15.88:0/1709819054 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011830 con 0x7f1a280b8870 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a277fe700 1 -- 172.21.15.88:0/1709819054 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a10011990 con 0x7f1a280b8870 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.791+0000 7f1a277fe700 1 -- 172.21.15.88:0/1709819054 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a10011d20 con 0x7f1a280b8870 2023-08-10T10:31:02.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/1709819054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b8870 msgr2=0x7f1a280b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/1709819054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b8870 0x7f1a280b4b00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f1a280cd840 tx=0x7f1a10009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/1709819054 shutdown_connections 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/1709819054 >> v2:172.21.15.187:3300/0 conn(0x7f1a280b5040 0x7f1a280d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/1709819054 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b8870 0x7f1a280b4b00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/1709819054 >> 172.21.15.88:0/1709819054 conn(0x7f1a280d3080 msgr2=0x7f1a280d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/1709819054 shutdown_connections 2023-08-10T10:31:02.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.792+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/1709819054 wait complete. 2023-08-10T10:31:02.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.794+0000 7f1a2e3ff700 1 Processor -- start 2023-08-10T10:31:02.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.794+0000 7f1a2e3ff700 1 -- start start 2023-08-10T10:31:02.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a280b8870 0x7f1a280c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a2815cf20 0x7f1a280b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280cae70 con 0x7f1a280b5040 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a281f2d40 con 0x7f1a2815cf20 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2e3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280ca1f0 con 0x7f1a280b8870 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50388/0 (socket says 172.21.15.88:50388) 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 -- 172.21.15.88:0/3321290086 learned_addr learned my addr 172.21.15.88:0/3321290086 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:02.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a2c99c700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a2815cf20 0x7f1a280b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a1ffff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a280b8870 0x7f1a280c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 -- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a280b8870 msgr2=0x7f1a280c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a280b8870 0x7f1a280c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 -- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a2815cf20 msgr2=0x7f1a280b20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a2815cf20 0x7f1a280b20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.795+0000 7f1a27fff700 1 -- 172.21.15.88:0/3321290086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a100094a0 con 0x7f1a280b5040 2023-08-10T10:31:02.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a27fff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c550 tx=0x7f1a1800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18004c80 con 0x7f1a280b5040 2023-08-10T10:31:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18004e00 con 0x7f1a280b5040 2023-08-10T10:31:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a280ca4d0 con 0x7f1a280b5040 2023-08-10T10:31:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007310 con 0x7f1a280b5040 2023-08-10T10:31:02.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.796+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a280caa90 con 0x7f1a280b5040 2023-08-10T10:31:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.797+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280cdc50 con 0x7f1a280b5040 2023-08-10T10:31:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.798+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1a18007470 con 0x7f1a280b5040 2023-08-10T10:31:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.799+0000 7f1a257fa700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 0x7f1a0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.799+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1a18089390 con 0x7f1a280b5040 2023-08-10T10:31:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.799+0000 7f1a1ffff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 0x7f1a0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:02.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.800+0000 7f1a1ffff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 0x7f1a0806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:02.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.803+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1a18054140 con 0x7f1a280b5040 2023-08-10T10:31:02.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:02.993+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a280ce5d0 con 0x7f1a0806ace0 2023-08-10T10:31:03.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.003+0000 7f1a257fa700 1 -- 172.21.15.88:0/3321290086 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+367406 (secure 0 0 0) 0x7f1a10011c00 con 0x7f1a0806ace0 2023-08-10T10:31:03.009 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:03.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 msgr2=0x7f1a0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 0x7f1a0806d1a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1a100097c0 tx=0x7f1a10008030 comp rx=0 tx=0).stop 2023-08-10T10:31:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 msgr2=0x7f1a281f2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c550 tx=0x7f1a1800c860 comp rx=0 tx=0).stop 2023-08-10T10:31:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 shutdown_connections 2023-08-10T10:31:03.012 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a2815cf20 0x7f1a280b20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1a280b5040 0x7f1a281f2800 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1a0806ace0 0x7f1a0806d1a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 --2- 172.21.15.88:0/3321290086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1a280b8870 0x7f1a280c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.008+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 >> 172.21.15.88:0/3321290086 conn(0x7f1a280d3080 msgr2=0x7f1a280d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.009+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 shutdown_connections 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.009+0000 7f1a2e3ff700 1 -- 172.21.15.88:0/3321290086 wait complete. 2023-08-10T10:31:03.013 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:31:03.028 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-08-10T10:31:01.539485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594960,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219672,"kb_used_data":3492,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755048,"statfs":{"total":773094113280,"available":772869169152,"internally_reserved":0,"allocated":3575808,"data_stored":2148109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.010856"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369311+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:30:39.369311+0000","last_peered":"2023-08-10T10:30:39.369311+0000","last_clean":"2023-08-10T10:30:39.369311+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:30:39.369311+0000","last_undegraded":"2023-08-10T10:30:39.369311+0000","last_fullsized":"2023-08-10T10:30:39.369311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:15:52.847844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983931+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:30:39.983931+0000","last_peered":"2023-08-10T10:30:39.983931+0000","last_clean":"2023-08-10T10:30:39.983931+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:30:39.983931+0000","last_undegraded":"2023-08-10T10:30:39.983931+0000","last_fullsized":"2023-08-10T10:30:39.983931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371111+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:30:39.371111+0000","last_peered":"2023-08-10T10:30:39.371111+0000","last_clean":"2023-08-10T10:30:39.371111+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:30:39.371111+0000","last_undegraded":"2023-08-10T10:30:39.371111+0000","last_fullsized":"2023-08-10T10:30:39.371111+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:07.275147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984157+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:30:39.984157+0000","last_peered":"2023-08-10T10:30:39.984157+0000","last_clean":"2023-08-10T10:30:39.984157+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:30:39.984157+0000","last_undegraded":"2023-08-10T10:30:39.984157+0000","last_fullsized":"2023-08-10T10:30:39.984157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:32:45.483566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983455+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:30:39.983455+0000","last_peered":"2023-08-10T10:30:39.983455+0000","last_clean":"2023-08-10T10:30:39.983455+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:30:39.983455+0000","last_undegraded":"2023-08-10T10:30:39.983455+0000","last_fullsized":"2023-08-10T10:30:39.983455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371199+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:30:39.371199+0000","last_peered":"2023-08-10T10:30:39.371199+0000","last_clean":"2023-08-10T10:30:39.371199+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:30:39.371199+0000","last_undegraded":"2023-08-10T10:30:39.371199+0000","last_fullsized":"2023-08-10T10:30:39.371199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:29.585173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370548+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:30:39.370548+0000","last_peered":"2023-08-10T10:30:39.370548+0000","last_clean":"2023-08-10T10:30:39.370548+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:30:39.370548+0000","last_undegraded":"2023-08-10T10:30:39.370548+0000","last_fullsized":"2023-08-10T10:30:39.370548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983193+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:30:39.983193+0000","last_peered":"2023-08-10T10:30:39.983193+0000","last_clean":"2023-08-10T10:30:39.983193+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:30:39.983193+0000","last_undegraded":"2023-08-10T10:30:39.983193+0000","last_fullsized":"2023-08-10T10:30:39.983193+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982871+0000","last_change":"2023-08-10T10:30:34.342831+0000","last_active":"2023-08-10T10:30:39.982871+0000","last_peered":"2023-08-10T10:30:39.982871+0000","last_clean":"2023-08-10T10:30:39.982871+0000","last_became_active":"2023-08-10T10:30:34.341582+0000","last_became_peered":"2023-08-10T10:30:34.341582+0000","last_unstale":"2023-08-10T10:30:39.982871+0000","last_undegraded":"2023-08-10T10:30:39.982871+0000","last_fullsized":"2023-08-10T10:30:39.982871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984422+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:30:39.984422+0000","last_peered":"2023-08-10T10:30:39.984422+0000","last_clean":"2023-08-10T10:30:39.984422+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:30:39.984422+0000","last_undegraded":"2023-08-10T10:30:39.984422+0000","last_fullsized":"2023-08-10T10:30:39.984422+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370892+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:30:39.370892+0000","last_peered":"2023-08-10T10:30:39.370892+0000","last_clean":"2023-08-10T10:30:39.370892+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:30:39.370892+0000","last_undegraded":"2023-08-10T10:30:39.370892+0000","last_fullsized":"2023-08-10T10:30:39.370892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:25.530256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369176+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:30:39.369176+0000","last_peered":"2023-08-10T10:30:39.369176+0000","last_clean":"2023-08-10T10:30:39.369176+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:30:39.369176+0000","last_undegraded":"2023-08-10T10:30:39.369176+0000","last_fullsized":"2023-08-10T10:30:39.369176+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:21.255854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369378+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:30:39.369378+0000","last_peered":"2023-08-10T10:30:39.369378+0000","last_clean":"2023-08-10T10:30:39.369378+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:30:39.369378+0000","last_undegraded":"2023-08-10T10:30:39.369378+0000","last_fullsized":"2023-08-10T10:30:39.369378+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:12:14.864006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983136+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:30:39.983136+0000","last_peered":"2023-08-10T10:30:39.983136+0000","last_clean":"2023-08-10T10:30:39.983136+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:30:39.983136+0000","last_undegraded":"2023-08-10T10:30:39.983136+0000","last_fullsized":"2023-08-10T10:30:39.983136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369966+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:30:39.369966+0000","last_peered":"2023-08-10T10:30:39.369966+0000","last_clean":"2023-08-10T10:30:39.369966+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:30:39.369966+0000","last_undegraded":"2023-08-10T10:30:39.369966+0000","last_fullsized":"2023-08-10T10:30:39.369966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370894+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:30:39.370894+0000","last_peered":"2023-08-10T10:30:39.370894+0000","last_clean":"2023-08-10T10:30:39.370894+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:30:39.370894+0000","last_undegraded":"2023-08-10T10:30:39.370894+0000","last_fullsized":"2023-08-10T10:30:39.370894+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982953+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:30:39.982953+0000","last_peered":"2023-08-10T10:30:39.982953+0000","last_clean":"2023-08-10T10:30:39.982953+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:30:39.982953+0000","last_undegraded":"2023-08-10T10:30:39.982953+0000","last_fullsized":"2023-08-10T10:30:39.982953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:34.134709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370539+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:30:39.370539+0000","last_peered":"2023-08-10T10:30:39.370539+0000","last_clean":"2023-08-10T10:30:39.370539+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:30:39.370539+0000","last_undegraded":"2023-08-10T10:30:39.370539+0000","last_fullsized":"2023-08-10T10:30:39.370539+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:56.660087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369083+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:30:39.369083+0000","last_peered":"2023-08-10T10:30:39.369083+0000","last_clean":"2023-08-10T10:30:39.369083+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:30:39.369083+0000","last_undegraded":"2023-08-10T10:30:39.369083+0000","last_fullsized":"2023-08-10T10:30:39.369083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:15:22.279579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371337+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:30:39.371337+0000","last_peered":"2023-08-10T10:30:39.371337+0000","last_clean":"2023-08-10T10:30:39.371337+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:30:39.371337+0000","last_undegraded":"2023-08-10T10:30:39.371337+0000","last_fullsized":"2023-08-10T10:30:39.371337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370272+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:30:39.370272+0000","last_peered":"2023-08-10T10:30:39.370272+0000","last_clean":"2023-08-10T10:30:39.370272+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:30:39.370272+0000","last_undegraded":"2023-08-10T10:30:39.370272+0000","last_fullsized":"2023-08-10T10:30:39.370272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982720+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:30:39.982720+0000","last_peered":"2023-08-10T10:30:39.982720+0000","last_clean":"2023-08-10T10:30:39.982720+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:30:39.982720+0000","last_undegraded":"2023-08-10T10:30:39.982720+0000","last_fullsized":"2023-08-10T10:30:39.982720+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983043+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:30:39.983043+0000","last_peered":"2023-08-10T10:30:39.983043+0000","last_clean":"2023-08-10T10:30:39.983043+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:30:39.983043+0000","last_undegraded":"2023-08-10T10:30:39.983043+0000","last_fullsized":"2023-08-10T10:30:39.983043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370537+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:30:39.370537+0000","last_peered":"2023-08-10T10:30:39.370537+0000","last_clean":"2023-08-10T10:30:39.370537+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:30:39.370537+0000","last_undegraded":"2023-08-10T10:30:39.370537+0000","last_fullsized":"2023-08-10T10:30:39.370537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:43.636905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872983+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:30:39.872983+0000","last_peered":"2023-08-10T10:30:39.872983+0000","last_clean":"2023-08-10T10:30:39.872983+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:30:39.872983+0000","last_undegraded":"2023-08-10T10:30:39.872983+0000","last_fullsized":"2023-08-10T10:30:39.872983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873160+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:30:39.873160+0000","last_peered":"2023-08-10T10:30:39.873160+0000","last_clean":"2023-08-10T10:30:39.873160+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:30:39.873160+0000","last_undegraded":"2023-08-10T10:30:39.873160+0000","last_fullsized":"2023-08-10T10:30:39.873160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984432+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:30:39.984432+0000","last_peered":"2023-08-10T10:30:39.984432+0000","last_clean":"2023-08-10T10:30:39.984432+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:30:39.984432+0000","last_undegraded":"2023-08-10T10:30:39.984432+0000","last_fullsized":"2023-08-10T10:30:39.984432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371835+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:30:39.371835+0000","last_peered":"2023-08-10T10:30:39.371835+0000","last_clean":"2023-08-10T10:30:39.371835+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:30:39.371835+0000","last_undegraded":"2023-08-10T10:30:39.371835+0000","last_fullsized":"2023-08-10T10:30:39.371835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:13:03.982064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370925+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:30:39.370925+0000","last_peered":"2023-08-10T10:30:39.370925+0000","last_clean":"2023-08-10T10:30:39.370925+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:30:39.370925+0000","last_undegraded":"2023-08-10T10:30:39.370925+0000","last_fullsized":"2023-08-10T10:30:39.370925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:32.438438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983791+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:30:39.983791+0000","last_peered":"2023-08-10T10:30:39.983791+0000","last_clean":"2023-08-10T10:30:39.983791+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:30:39.983791+0000","last_undegraded":"2023-08-10T10:30:39.983791+0000","last_fullsized":"2023-08-10T10:30:39.983791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983622+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:30:39.983622+0000","last_peered":"2023-08-10T10:30:39.983622+0000","last_clean":"2023-08-10T10:30:39.983622+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:30:39.983622+0000","last_undegraded":"2023-08-10T10:30:39.983622+0000","last_fullsized":"2023-08-10T10:30:39.983622+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:57:07.717850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872457+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:30:39.872457+0000","last_peered":"2023-08-10T10:30:39.872457+0000","last_clean":"2023-08-10T10:30:39.872457+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:30:39.872457+0000","last_undegraded":"2023-08-10T10:30:39.872457+0000","last_fullsized":"2023-08-10T10:30:39.872457+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:33:40.229479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983295+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:30:39.983295+0000","last_peered":"2023-08-10T10:30:39.983295+0000","last_clean":"2023-08-10T10:30:39.983295+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:30:39.983295+0000","last_undegraded":"2023-08-10T10:30:39.983295+0000","last_fullsized":"2023-08-10T10:30:39.983295+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983451+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:30:39.983451+0000","last_peered":"2023-08-10T10:30:39.983451+0000","last_clean":"2023-08-10T10:30:39.983451+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:30:39.983451+0000","last_undegraded":"2023-08-10T10:30:39.983451+0000","last_fullsized":"2023-08-10T10:30:39.983451+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:25.693202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983147+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:30:39.983147+0000","last_peered":"2023-08-10T10:30:39.983147+0000","last_clean":"2023-08-10T10:30:39.983147+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:30:39.983147+0000","last_undegraded":"2023-08-10T10:30:39.983147+0000","last_fullsized":"2023-08-10T10:30:39.983147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983947+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:30:39.983947+0000","last_peered":"2023-08-10T10:30:39.983947+0000","last_clean":"2023-08-10T10:30:39.983947+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:30:39.983947+0000","last_undegraded":"2023-08-10T10:30:39.983947+0000","last_fullsized":"2023-08-10T10:30:39.983947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:52:18.306807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983456+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:30:39.983456+0000","last_peered":"2023-08-10T10:30:39.983456+0000","last_clean":"2023-08-10T10:30:39.983456+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:30:39.983456+0000","last_undegraded":"2023-08-10T10:30:39.983456+0000","last_fullsized":"2023-08-10T10:30:39.983456+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:14:22.387232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983003+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:30:39.983003+0000","last_peered":"2023-08-10T10:30:39.983003+0000","last_clean":"2023-08-10T10:30:39.983003+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:30:39.983003+0000","last_undegraded":"2023-08-10T10:30:39.983003+0000","last_fullsized":"2023-08-10T10:30:39.983003+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983092+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:30:39.983092+0000","last_peered":"2023-08-10T10:30:39.983092+0000","last_clean":"2023-08-10T10:30:39.983092+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:30:39.983092+0000","last_undegraded":"2023-08-10T10:30:39.983092+0000","last_fullsized":"2023-08-10T10:30:39.983092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:04.672162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369849+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:30:39.369849+0000","last_peered":"2023-08-10T10:30:39.369849+0000","last_clean":"2023-08-10T10:30:39.369849+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:30:39.369849+0000","last_undegraded":"2023-08-10T10:30:39.369849+0000","last_fullsized":"2023-08-10T10:30:39.369849+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984181+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:30:39.984181+0000","last_peered":"2023-08-10T10:30:39.984181+0000","last_clean":"2023-08-10T10:30:39.984181+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:30:39.984181+0000","last_undegraded":"2023-08-10T10:30:39.984181+0000","last_fullsized":"2023-08-10T10:30:39.984181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983153+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:30:39.983153+0000","last_peered":"2023-08-10T10:30:39.983153+0000","last_clean":"2023-08-10T10:30:39.983153+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:30:39.983153+0000","last_undegraded":"2023-08-10T10:30:39.983153+0000","last_fullsized":"2023-08-10T10:30:39.983153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:50.545128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984063+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:30:39.984063+0000","last_peered":"2023-08-10T10:30:39.984063+0000","last_clean":"2023-08-10T10:30:39.984063+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:30:39.984063+0000","last_undegraded":"2023-08-10T10:30:39.984063+0000","last_fullsized":"2023-08-10T10:30:39.984063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371870+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:30:39.371870+0000","last_peered":"2023-08-10T10:30:39.371870+0000","last_clean":"2023-08-10T10:30:39.371870+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:30:39.371870+0000","last_undegraded":"2023-08-10T10:30:39.371870+0000","last_fullsized":"2023-08-10T10:30:39.371870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:45.302001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872782+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:30:39.872782+0000","last_peered":"2023-08-10T10:30:39.872782+0000","last_clean":"2023-08-10T10:30:39.872782+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:30:39.872782+0000","last_undegraded":"2023-08-10T10:30:39.872782+0000","last_fullsized":"2023-08-10T10:30:39.872782+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872553+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:30:39.872553+0000","last_peered":"2023-08-10T10:30:39.872553+0000","last_clean":"2023-08-10T10:30:39.872553+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:30:39.872553+0000","last_undegraded":"2023-08-10T10:30:39.872553+0000","last_fullsized":"2023-08-10T10:30:39.872553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:08:24.539937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"27'10","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:52.633741+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:30:52.633741+0000","last_peered":"2023-08-10T10:30:52.633741+0000","last_clean":"2023-08-10T10:30:52.633741+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:30:52.633741+0000","last_undegraded":"2023-08-10T10:30:52.633741+0000","last_fullsized":"2023-08-10T10:30:52.633741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:37.081141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3794,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371788+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:30:39.371788+0000","last_peered":"2023-08-10T10:30:39.371788+0000","last_clean":"2023-08-10T10:30:39.371788+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:30:39.371788+0000","last_undegraded":"2023-08-10T10:30:39.371788+0000","last_fullsized":"2023-08-10T10:30:39.371788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:24.614492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984518+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:30:39.984518+0000","last_peered":"2023-08-10T10:30:39.984518+0000","last_clean":"2023-08-10T10:30:39.984518+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:30:39.984518+0000","last_undegraded":"2023-08-10T10:30:39.984518+0000","last_fullsized":"2023-08-10T10:30:39.984518+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370136+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:30:39.370136+0000","last_peered":"2023-08-10T10:30:39.370136+0000","last_clean":"2023-08-10T10:30:39.370136+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:30:39.370136+0000","last_undegraded":"2023-08-10T10:30:39.370136+0000","last_fullsized":"2023-08-10T10:30:39.370136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:53.284786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984177+0000","last_change":"2023-08-10T10:30:34.333045+0000","last_active":"2023-08-10T10:30:39.984177+0000","last_peered":"2023-08-10T10:30:39.984177+0000","last_clean":"2023-08-10T10:30:39.984177+0000","last_became_active":"2023-08-10T10:30:34.332756+0000","last_became_peered":"2023-08-10T10:30:34.332756+0000","last_unstale":"2023-08-10T10:30:39.984177+0000","last_undegraded":"2023-08-10T10:30:39.984177+0000","last_fullsized":"2023-08-10T10:30:39.984177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:28.964743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984070+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:30:39.984070+0000","last_peered":"2023-08-10T10:30:39.984070+0000","last_clean":"2023-08-10T10:30:39.984070+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:30:39.984070+0000","last_undegraded":"2023-08-10T10:30:39.984070+0000","last_fullsized":"2023-08-10T10:30:39.984070+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982553+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:30:39.982553+0000","last_peered":"2023-08-10T10:30:39.982553+0000","last_clean":"2023-08-10T10:30:39.982553+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:30:39.982553+0000","last_undegraded":"2023-08-10T10:30:39.982553+0000","last_fullsized":"2023-08-10T10:30:39.982553+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:12.238493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984332+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:30:39.984332+0000","last_peered":"2023-08-10T10:30:39.984332+0000","last_clean":"2023-08-10T10:30:39.984332+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:30:39.984332+0000","last_undegraded":"2023-08-10T10:30:39.984332+0000","last_fullsized":"2023-08-10T10:30:39.984332+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:21.638420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:30:39.983925+0000","last_peered":"2023-08-10T10:30:39.983925+0000","last_clean":"2023-08-10T10:30:39.983925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:30:39.983925+0000","last_undegraded":"2023-08-10T10:30:39.983925+0000","last_fullsized":"2023-08-10T10:30:39.983925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:28.436558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370418+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:30:39.370418+0000","last_peered":"2023-08-10T10:30:39.370418+0000","last_clean":"2023-08-10T10:30:39.370418+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.370418+0000","last_undegraded":"2023-08-10T10:30:39.370418+0000","last_fullsized":"2023-08-10T10:30:39.370418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983299+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:30:39.983299+0000","last_peered":"2023-08-10T10:30:39.983299+0000","last_clean":"2023-08-10T10:30:39.983299+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:30:39.983299+0000","last_undegraded":"2023-08-10T10:30:39.983299+0000","last_fullsized":"2023-08-10T10:30:39.983299+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:25.632086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983777+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:30:39.983777+0000","last_peered":"2023-08-10T10:30:39.983777+0000","last_clean":"2023-08-10T10:30:39.983777+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:30:39.983777+0000","last_undegraded":"2023-08-10T10:30:39.983777+0000","last_fullsized":"2023-08-10T10:30:39.983777+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983006+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:30:39.983006+0000","last_peered":"2023-08-10T10:30:39.983006+0000","last_clean":"2023-08-10T10:30:39.983006+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:30:39.983006+0000","last_undegraded":"2023-08-10T10:30:39.983006+0000","last_fullsized":"2023-08-10T10:30:39.983006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:35:25.545777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984046+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:30:39.984046+0000","last_peered":"2023-08-10T10:30:39.984046+0000","last_clean":"2023-08-10T10:30:39.984046+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:30:39.984046+0000","last_undegraded":"2023-08-10T10:30:39.984046+0000","last_fullsized":"2023-08-10T10:30:39.984046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:12.376679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371191+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:30:39.371191+0000","last_peered":"2023-08-10T10:30:39.371191+0000","last_clean":"2023-08-10T10:30:39.371191+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:30:39.371191+0000","last_undegraded":"2023-08-10T10:30:39.371191+0000","last_fullsized":"2023-08-10T10:30:39.371191+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:53.760062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371171+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:30:39.371171+0000","last_peered":"2023-08-10T10:30:39.371171+0000","last_clean":"2023-08-10T10:30:39.371171+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:30:39.371171+0000","last_undegraded":"2023-08-10T10:30:39.371171+0000","last_fullsized":"2023-08-10T10:30:39.371171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:34.188865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983055+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:30:39.983055+0000","last_peered":"2023-08-10T10:30:39.983055+0000","last_clean":"2023-08-10T10:30:39.983055+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:30:39.983055+0000","last_undegraded":"2023-08-10T10:30:39.983055+0000","last_fullsized":"2023-08-10T10:30:39.983055+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:13.245170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368831+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:30:39.368831+0000","last_peered":"2023-08-10T10:30:39.368831+0000","last_clean":"2023-08-10T10:30:39.368831+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:30:39.368831+0000","last_undegraded":"2023-08-10T10:30:39.368831+0000","last_fullsized":"2023-08-10T10:30:39.368831+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:29.757505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370481+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:30:39.370481+0000","last_peered":"2023-08-10T10:30:39.370481+0000","last_clean":"2023-08-10T10:30:39.370481+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:30:39.370481+0000","last_undegraded":"2023-08-10T10:30:39.370481+0000","last_fullsized":"2023-08-10T10:30:39.370481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371233+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:30:39.371233+0000","last_peered":"2023-08-10T10:30:39.371233+0000","last_clean":"2023-08-10T10:30:39.371233+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:30:39.371233+0000","last_undegraded":"2023-08-10T10:30:39.371233+0000","last_fullsized":"2023-08-10T10:30:39.371233+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:49.770265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369037+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:30:39.369037+0000","last_peered":"2023-08-10T10:30:39.369037+0000","last_clean":"2023-08-10T10:30:39.369037+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:30:39.369037+0000","last_undegraded":"2023-08-10T10:30:39.369037+0000","last_fullsized":"2023-08-10T10:30:39.369037+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:31.582189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371929+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:30:39.371929+0000","last_peered":"2023-08-10T10:30:39.371929+0000","last_clean":"2023-08-10T10:30:39.371929+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:30:39.371929+0000","last_undegraded":"2023-08-10T10:30:39.371929+0000","last_fullsized":"2023-08-10T10:30:39.371929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:07.689076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983438+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:30:39.983438+0000","last_peered":"2023-08-10T10:30:39.983438+0000","last_clean":"2023-08-10T10:30:39.983438+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:30:39.983438+0000","last_undegraded":"2023-08-10T10:30:39.983438+0000","last_fullsized":"2023-08-10T10:30:39.983438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:28:12.535150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369073+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:30:39.369073+0000","last_peered":"2023-08-10T10:30:39.369073+0000","last_clean":"2023-08-10T10:30:39.369073+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:30:39.369073+0000","last_undegraded":"2023-08-10T10:30:39.369073+0000","last_fullsized":"2023-08-10T10:30:39.369073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:51:39.562819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983698+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:30:39.983698+0000","last_peered":"2023-08-10T10:30:39.983698+0000","last_clean":"2023-08-10T10:30:39.983698+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:30:39.983698+0000","last_undegraded":"2023-08-10T10:30:39.983698+0000","last_fullsized":"2023-08-10T10:30:39.983698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983097+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:30:39.983097+0000","last_peered":"2023-08-10T10:30:39.983097+0000","last_clean":"2023-08-10T10:30:39.983097+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:30:39.983097+0000","last_undegraded":"2023-08-10T10:30:39.983097+0000","last_fullsized":"2023-08-10T10:30:39.983097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369182+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:30:39.369182+0000","last_peered":"2023-08-10T10:30:39.369182+0000","last_clean":"2023-08-10T10:30:39.369182+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:30:39.369182+0000","last_undegraded":"2023-08-10T10:30:39.369182+0000","last_fullsized":"2023-08-10T10:30:39.369182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:12.307358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983784+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:30:39.983784+0000","last_peered":"2023-08-10T10:30:39.983784+0000","last_clean":"2023-08-10T10:30:39.983784+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:30:39.983784+0000","last_undegraded":"2023-08-10T10:30:39.983784+0000","last_fullsized":"2023-08-10T10:30:39.983784+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:37:20.631743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371024+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:30:39.371024+0000","last_peered":"2023-08-10T10:30:39.371024+0000","last_clean":"2023-08-10T10:30:39.371024+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:30:39.371024+0000","last_undegraded":"2023-08-10T10:30:39.371024+0000","last_fullsized":"2023-08-10T10:30:39.371024+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:47:42.367582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872669+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:30:39.872669+0000","last_peered":"2023-08-10T10:30:39.872669+0000","last_clean":"2023-08-10T10:30:39.872669+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:30:39.872669+0000","last_undegraded":"2023-08-10T10:30:39.872669+0000","last_fullsized":"2023-08-10T10:30:39.872669+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:25:17.299952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983630+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:30:39.983630+0000","last_peered":"2023-08-10T10:30:39.983630+0000","last_clean":"2023-08-10T10:30:39.983630+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:30:39.983630+0000","last_undegraded":"2023-08-10T10:30:39.983630+0000","last_fullsized":"2023-08-10T10:30:39.983630+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:17:25.597861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370188+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:30:39.370188+0000","last_peered":"2023-08-10T10:30:39.370188+0000","last_clean":"2023-08-10T10:30:39.370188+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:30:39.370188+0000","last_undegraded":"2023-08-10T10:30:39.370188+0000","last_fullsized":"2023-08-10T10:30:39.370188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:46.308677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983978+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:30:39.983978+0000","last_peered":"2023-08-10T10:30:39.983978+0000","last_clean":"2023-08-10T10:30:39.983978+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:30:39.983978+0000","last_undegraded":"2023-08-10T10:30:39.983978+0000","last_fullsized":"2023-08-10T10:30:39.983978+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:54.599910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370824+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:30:39.370824+0000","last_peered":"2023-08-10T10:30:39.370824+0000","last_clean":"2023-08-10T10:30:39.370824+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:30:39.370824+0000","last_undegraded":"2023-08-10T10:30:39.370824+0000","last_fullsized":"2023-08-10T10:30:39.370824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:45.246627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370711+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:30:39.370711+0000","last_peered":"2023-08-10T10:30:39.370711+0000","last_clean":"2023-08-10T10:30:39.370711+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:30:39.370711+0000","last_undegraded":"2023-08-10T10:30:39.370711+0000","last_fullsized":"2023-08-10T10:30:39.370711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370373+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:30:39.370373+0000","last_peered":"2023-08-10T10:30:39.370373+0000","last_clean":"2023-08-10T10:30:39.370373+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:30:39.370373+0000","last_undegraded":"2023-08-10T10:30:39.370373+0000","last_fullsized":"2023-08-10T10:30:39.370373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:12.750535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982981+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:30:39.982981+0000","last_peered":"2023-08-10T10:30:39.982981+0000","last_clean":"2023-08-10T10:30:39.982981+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:30:39.982981+0000","last_undegraded":"2023-08-10T10:30:39.982981+0000","last_fullsized":"2023-08-10T10:30:39.982981+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873270+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:30:39.873270+0000","last_peered":"2023-08-10T10:30:39.873270+0000","last_clean":"2023-08-10T10:30:39.873270+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:30:39.873270+0000","last_undegraded":"2023-08-10T10:30:39.873270+0000","last_fullsized":"2023-08-10T10:30:39.873270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982968+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:30:39.982968+0000","last_peered":"2023-08-10T10:30:39.982968+0000","last_clean":"2023-08-10T10:30:39.982968+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:30:39.982968+0000","last_undegraded":"2023-08-10T10:30:39.982968+0000","last_fullsized":"2023-08-10T10:30:39.982968+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:15.125661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872875+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:30:39.872875+0000","last_peered":"2023-08-10T10:30:39.872875+0000","last_clean":"2023-08-10T10:30:39.872875+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:30:39.872875+0000","last_undegraded":"2023-08-10T10:30:39.872875+0000","last_fullsized":"2023-08-10T10:30:39.872875+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984191+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:30:39.984191+0000","last_peered":"2023-08-10T10:30:39.984191+0000","last_clean":"2023-08-10T10:30:39.984191+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:30:39.984191+0000","last_undegraded":"2023-08-10T10:30:39.984191+0000","last_fullsized":"2023-08-10T10:30:39.984191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872443+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:30:39.872443+0000","last_peered":"2023-08-10T10:30:39.872443+0000","last_clean":"2023-08-10T10:30:39.872443+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:30:39.872443+0000","last_undegraded":"2023-08-10T10:30:39.872443+0000","last_fullsized":"2023-08-10T10:30:39.872443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:48:22.886580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982829+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:30:39.982829+0000","last_peered":"2023-08-10T10:30:39.982829+0000","last_clean":"2023-08-10T10:30:39.982829+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:30:39.982829+0000","last_undegraded":"2023-08-10T10:30:39.982829+0000","last_fullsized":"2023-08-10T10:30:39.982829+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983219+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:30:39.983219+0000","last_peered":"2023-08-10T10:30:39.983219+0000","last_clean":"2023-08-10T10:30:39.983219+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:30:39.983219+0000","last_undegraded":"2023-08-10T10:30:39.983219+0000","last_fullsized":"2023-08-10T10:30:39.983219+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:00.831050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371933+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:30:39.371933+0000","last_peered":"2023-08-10T10:30:39.371933+0000","last_clean":"2023-08-10T10:30:39.371933+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:30:39.371933+0000","last_undegraded":"2023-08-10T10:30:39.371933+0000","last_fullsized":"2023-08-10T10:30:39.371933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:13.886565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872839+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:30:39.872839+0000","last_peered":"2023-08-10T10:30:39.872839+0000","last_clean":"2023-08-10T10:30:39.872839+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:30:39.872839+0000","last_undegraded":"2023-08-10T10:30:39.872839+0000","last_fullsized":"2023-08-10T10:30:39.872839+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:25:15.920192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369614+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:30:39.369614+0000","last_peered":"2023-08-10T10:30:39.369614+0000","last_clean":"2023-08-10T10:30:39.369614+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:30:39.369614+0000","last_undegraded":"2023-08-10T10:30:39.369614+0000","last_fullsized":"2023-08-10T10:30:39.369614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:19:31.264771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.368880+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:30:39.368880+0000","last_peered":"2023-08-10T10:30:39.368880+0000","last_clean":"2023-08-10T10:30:39.368880+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:30:39.368880+0000","last_undegraded":"2023-08-10T10:30:39.368880+0000","last_fullsized":"2023-08-10T10:30:39.368880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.879507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872450+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:30:39.872450+0000","last_peered":"2023-08-10T10:30:39.872450+0000","last_clean":"2023-08-10T10:30:39.872450+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:30:39.872450+0000","last_undegraded":"2023-08-10T10:30:39.872450+0000","last_fullsized":"2023-08-10T10:30:39.872450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:03:27.225030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873190+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:30:39.873190+0000","last_peered":"2023-08-10T10:30:39.873190+0000","last_clean":"2023-08-10T10:30:39.873190+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:30:39.873190+0000","last_undegraded":"2023-08-10T10:30:39.873190+0000","last_fullsized":"2023-08-10T10:30:39.873190+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:31:54.291463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370168+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:30:39.370168+0000","last_peered":"2023-08-10T10:30:39.370168+0000","last_clean":"2023-08-10T10:30:39.370168+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:30:39.370168+0000","last_undegraded":"2023-08-10T10:30:39.370168+0000","last_fullsized":"2023-08-10T10:30:39.370168+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:08.726944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983289+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:30:39.983289+0000","last_peered":"2023-08-10T10:30:39.983289+0000","last_clean":"2023-08-10T10:30:39.983289+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:30:39.983289+0000","last_undegraded":"2023-08-10T10:30:39.983289+0000","last_fullsized":"2023-08-10T10:30:39.983289+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:52:59.872554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370088+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:30:39.370088+0000","last_peered":"2023-08-10T10:30:39.370088+0000","last_clean":"2023-08-10T10:30:39.370088+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:30:39.370088+0000","last_undegraded":"2023-08-10T10:30:39.370088+0000","last_fullsized":"2023-08-10T10:30:39.370088+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:03:57.539627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983688+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:30:39.983688+0000","last_peered":"2023-08-10T10:30:39.983688+0000","last_clean":"2023-08-10T10:30:39.983688+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:30:39.983688+0000","last_undegraded":"2023-08-10T10:30:39.983688+0000","last_fullsized":"2023-08-10T10:30:39.983688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:59:24.625409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983836+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:30:39.983836+0000","last_peered":"2023-08-10T10:30:39.983836+0000","last_clean":"2023-08-10T10:30:39.983836+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:30:39.983836+0000","last_undegraded":"2023-08-10T10:30:39.983836+0000","last_fullsized":"2023-08-10T10:30:39.983836+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:19:55.787159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983619+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:30:39.983619+0000","last_peered":"2023-08-10T10:30:39.983619+0000","last_clean":"2023-08-10T10:30:39.983619+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:30:39.983619+0000","last_undegraded":"2023-08-10T10:30:39.983619+0000","last_fullsized":"2023-08-10T10:30:39.983619+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:19.843264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370678+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:30:39.370678+0000","last_peered":"2023-08-10T10:30:39.370678+0000","last_clean":"2023-08-10T10:30:39.370678+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:30:39.370678+0000","last_undegraded":"2023-08-10T10:30:39.370678+0000","last_fullsized":"2023-08-10T10:30:39.370678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:27:18.355230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982478+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:30:39.982478+0000","last_peered":"2023-08-10T10:30:39.982478+0000","last_clean":"2023-08-10T10:30:39.982478+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:30:39.982478+0000","last_undegraded":"2023-08-10T10:30:39.982478+0000","last_fullsized":"2023-08-10T10:30:39.982478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:02.723294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982630+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:30:39.982630+0000","last_peered":"2023-08-10T10:30:39.982630+0000","last_clean":"2023-08-10T10:30:39.982630+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:30:39.982630+0000","last_undegraded":"2023-08-10T10:30:39.982630+0000","last_fullsized":"2023-08-10T10:30:39.982630+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:30:42.215831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984052+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:30:39.984052+0000","last_peered":"2023-08-10T10:30:39.984052+0000","last_clean":"2023-08-10T10:30:39.984052+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:30:39.984052+0000","last_undegraded":"2023-08-10T10:30:39.984052+0000","last_fullsized":"2023-08-10T10:30:39.984052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:52:59.078823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371781+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:30:39.371781+0000","last_peered":"2023-08-10T10:30:39.371781+0000","last_clean":"2023-08-10T10:30:39.371781+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:30:39.371781+0000","last_undegraded":"2023-08-10T10:30:39.371781+0000","last_fullsized":"2023-08-10T10:30:39.371781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:01:06.350134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873008+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:30:39.873008+0000","last_peered":"2023-08-10T10:30:39.873008+0000","last_clean":"2023-08-10T10:30:39.873008+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:30:39.873008+0000","last_undegraded":"2023-08-10T10:30:39.873008+0000","last_fullsized":"2023-08-10T10:30:39.873008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:02:33.128033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983910+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:30:39.983910+0000","last_peered":"2023-08-10T10:30:39.983910+0000","last_clean":"2023-08-10T10:30:39.983910+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:30:39.983910+0000","last_undegraded":"2023-08-10T10:30:39.983910+0000","last_fullsized":"2023-08-10T10:30:39.983910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:47:49.705279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371390+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:30:39.371390+0000","last_peered":"2023-08-10T10:30:39.371390+0000","last_clean":"2023-08-10T10:30:39.371390+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:30:39.371390+0000","last_undegraded":"2023-08-10T10:30:39.371390+0000","last_fullsized":"2023-08-10T10:30:39.371390+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:11.417490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984167+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:30:39.984167+0000","last_peered":"2023-08-10T10:30:39.984167+0000","last_clean":"2023-08-10T10:30:39.984167+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:30:39.984167+0000","last_undegraded":"2023-08-10T10:30:39.984167+0000","last_fullsized":"2023-08-10T10:30:39.984167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:51:55.653411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873193+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:30:39.873193+0000","last_peered":"2023-08-10T10:30:39.873193+0000","last_clean":"2023-08-10T10:30:39.873193+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:30:39.873193+0000","last_undegraded":"2023-08-10T10:30:39.873193+0000","last_fullsized":"2023-08-10T10:30:39.873193+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:44.518583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982243+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:30:39.982243+0000","last_peered":"2023-08-10T10:30:39.982243+0000","last_clean":"2023-08-10T10:30:39.982243+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:30:39.982243+0000","last_undegraded":"2023-08-10T10:30:39.982243+0000","last_fullsized":"2023-08-10T10:30:39.982243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:15.788481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982179+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:30:39.982179+0000","last_peered":"2023-08-10T10:30:39.982179+0000","last_clean":"2023-08-10T10:30:39.982179+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:30:39.982179+0000","last_undegraded":"2023-08-10T10:30:39.982179+0000","last_fullsized":"2023-08-10T10:30:39.982179+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983789+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:30:39.983789+0000","last_peered":"2023-08-10T10:30:39.983789+0000","last_clean":"2023-08-10T10:30:39.983789+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:30:39.983789+0000","last_undegraded":"2023-08-10T10:30:39.983789+0000","last_fullsized":"2023-08-10T10:30:39.983789+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:50:24.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"26'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.982789+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:30:39.982789+0000","last_peered":"2023-08-10T10:30:39.982789+0000","last_clean":"2023-08-10T10:30:39.982789+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:30:39.982789+0000","last_undegraded":"2023-08-10T10:30:39.982789+0000","last_fullsized":"2023-08-10T10:30:39.982789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:53:04.892422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370966+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:30:39.370966+0000","last_peered":"2023-08-10T10:30:39.370966+0000","last_clean":"2023-08-10T10:30:39.370966+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:30:39.370966+0000","last_undegraded":"2023-08-10T10:30:39.370966+0000","last_fullsized":"2023-08-10T10:30:39.370966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:17:05.482062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872971+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:30:39.872971+0000","last_peered":"2023-08-10T10:30:39.872971+0000","last_clean":"2023-08-10T10:30:39.872971+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:30:39.872971+0000","last_undegraded":"2023-08-10T10:30:39.872971+0000","last_fullsized":"2023-08-10T10:30:39.872971+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983288+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:30:39.983288+0000","last_peered":"2023-08-10T10:30:39.983288+0000","last_clean":"2023-08-10T10:30:39.983288+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:30:39.983288+0000","last_undegraded":"2023-08-10T10:30:39.983288+0000","last_fullsized":"2023-08-10T10:30:39.983288+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.369221+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:30:39.369221+0000","last_peered":"2023-08-10T10:30:39.369221+0000","last_clean":"2023-08-10T10:30:39.369221+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:30:39.369221+0000","last_undegraded":"2023-08-10T10:30:39.369221+0000","last_fullsized":"2023-08-10T10:30:39.369221+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:55:31.891569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370491+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:30:39.370491+0000","last_peered":"2023-08-10T10:30:39.370491+0000","last_clean":"2023-08-10T10:30:39.370491+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:30:39.370491+0000","last_undegraded":"2023-08-10T10:30:39.370491+0000","last_fullsized":"2023-08-10T10:30:39.370491+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:10.912377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983827+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:30:39.983827+0000","last_peered":"2023-08-10T10:30:39.983827+0000","last_clean":"2023-08-10T10:30:39.983827+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:30:39.983827+0000","last_undegraded":"2023-08-10T10:30:39.983827+0000","last_fullsized":"2023-08-10T10:30:39.983827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:13:03.665485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.372064+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:30:39.372064+0000","last_peered":"2023-08-10T10:30:39.372064+0000","last_clean":"2023-08-10T10:30:39.372064+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:30:39.372064+0000","last_undegraded":"2023-08-10T10:30:39.372064+0000","last_fullsized":"2023-08-10T10:30:39.372064+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983306+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:30:39.983306+0000","last_peered":"2023-08-10T10:30:39.983306+0000","last_clean":"2023-08-10T10:30:39.983306+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:30:39.983306+0000","last_undegraded":"2023-08-10T10:30:39.983306+0000","last_fullsized":"2023-08-10T10:30:39.983306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:46:24.565717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":23,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984069+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:30:39.984069+0000","last_peered":"2023-08-10T10:30:39.984069+0000","last_clean":"2023-08-10T10:30:39.984069+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:30:39.984069+0000","last_undegraded":"2023-08-10T10:30:39.984069+0000","last_fullsized":"2023-08-10T10:30:39.984069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:26.030825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370682+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:30:39.370682+0000","last_peered":"2023-08-10T10:30:39.370682+0000","last_clean":"2023-08-10T10:30:39.370682+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:30:39.370682+0000","last_undegraded":"2023-08-10T10:30:39.370682+0000","last_fullsized":"2023-08-10T10:30:39.370682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370384+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:30:39.370384+0000","last_peered":"2023-08-10T10:30:39.370384+0000","last_clean":"2023-08-10T10:30:39.370384+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:30:39.370384+0000","last_undegraded":"2023-08-10T10:30:39.370384+0000","last_fullsized":"2023-08-10T10:30:39.370384+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":22,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983703+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:30:39.983703+0000","last_peered":"2023-08-10T10:30:39.983703+0000","last_clean":"2023-08-10T10:30:39.983703+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:30:39.983703+0000","last_undegraded":"2023-08-10T10:30:39.983703+0000","last_fullsized":"2023-08-10T10:30:39.983703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:56:42.630229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983297+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:30:39.983297+0000","last_peered":"2023-08-10T10:30:39.983297+0000","last_clean":"2023-08-10T10:30:39.983297+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:30:39.983297+0000","last_undegraded":"2023-08-10T10:30:39.983297+0000","last_fullsized":"2023-08-10T10:30:39.983297+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:46:27.037502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.872672+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:30:39.872672+0000","last_peered":"2023-08-10T10:30:39.872672+0000","last_clean":"2023-08-10T10:30:39.872672+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:30:39.872672+0000","last_undegraded":"2023-08-10T10:30:39.872672+0000","last_fullsized":"2023-08-10T10:30:39.872672+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:07.784753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983138+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:30:39.983138+0000","last_peered":"2023-08-10T10:30:39.983138+0000","last_clean":"2023-08-10T10:30:39.983138+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:30:39.983138+0000","last_undegraded":"2023-08-10T10:30:39.983138+0000","last_fullsized":"2023-08-10T10:30:39.983138+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:55:49.538451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.370654+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:30:39.370654+0000","last_peered":"2023-08-10T10:30:39.370654+0000","last_clean":"2023-08-10T10:30:39.370654+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:30:39.370654+0000","last_undegraded":"2023-08-10T10:30:39.370654+0000","last_fullsized":"2023-08-10T10:30:39.370654+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.984216+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:30:39.984216+0000","last_peered":"2023-08-10T10:30:39.984216+0000","last_clean":"2023-08-10T10:30:39.984216+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:30:39.984216+0000","last_undegraded":"2023-08-10T10:30:39.984216+0000","last_fullsized":"2023-08-10T10:30:39.984216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:58:25.947292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983467+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:30:39.983467+0000","last_peered":"2023-08-10T10:30:39.983467+0000","last_clean":"2023-08-10T10:30:39.983467+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:30:39.983467+0000","last_undegraded":"2023-08-10T10:30:39.983467+0000","last_fullsized":"2023-08-10T10:30:39.983467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:24:06.857595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.371344+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:30:39.371344+0000","last_peered":"2023-08-10T10:30:39.371344+0000","last_clean":"2023-08-10T10:30:39.371344+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:30:39.371344+0000","last_undegraded":"2023-08-10T10:30:39.371344+0000","last_fullsized":"2023-08-10T10:30:39.371344+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:21.149063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.983858+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:30:39.983858+0000","last_peered":"2023-08-10T10:30:39.983858+0000","last_clean":"2023-08-10T10:30:39.983858+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:30:39.983858+0000","last_undegraded":"2023-08-10T10:30:39.983858+0000","last_fullsized":"2023-08-10T10:30:39.983858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:21:35.195541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-08-10T10:30:39.873013+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:30:39.873013+0000","last_peered":"2023-08-10T10:30:39.873013+0000","last_clean":"2023-08-10T10:30:39.873013+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:30:39.873013+0000","last_undegraded":"2023-08-10T10:30:39.873013+0000","last_fullsized":"2023-08-10T10:30:39.873013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:04:11.070878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":4592,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343932,"statfs":{"total":96636764160,"available":96608186368,"internally_reserved":0,"allocated":913408,"data_stored":714279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":709832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":290816,"data_stored":119901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7110000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.659}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":119991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27320,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344520,"statfs":{"total":96636764160,"available":96608788480,"internally_reserved":0,"allocated":311296,"data_stored":123751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574859,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":120553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":3850,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":4010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:31:03.036 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-10T10:31:03.037 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-10T10:31:03.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-10T10:31:03.038 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-10T10:31:03.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.261+0000 7fb01fdff700 1 Processor -- start 2023-08-10T10:31:03.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.261+0000 7fb01fdff700 1 -- start start 2023-08-10T10:31:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01fdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb01815cf20 0x7fb01815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01fdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb0180b5210 0x7fb0180d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01fdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01815e590 con 0x7fb0180b8870 2023-08-10T10:31:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01fdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180cde30 con 0x7fb01815cf20 2023-08-10T10:31:03.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01fdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0180b8e30 con 0x7fb0180b5210 2023-08-10T10:31:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.262+0000 7fb01db9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb01815cf20 0x7fb01815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb01815cf20 0x7fb01815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50392/0 (socket says 172.21.15.88:50392) 2023-08-10T10:31:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 -- 172.21.15.88:0/3959391344 learned_addr learned my addr 172.21.15.88:0/3959391344 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:03.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01e39c700 1 --2- 172.21.15.88:0/3959391344 >> v2:172.21.15.187:3300/0 conn(0x7fb0180b5210 0x7fb0180d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 -- 172.21.15.88:0/3959391344 >> v2:172.21.15.187:3300/0 conn(0x7fb0180b5210 msgr2=0x7fb0180d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 --2- 172.21.15.88:0/3959391344 >> v2:172.21.15.187:3300/0 conn(0x7fb0180b5210 0x7fb0180d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 -- 172.21.15.88:0/3959391344 >> v1:172.21.15.187:6789/0 conn(0x7fb0180b8870 legacy=0x7fb0180b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 -- 172.21.15.88:0/3959391344 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180ce010 con 0x7fb01815cf20 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01db9b700 1 --2- 172.21.15.88:0/3959391344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb01815cf20 0x7fb01815e050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0180cd840 tx=0x7fb014009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9519b0a53f0c0d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01cb99700 1 -- 172.21.15.88:0/3959391344 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014011830 con 0x7fb01815cf20 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01cb99700 1 -- 172.21.15.88:0/3959391344 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb014011990 con 0x7fb01815cf20 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.263+0000 7fb01cb99700 1 -- 172.21.15.88:0/3959391344 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014011d20 con 0x7fb01815cf20 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 -- 172.21.15.88:0/3959391344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb01815cf20 msgr2=0x7fb01815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 --2- 172.21.15.88:0/3959391344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb01815cf20 0x7fb01815e050 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb0180cd840 tx=0x7fb014009bd0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 -- 172.21.15.88:0/3959391344 shutdown_connections 2023-08-10T10:31:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 --2- 172.21.15.88:0/3959391344 >> v2:172.21.15.187:3300/0 conn(0x7fb0180b5210 0x7fb0180d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 --2- 172.21.15.88:0/3959391344 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb01815cf20 0x7fb01815e050 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 -- 172.21.15.88:0/3959391344 >> 172.21.15.88:0/3959391344 conn(0x7fb0180d3080 msgr2=0x7fb0180d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 -- 172.21.15.88:0/3959391344 shutdown_connections 2023-08-10T10:31:03.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.264+0000 7fb01fdff700 1 -- 172.21.15.88:0/3959391344 wait complete. 2023-08-10T10:31:03.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.266+0000 7fb01fdff700 1 Processor -- start 2023-08-10T10:31:03.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.266+0000 7fb01fdff700 1 -- start start 2023-08-10T10:31:03.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0180b5210 0x7fb01814c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01815cf20 0x7fb0180c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180c8ca0 con 0x7fb0180b8870 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180cbbc0 con 0x7fb0180b5210 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01fdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0180c80b0 con 0x7fb01815cf20 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50400/0 (socket says 172.21.15.88:50400) 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 -- 172.21.15.88:0/2436326777 learned_addr learned my addr 172.21.15.88:0/2436326777 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01db9b700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0180b5210 0x7fb01814c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01e39c700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01815cf20 0x7fb0180c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 -- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01815cf20 msgr2=0x7fb0180c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01815cf20 0x7fb0180c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 -- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0180b5210 msgr2=0x7fb01814c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0180b5210 0x7fb01814c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.267+0000 7fb01d39a700 1 -- 172.21.15.88:0/2436326777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009550 con 0x7fb0180b8870 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb01d39a700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c4e0 tx=0x7fb00800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080052d0 con 0x7fb0180b8870 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb008005430 con 0x7fb0180b8870 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0080038c0 con 0x7fb0180b8870 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01814c9f0 con 0x7fb0180b8870 2023-08-10T10:31:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.268+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0180c8300 con 0x7fb0180b8870 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.269+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01804ecc0 con 0x7fb0180b8870 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.270+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fb008003a20 con 0x7fb0180b8870 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.271+0000 7fb00e7fc700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 0x7faffc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.271+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fb008088bb0 con 0x7fb0180b8870 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.271+0000 7fb01db9b700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 0x7faffc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.272+0000 7fb01db9b700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 0x7faffc06d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb014009840 tx=0x7fb014008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.275+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fb0080538d0 con 0x7fb0180b8870 2023-08-10T10:31:03.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.510+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb01815fc60 con 0x7fb0180b8870 2023-08-10T10:31:03.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.510+0000 7fb00e7fc700 1 -- 172.21.15.88:0/2436326777 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fb008056ef0 con 0x7fb0180b8870 2023-08-10T10:31:03.512 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:03.512 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-10T10:31:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 msgr2=0x7faffc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 0x7faffc06d1a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb014009840 tx=0x7fb014008030 comp rx=0 tx=0).stop 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 msgr2=0x7fb01814cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c4e0 tx=0x7fb00800c7f0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 shutdown_connections 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7faffc06ace0 0x7faffc06d1a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01815cf20 0x7fb0180c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0180b5210 0x7fb01814c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 --2- 172.21.15.88:0/2436326777 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0180b8870 0x7fb01814cde0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 >> 172.21.15.88:0/2436326777 conn(0x7fb0180d3080 msgr2=0x7fb018160040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:03.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 shutdown_connections 2023-08-10T10:31:03.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.513+0000 7fb01fdff700 1 -- 172.21.15.88:0/2436326777 wait complete. 2023-08-10T10:31:03.532 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-10T10:31:03.533 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:31:03.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.726+0000 7f15323ff700 1 Processor -- start 2023-08-10T10:31:03.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.726+0000 7f15323ff700 1 -- start start 2023-08-10T10:31:03.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f15323ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f152c0b5210 0x7f152c167c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f15323ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0b8e30 con 0x7f152c15cf20 2023-08-10T10:31:03.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f15323ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f152c0ce010 con 0x7f152c0b8870 2023-08-10T10:31:03.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f15323ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f152c0cde30 con 0x7f152c0b5210 2023-08-10T10:31:03.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f152bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f152c15cf20 0x7f152c15e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58014/0 (socket says 172.21.15.88:58014) 2023-08-10T10:31:03.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f152bfff700 1 -- 172.21.15.88:0/3211970513 learned_addr learned my addr 172.21.15.88:0/3211970513 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:03.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f153099c700 1 --2- 172.21.15.88:0/3211970513 >> v2:172.21.15.88:3300/0 conn(0x7f152c0b5210 0x7f152c167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f152b7fe700 1 -- 172.21.15.88:0/3211970513 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010831842 0 0) 0x7f152c0b8e30 con 0x7f152c15cf20 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f152b7fe700 1 -- 172.21.15.88:0/3211970513 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15180035b0 con 0x7f152c15cf20 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f153099c700 1 -- 172.21.15.88:0/3211970513 >> v1:172.21.15.187:6789/0 conn(0x7f152c0b8870 legacy=0x7f152c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f153099c700 1 -- 172.21.15.88:0/3211970513 >> v1:172.21.15.88:6789/0 conn(0x7f152c15cf20 legacy=0x7f152c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.728+0000 7f153099c700 1 -- 172.21.15.88:0/3211970513 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152c0ce2f0 con 0x7f152c0b5210 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f153099c700 1 --2- 172.21.15.88:0/3211970513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b5210 0x7f152c167c00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1524009d90 tx=0x7f152400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2709c17d4707d3a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f152b7fe700 1 -- 172.21.15.88:0/3211970513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400e070 con 0x7f152c0b5210 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f152b7fe700 1 -- 172.21.15.88:0/3211970513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152400bb20 con 0x7f152c0b5210 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f152b7fe700 1 -- 172.21.15.88:0/3211970513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1524012430 con 0x7f152c0b5210 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f15323ff700 1 -- 172.21.15.88:0/3211970513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b5210 msgr2=0x7f152c167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.729+0000 7f15323ff700 1 --2- 172.21.15.88:0/3211970513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b5210 0x7f152c167c00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1524009d90 tx=0x7f152400b330 comp rx=0 tx=0).stop 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.730+0000 7f15323ff700 1 -- 172.21.15.88:0/3211970513 shutdown_connections 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.730+0000 7f15323ff700 1 --2- 172.21.15.88:0/3211970513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b5210 0x7f152c167c00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.730+0000 7f15323ff700 1 -- 172.21.15.88:0/3211970513 >> 172.21.15.88:0/3211970513 conn(0x7f152c0d3080 msgr2=0x7f152c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:03.733 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.730+0000 7f15323ff700 1 -- 172.21.15.88:0/3211970513 shutdown_connections 2023-08-10T10:31:03.734 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.730+0000 7f15323ff700 1 -- 172.21.15.88:0/3211970513 wait complete. 2023-08-10T10:31:03.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.731+0000 7f15323ff700 1 Processor -- start 2023-08-10T10:31:03.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.731+0000 7f15323ff700 1 -- start start 2023-08-10T10:31:03.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f152c0b5210 0x7f152c1f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f152c15cf20 0x7f152c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1f28d0 con 0x7f152c0b8870 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1f2ae0 con 0x7f152c0b5210 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.732+0000 7f15323ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1f2dc0 con 0x7f152c15cf20 2023-08-10T10:31:03.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f152bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f152c0b5210 0x7f152c1f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50424/0 (socket says 172.21.15.88:50424) 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 -- 172.21.15.88:0/2864506694 learned_addr learned my addr 172.21.15.88:0/2864506694 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f153099c700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f152c15cf20 0x7f152c158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 -- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f152c15cf20 msgr2=0x7f152c158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f152c15cf20 0x7f152c158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 -- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f152c0b5210 msgr2=0x7f152c1f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.737 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f152c0b5210 0x7f152c1f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 -- 172.21.15.88:0/2864506694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009a70 con 0x7f152c0b8870 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.733+0000 7f1523fff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f151400c4e0 tx=0x7f151400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.734+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140052d0 con 0x7f152c0b8870 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.734+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1514005430 con 0x7f152c0b8870 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.734+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c1f30a0 con 0x7f152c0b8870 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.734+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140038c0 con 0x7f152c0b8870 2023-08-10T10:31:03.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.734+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c1f3660 con 0x7f152c0b8870 2023-08-10T10:31:03.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.735+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f152c04ecc0 con 0x7f152c0b8870 2023-08-10T10:31:03.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.736+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1514003a20 con 0x7f152c0b8870 2023-08-10T10:31:03.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.736+0000 7f15297fa700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 0x7f150c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:03.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.737+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f1514088bb0 con 0x7f152c0b8870 2023-08-10T10:31:03.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.737+0000 7f152bfff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 0x7f150c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:03.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.737+0000 7f152bfff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 0x7f150c06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:03.742 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.741+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f15140538d0 con 0x7f152c0b8870 2023-08-10T10:31:03.938 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.937+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f152c0d2b70 con 0x7f152c0b8870 2023-08-10T10:31:03.939 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.938+0000 7f15297fa700 1 -- 172.21.15.88:0/2864506694 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f1514056ef0 con 0x7f152c0b8870 2023-08-10T10:31:03.940 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:03.940 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:31:03.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 msgr2=0x7f150c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 0x7f150c06d1a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f151c007fd0 tx=0x7f151c007dc0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 msgr2=0x7f152c156a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f151400c4e0 tx=0x7f151400c7f0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 shutdown_connections 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f150c06ace0 0x7f150c06d1a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f152c15cf20 0x7f152c158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f152c0b5210 0x7f152c1f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 --2- 172.21.15.88:0/2864506694 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f152c0b8870 0x7f152c156a00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:03.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 >> 172.21.15.88:0/2864506694 conn(0x7f152c0d3080 msgr2=0x7f152c0b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:03.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 shutdown_connections 2023-08-10T10:31:03.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:03.941+0000 7f15323ff700 1 -- 172.21.15.88:0/2864506694 wait complete. 2023-08-10T10:31:03.960 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:31:03.961 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:31:04.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.159+0000 7f033f3ff700 1 Processor -- start 2023-08-10T10:31:04.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.159+0000 7f033f3ff700 1 -- start start 2023-08-10T10:31:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033f3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f033815d1e0 0x7f03380d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033f3ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f03380d1060 0x7f03380b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033f3ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03380b52a0 con 0x7f03380b4e90 2023-08-10T10:31:04.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033f3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f033815d5c0 con 0x7f033815d1e0 2023-08-10T10:31:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033f3ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03380d1840 con 0x7f03380d1060 2023-08-10T10:31:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033d99c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f03380b4e90 0x7f03380b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58022/0 (socket says 172.21.15.88:58022) 2023-08-10T10:31:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033d19b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f033815d1e0 0x7f03380d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.160+0000 7f033d99c700 1 -- 172.21.15.88:0/3184026082 learned_addr learned my addr 172.21.15.88:0/3184026082 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:04.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033c99a700 1 --2- 172.21.15.88:0/3184026082 >> v2:172.21.15.187:3300/0 conn(0x7f03380d1060 0x7f03380b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033d19b700 1 -- 172.21.15.88:0/3184026082 >> v2:172.21.15.187:3300/0 conn(0x7f03380d1060 msgr2=0x7f03380b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f032ffff700 1 -- 172.21.15.88:0/3184026082 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 942548447 0 0) 0x7f03380b52a0 con 0x7f03380b4e90 2023-08-10T10:31:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033d19b700 1 --2- 172.21.15.88:0/3184026082 >> v2:172.21.15.187:3300/0 conn(0x7f03380d1060 0x7f03380b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033d19b700 1 -- 172.21.15.88:0/3184026082 >> v1:172.21.15.88:6789/0 conn(0x7f03380b4e90 legacy=0x7f03380b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033d19b700 1 -- 172.21.15.88:0/3184026082 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03380d1b20 con 0x7f033815d1e0 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f033d19b700 1 --2- 172.21.15.88:0/3184026082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f033815d1e0 0x7f03380d27a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f03380b8fc0 tx=0x7f0334009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77c5dfbae0eeed7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f032ffff700 1 -- 172.21.15.88:0/3184026082 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011830 con 0x7f033815d1e0 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f032ffff700 1 -- 172.21.15.88:0/3184026082 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0334011990 con 0x7f033815d1e0 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.161+0000 7f032ffff700 1 -- 172.21.15.88:0/3184026082 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0334011d20 con 0x7f033815d1e0 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 -- 172.21.15.88:0/3184026082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f033815d1e0 msgr2=0x7f03380d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 --2- 172.21.15.88:0/3184026082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f033815d1e0 0x7f03380d27a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f03380b8fc0 tx=0x7f0334009b20 comp rx=0 tx=0).stop 2023-08-10T10:31:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 -- 172.21.15.88:0/3184026082 shutdown_connections 2023-08-10T10:31:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 --2- 172.21.15.88:0/3184026082 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f033815d1e0 0x7f03380d27a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 --2- 172.21.15.88:0/3184026082 >> v2:172.21.15.187:3300/0 conn(0x7f03380d1060 0x7f03380b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 -- 172.21.15.88:0/3184026082 >> 172.21.15.88:0/3184026082 conn(0x7f03380cf950 msgr2=0x7f03380cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:04.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 -- 172.21.15.88:0/3184026082 shutdown_connections 2023-08-10T10:31:04.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.162+0000 7f033f3ff700 1 -- 172.21.15.88:0/3184026082 wait complete. 2023-08-10T10:31:04.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.164+0000 7f033f3ff700 1 Processor -- start 2023-08-10T10:31:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.164+0000 7f033f3ff700 1 -- start start 2023-08-10T10:31:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03380b4e90 0x7f03380caff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f033815d1e0 0x7f0338153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cc950 con 0x7f03380d1060 2023-08-10T10:31:04.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cb8b0 con 0x7f033815d1e0 2023-08-10T10:31:04.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033f3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03380cbb90 con 0x7f03380b4e90 2023-08-10T10:31:04.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50442/0 (socket says 172.21.15.88:50442) 2023-08-10T10:31:04.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 -- 172.21.15.88:0/2743973081 learned_addr learned my addr 172.21.15.88:0/2743973081 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:04.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033d19b700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03380b4e90 0x7f03380caff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033d99c700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f033815d1e0 0x7f0338153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 -- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03380b4e90 msgr2=0x7f03380caff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03380b4e90 0x7f03380caff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 -- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f033815d1e0 msgr2=0x7f0338153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f033815d1e0 0x7f0338153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.165+0000 7f033c99a700 1 -- 172.21.15.88:0/2743973081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03340094a0 con 0x7f03380d1060 2023-08-10T10:31:04.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f033c99a700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f032800e810 tx=0x7f032800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328013610 con 0x7f03380d1060 2023-08-10T10:31:04.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0328013770 con 0x7f03380d1060 2023-08-10T10:31:04.176 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0328013b20 con 0x7f03380d1060 2023-08-10T10:31:04.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03380cbe70 con 0x7f03380d1060 2023-08-10T10:31:04.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.166+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03380cc430 con 0x7f03380d1060 2023-08-10T10:31:04.177 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.167+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03380743a0 con 0x7f03380d1060 2023-08-10T10:31:04.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.168+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0328013c80 con 0x7f03380d1060 2023-08-10T10:31:04.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.169+0000 7f032dffb700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 0x7f031c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.169+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f03280894b0 con 0x7f03380d1060 2023-08-10T10:31:04.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.169+0000 7f033d19b700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 0x7f031c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.170+0000 7f033d19b700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 0x7f031c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f03340090b0 tx=0x7f0334008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.173+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0328057c70 con 0x7f03380d1060 2023-08-10T10:31:04.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.370+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f03380cef10 con 0x7f03380d1060 2023-08-10T10:31:04.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.370+0000 7f032dffb700 1 -- 172.21.15.88:0/2743973081 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0328057800 con 0x7f03380d1060 2023-08-10T10:31:04.372 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:31:04.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.372+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 msgr2=0x7f031c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.372+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 0x7f031c06d1a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f03340090b0 tx=0x7f0334008030 comp rx=0 tx=0).stop 2023-08-10T10:31:04.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.372+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 msgr2=0x7f0338152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.372+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f032800e810 tx=0x7f032800eb20 comp rx=0 tx=0).stop 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 shutdown_connections 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f033815d1e0 0x7f0338153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f031c06ace0 0x7f031c06d1a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03380b4e90 0x7f03380caff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 --2- 172.21.15.88:0/2743973081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03380d1060 0x7f0338152d30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 >> 172.21.15.88:0/2743973081 conn(0x7f03380cf950 msgr2=0x7f03380cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:04.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 shutdown_connections 2023-08-10T10:31:04.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.373+0000 7f033f3ff700 1 -- 172.21.15.88:0/2743973081 wait complete. 2023-08-10T10:31:04.392 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:31:04.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.590+0000 7f5fadfff700 1 Processor -- start 2023-08-10T10:31:04.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.591+0000 7f5fadfff700 1 -- start start 2023-08-10T10:31:04.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fadfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa80d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fadfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5fa80d1060 0x7f5fa80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fadfff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa80d1840 con 0x7f5fa80b4e90 2023-08-10T10:31:04.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fadfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa815d5c0 con 0x7f5fa80d1060 2023-08-10T10:31:04.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fadfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa80b5300 con 0x7f5fa815d1e0 2023-08-10T10:31:04.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa7fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5fa80b4e90 0x7f5fa80b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58026/0 (socket says 172.21.15.88:58026) 2023-08-10T10:31:04.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa7fff700 1 -- 172.21.15.88:0/42324731 learned_addr learned my addr 172.21.15.88:0/42324731 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa77fe700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa80d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/42324731 >> v2:172.21.15.187:3300/0 conn(0x7f5fa80d1060 0x7f5fa80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa67fc700 1 -- 172.21.15.88:0/42324731 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 132179372 0 0) 0x7f5fa80d1840 con 0x7f5fa80b4e90 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.592+0000 7f5fa67fc700 1 -- 172.21.15.88:0/42324731 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f900035b0 con 0x7f5fa80b4e90 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 msgr2=0x7f5fa80d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:04.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa80d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/42324731 >> v1:172.21.15.88:6789/0 conn(0x7f5fa80b4e90 legacy=0x7f5fa80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/42324731 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa80d1b20 con 0x7f5fa80d1060 2023-08-10T10:31:04.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80d1060 0x7f5fa80b4950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009870 tx=0x7f5f9c009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cb8b666f2bb9ca5c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa67fc700 1 -- 172.21.15.88:0/42324731 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c011830 con 0x7f5fa80d1060 2023-08-10T10:31:04.597 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa67fc700 1 -- 172.21.15.88:0/42324731 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c011990 con 0x7f5fa80d1060 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.593+0000 7f5fa67fc700 1 -- 172.21.15.88:0/42324731 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c011d20 con 0x7f5fa80d1060 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 -- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80d1060 msgr2=0x7f5fa80b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80d1060 0x7f5fa80b4950 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c009870 tx=0x7f5f9c009b80 comp rx=0 tx=0).stop 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 -- 172.21.15.88:0/42324731 shutdown_connections 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa80d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 --2- 172.21.15.88:0/42324731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80d1060 0x7f5fa80b4950 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 -- 172.21.15.88:0/42324731 >> 172.21.15.88:0/42324731 conn(0x7f5fa80cf950 msgr2=0x7f5fa80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:04.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 -- 172.21.15.88:0/42324731 shutdown_connections 2023-08-10T10:31:04.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.594+0000 7f5fadfff700 1 -- 172.21.15.88:0/42324731 wait complete. 2023-08-10T10:31:04.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.596+0000 7f5fadfff700 1 Processor -- start 2023-08-10T10:31:04.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.596+0000 7f5fadfff700 1 -- start start 2023-08-10T10:31:04.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80b4e90 0x7f5fa81f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa815d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa8144e70 con 0x7f5fa80d1060 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa81f2ef0 con 0x7f5fa80b4e90 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fadfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa81f31d0 con 0x7f5fa815d1e0 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80b4e90 0x7f5fa81f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50444/0 (socket says 172.21.15.88:50444) 2023-08-10T10:31:04.602 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/3109599039 learned_addr learned my addr 172.21.15.88:0/3109599039 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:04.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa7fff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa815d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 msgr2=0x7f5fa815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa815d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80b4e90 msgr2=0x7f5fa81f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.603 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80b4e90 0x7f5fa81f2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa6ffd700 1 -- 172.21.15.88:0/3109599039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0094a0 con 0x7f5fa80d1060 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.598+0000 7f5fa7fff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5fa6ffd700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c000c00 tx=0x7f5f9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c0036a0 con 0x7f5fa80d1060 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c01f070 con 0x7f5fa80d1060 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa81f34b0 con 0x7f5fa80d1060 2023-08-10T10:31:04.604 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c003a60 con 0x7f5fa80d1060 2023-08-10T10:31:04.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.599+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa8154b80 con 0x7f5fa80d1060 2023-08-10T10:31:04.605 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.600+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa8144fe0 con 0x7f5fa80d1060 2023-08-10T10:31:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.601+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5f9c003bc0 con 0x7f5fa80d1060 2023-08-10T10:31:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.602+0000 7f5f8ffff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 0x7f5f9406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.602+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f5f9c021070 con 0x7f5fa80d1060 2023-08-10T10:31:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.602+0000 7f5fa77fe700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 0x7f5f9406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:04.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.603+0000 7f5fa77fe700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 0x7f5f9406d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80c9140 tx=0x7f5f98009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:04.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.606+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5f9c055df0 con 0x7f5fa80d1060 2023-08-10T10:31:04.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.801+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5fa80743a0 con 0x7f5fa80d1060 2023-08-10T10:31:04.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.801+0000 7f5f8ffff700 1 -- 172.21.15.88:0/3109599039 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5f9c0150a0 con 0x7f5fa80d1060 2023-08-10T10:31:04.803 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:31:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.803+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 msgr2=0x7f5f9406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.803+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 0x7f5f9406d1a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5fa80c9140 tx=0x7f5f98009210 comp rx=0 tx=0).stop 2023-08-10T10:31:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.803+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 msgr2=0x7f5fa8154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:04.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.803+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c000c00 tx=0x7f5f9c004750 comp rx=0 tx=0).stop 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 shutdown_connections 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5f9406ace0 0x7f5f9406d1a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fa815d1e0 0x7f5fa815d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fa80b4e90 0x7f5fa81f2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 --2- 172.21.15.88:0/3109599039 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fa80d1060 0x7f5fa8154640 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 >> 172.21.15.88:0/3109599039 conn(0x7f5fa80cf950 msgr2=0x7f5fa80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 shutdown_connections 2023-08-10T10:31:04.806 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:04.804+0000 7f5fadfff700 1 -- 172.21.15.88:0/3109599039 wait complete. 2023-08-10T10:31:04.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:31:05.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.020+0000 7f7f2f5ff700 1 Processor -- start 2023-08-10T10:31:05.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.020+0000 7f7f2f5ff700 1 -- start start 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.021+0000 7f7f2f5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f280d27a0 0x7f7f280b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.021+0000 7f7f2f5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f280b4e90 0x7f7f280b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.021+0000 7f7f2f5ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f280b52e0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.021+0000 7f7f2f5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f280d2c50 con 0x7f7f280d27a0 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.021+0000 7f7f2f5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2815d5c0 con 0x7f7f280b4e90 2023-08-10T10:31:05.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7f280d27a0 0x7f7f280b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2d39b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7f2815d1e0 0x7f7f280d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58038/0 (socket says 172.21.15.88:58038) 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2d39b700 1 -- 172.21.15.88:0/1653241398 learned_addr learned my addr 172.21.15.88:0/1653241398 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2db9c700 1 --2- 172.21.15.88:0/1653241398 >> v2:172.21.15.187:3300/0 conn(0x7f7f280b4e90 0x7f7f280b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 -- 172.21.15.88:0/1653241398 >> v2:172.21.15.187:3300/0 conn(0x7f7f280b4e90 msgr2=0x7f7f280b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 --2- 172.21.15.88:0/1653241398 >> v2:172.21.15.187:3300/0 conn(0x7f7f280b4e90 0x7f7f280b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 -- 172.21.15.88:0/1653241398 >> v1:172.21.15.88:6789/0 conn(0x7f7f2815d1e0 legacy=0x7f7f280d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 -- 172.21.15.88:0/1653241398 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f280d1840 con 0x7f7f280d27a0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f1ffff700 1 -- 172.21.15.88:0/1653241398 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276160880 0 0) 0x7f7f24001110 con 0x7f7f2815d1e0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.022+0000 7f7f2cb9a700 1 --2- 172.21.15.88:0/1653241398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f280d27a0 0x7f7f280b4950 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f280b8fc0 tx=0x7f7f18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c317c00b8e809c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f1ffff700 1 -- 172.21.15.88:0/1653241398 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011830 con 0x7f7f280d27a0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f1ffff700 1 -- 172.21.15.88:0/1653241398 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18011990 con 0x7f7f280d27a0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f1ffff700 1 -- 172.21.15.88:0/1653241398 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011d20 con 0x7f7f280d27a0 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/1653241398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f280d27a0 msgr2=0x7f7f280b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/1653241398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f280d27a0 0x7f7f280b4950 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7f280b8fc0 tx=0x7f7f18009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/1653241398 shutdown_connections 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/1653241398 >> v2:172.21.15.187:3300/0 conn(0x7f7f280b4e90 0x7f7f280b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/1653241398 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f280d27a0 0x7f7f280b4950 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/1653241398 >> 172.21.15.88:0/1653241398 conn(0x7f7f280cf950 msgr2=0x7f7f280cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/1653241398 shutdown_connections 2023-08-10T10:31:05.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.023+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/1653241398 wait complete. 2023-08-10T10:31:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.025+0000 7f7f2f5ff700 1 Processor -- start 2023-08-10T10:31:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.025+0000 7f7f2f5ff700 1 -- start start 2023-08-10T10:31:05.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f280b4e90 0x7f7f281561e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f280d27a0 0x7f7f280c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280caed0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280ca910 con 0x7f7f280d27a0 2023-08-10T10:31:05.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2f5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f280cabf0 con 0x7f7f280b4e90 2023-08-10T10:31:05.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2db9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2db9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50454/0 (socket says 172.21.15.88:50454) 2023-08-10T10:31:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.026+0000 7f7f2db9c700 1 -- 172.21.15.88:0/2008200426 learned_addr learned my addr 172.21.15.88:0/2008200426 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2cb9a700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f280d27a0 0x7f7f280c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2d39b700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f280b4e90 0x7f7f281561e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 -- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f280b4e90 msgr2=0x7f7f281561e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f280b4e90 0x7f7f281561e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 -- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f280d27a0 msgr2=0x7f7f280c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f280d27a0 0x7f7f280c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 -- 172.21.15.88:0/2008200426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f180094a0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2db9c700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000efc0 tx=0x7f7f2000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2000cd40 con 0x7f7f2815d1e0 2023-08-10T10:31:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2000f040 con 0x7f7f2815d1e0 2023-08-10T10:31:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f200146c0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f280cb1e0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.027+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f28156720 con 0x7f7f2815d1e0 2023-08-10T10:31:05.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.028+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f280cb700 con 0x7f7f2815d1e0 2023-08-10T10:31:05.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.029+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f20014820 con 0x7f7f2815d1e0 2023-08-10T10:31:05.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.030+0000 7f7f1dffb700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 0x7f7f0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.030+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7f2008a0e0 con 0x7f7f2815d1e0 2023-08-10T10:31:05.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.030+0000 7f7f2d39b700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 0x7f7f0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.031+0000 7f7f2d39b700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 0x7f7f0c06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000f60 tx=0x7f7f24007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.034+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f280cb700 con 0x7f7f2815d1e0 2023-08-10T10:31:05.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.228+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f280cb700 con 0x7f7f2815d1e0 2023-08-10T10:31:05.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.228+0000 7f7f1dffb700 1 -- 172.21.15.88:0/2008200426 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f280cb700 con 0x7f7f2815d1e0 2023-08-10T10:31:05.230 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:31:05.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 msgr2=0x7f7f0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 0x7f7f0c06d1a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7f24000f60 tx=0x7f7f24007c90 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 msgr2=0x7f7f2815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7f2000efc0 tx=0x7f7f2000c3a0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 shutdown_connections 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f2815d1e0 0x7f7f2815f100 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f0c06ace0 0x7f7f0c06d1a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f280b4e90 0x7f7f281561e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 --2- 172.21.15.88:0/2008200426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f280d27a0 0x7f7f280c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 >> 172.21.15.88:0/2008200426 conn(0x7f7f280cf950 msgr2=0x7f7f280c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:05.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 shutdown_connections 2023-08-10T10:31:05.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.231+0000 7f7f2f5ff700 1 -- 172.21.15.88:0/2008200426 wait complete. 2023-08-10T10:31:05.250 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:31:05.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.449+0000 7fac35dff700 1 Processor -- start 2023-08-10T10:31:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.449+0000 7fac35dff700 1 -- start start 2023-08-10T10:31:05.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.450+0000 7fac35dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac30143810 0x7fac300c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.450+0000 7fac35dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac300c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.450+0000 7fac35dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300c43a0 con 0x7fac300cc6c0 2023-08-10T10:31:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.450+0000 7fac35dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300c4960 con 0x7fac30143810 2023-08-10T10:31:05.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.450+0000 7fac35dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3006e8c0 con 0x7fac3006dca0 2023-08-10T10:31:05.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2effd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fac300cc6c0 0x7fac300cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58054/0 (socket says 172.21.15.88:58054) 2023-08-10T10:31:05.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fac30143810 0x7fac300c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2effd700 1 -- 172.21.15.88:0/3796296628 learned_addr learned my addr 172.21.15.88:0/3796296628 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2ffff700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac300c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 -- 172.21.15.88:0/3796296628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 msgr2=0x7fac300c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac300c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 -- 172.21.15.88:0/3796296628 >> v1:172.21.15.88:6789/0 conn(0x7fac300cc6c0 legacy=0x7fac300cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2e7fc700 1 -- 172.21.15.88:0/3796296628 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919221016 0 0) 0x7fac300c43a0 con 0x7fac300cc6c0 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 -- 172.21.15.88:0/3796296628 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3006eba0 con 0x7fac30143810 2023-08-10T10:31:05.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2f7fe700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac30143810 0x7fac300c4df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac20009840 tx=0x7fac20009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b15bd60f44600c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.451+0000 7fac2e7fc700 1 -- 172.21.15.88:0/3796296628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000f8a0 con 0x7fac30143810 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac2e7fc700 1 -- 172.21.15.88:0/3796296628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000fa00 con 0x7fac30143810 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac2e7fc700 1 -- 172.21.15.88:0/3796296628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2000fd90 con 0x7fac30143810 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 -- 172.21.15.88:0/3796296628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac30143810 msgr2=0x7fac300c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac30143810 0x7fac300c4df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fac20009840 tx=0x7fac20009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:05.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 -- 172.21.15.88:0/3796296628 shutdown_connections 2023-08-10T10:31:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac300c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 --2- 172.21.15.88:0/3796296628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac30143810 0x7fac300c4df0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 -- 172.21.15.88:0/3796296628 >> 172.21.15.88:0/3796296628 conn(0x7fac300cb570 msgr2=0x7fac300cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 -- 172.21.15.88:0/3796296628 shutdown_connections 2023-08-10T10:31:05.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.452+0000 7fac35dff700 1 -- 172.21.15.88:0/3796296628 wait complete. 2023-08-10T10:31:05.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.454+0000 7fac35dff700 1 Processor -- start 2023-08-10T10:31:05.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.455+0000 7fac35dff700 1 -- start start 2023-08-10T10:31:05.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac30136ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac30143810 0x7fac300ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015a530 con 0x7fac300cc6c0 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015a7f0 con 0x7fac30143810 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac35dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac3015aad0 con 0x7fac3006dca0 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac2effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac2f7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac30136ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac2effd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50462/0 (socket says 172.21.15.88:50462) 2023-08-10T10:31:05.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac2effd700 1 -- 172.21.15.88:0/3705347555 learned_addr learned my addr 172.21.15.88:0/3705347555 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:05.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.456+0000 7fac2ffff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac30143810 0x7fac300ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 -- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 msgr2=0x7fac30136ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac30136ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 -- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac30143810 msgr2=0x7fac300ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac30143810 0x7fac300ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 -- 172.21.15.88:0/3705347555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac200094a0 con 0x7fac300cc6c0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac2effd700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c520 tx=0x7fac2400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24004c80 con 0x7fac300cc6c0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac24004de0 con 0x7fac300cc6c0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac3015adb0 con 0x7fac300cc6c0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac240072d0 con 0x7fac300cc6c0 2023-08-10T10:31:05.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.457+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac30137530 con 0x7fac300cc6c0 2023-08-10T10:31:05.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.458+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac301377b0 con 0x7fac300cc6c0 2023-08-10T10:31:05.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.459+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fac24007430 con 0x7fac300cc6c0 2023-08-10T10:31:05.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.460+0000 7fac17fff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 0x7fac1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.460+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fac24089450 con 0x7fac300cc6c0 2023-08-10T10:31:05.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.460+0000 7fac2f7fe700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 0x7fac1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.461+0000 7fac2f7fe700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 0x7fac1c06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac200090b0 tx=0x7fac2001b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.464+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fac24054170 con 0x7fac300cc6c0 2023-08-10T10:31:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.660+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fac300743a0 con 0x7fac300cc6c0 2023-08-10T10:31:05.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.661+0000 7fac17fff700 1 -- 172.21.15.88:0/3705347555 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fac24057790 con 0x7fac300cc6c0 2023-08-10T10:31:05.663 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 msgr2=0x7fac1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 0x7fac1c06d1a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fac200090b0 tx=0x7fac2001b040 comp rx=0 tx=0).stop 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 msgr2=0x7fac300c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fac2400c520 tx=0x7fac2400c830 comp rx=0 tx=0).stop 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 shutdown_connections 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac30143810 0x7fac300ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fac1c06ace0 0x7fac1c06d1a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac3006dca0 0x7fac30136ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 --2- 172.21.15.88:0/3705347555 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fac300cc6c0 0x7fac300c9fd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 >> 172.21.15.88:0/3705347555 conn(0x7fac300cb570 msgr2=0x7fac300af6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 shutdown_connections 2023-08-10T10:31:05.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.663+0000 7fac35dff700 1 -- 172.21.15.88:0/3705347555 wait complete. 2023-08-10T10:31:05.683 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:31:05.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.879+0000 7fa44bbff700 1 Processor -- start 2023-08-10T10:31:05.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.879+0000 7fa44bbff700 1 -- start start 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44bbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa4440d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44bbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4440d1060 0x7fa4440b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44bbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4440d1840 con 0x7fa4440b4e90 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44bbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa44415d5c0 con 0x7fa4440d1060 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44bbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4440b5300 con 0x7fa44415d1e0 2023-08-10T10:31:05.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44919a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4440d1060 0x7fa4440b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44919a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa4440d1060 0x7fa4440b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50466/0 (socket says 172.21.15.88:50466) 2023-08-10T10:31:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.880+0000 7fa44919a700 1 -- 172.21.15.88:0/2182715451 learned_addr learned my addr 172.21.15.88:0/2182715451 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:05.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44999b700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa4440d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44919a700 1 -- 172.21.15.88:0/2182715451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 msgr2=0x7fa4440d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44919a700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa4440d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44919a700 1 -- 172.21.15.88:0/2182715451 >> v1:172.21.15.187:6789/0 conn(0x7fa4440b4e90 legacy=0x7fa4440b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44919a700 1 -- 172.21.15.88:0/2182715451 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4440d1b20 con 0x7fa4440d1060 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa44919a700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440d1060 0x7fa4440b4950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa434009920 tx=0x7fa434009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dc0703f5312ba17 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa448999700 1 -- 172.21.15.88:0/2182715451 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011830 con 0x7fa4440d1060 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa448999700 1 -- 172.21.15.88:0/2182715451 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa434011990 con 0x7fa4440d1060 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.881+0000 7fa448999700 1 -- 172.21.15.88:0/2182715451 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434011d20 con 0x7fa4440d1060 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 -- 172.21.15.88:0/2182715451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440d1060 msgr2=0x7fa4440b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440d1060 0x7fa4440b4950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa434009920 tx=0x7fa434009c30 comp rx=0 tx=0).stop 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 -- 172.21.15.88:0/2182715451 shutdown_connections 2023-08-10T10:31:05.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa4440d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 --2- 172.21.15.88:0/2182715451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440d1060 0x7fa4440b4950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 -- 172.21.15.88:0/2182715451 >> 172.21.15.88:0/2182715451 conn(0x7fa4440cf950 msgr2=0x7fa4440cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 -- 172.21.15.88:0/2182715451 shutdown_connections 2023-08-10T10:31:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.882+0000 7fa44bbff700 1 -- 172.21.15.88:0/2182715451 wait complete. 2023-08-10T10:31:05.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.884+0000 7fa44bbff700 1 Processor -- start 2023-08-10T10:31:05.887 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.885+0000 7fa44bbff700 1 -- start start 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4440d1060 0x7fa444145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa444154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4441f2cd0 con 0x7fa4440b4e90 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa444153420 con 0x7fa4440d1060 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44bbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa444155930 con 0x7fa44415d1e0 2023-08-10T10:31:05.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50478/0 (socket says 172.21.15.88:50478) 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 -- 172.21.15.88:0/1199272216 learned_addr learned my addr 172.21.15.88:0/1199272216 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 -- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 msgr2=0x7fa444154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa444154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 -- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4440d1060 msgr2=0x7fa444145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4440d1060 0x7fa444145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:05.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.886+0000 7fa44999b700 1 -- 172.21.15.88:0/1199272216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa434009550 con 0x7fa4440b4e90 2023-08-10T10:31:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa44999b700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa44000e9b0 tx=0x7fa44000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000c850 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa44000c9b0 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa444155c10 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa44000cd20 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.887+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa444152850 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.888+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4440743a0 con 0x7fa4440b4e90 2023-08-10T10:31:05.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.889+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa440013470 con 0x7fa4440b4e90 2023-08-10T10:31:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.890+0000 7fa43a7fc700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 0x7fa42806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.890+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa4400899e0 con 0x7fa4440b4e90 2023-08-10T10:31:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.890+0000 7fa44919a700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 0x7fa42806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:05.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.891+0000 7fa44919a700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 0x7fa42806d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4440b4c50 tx=0x7fa434010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:05.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:05.894+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa440054700 con 0x7fa4440b4e90 2023-08-10T10:31:06.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.087+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa4440cf1f0 con 0x7fa4440b4e90 2023-08-10T10:31:06.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.088+0000 7fa43a7fc700 1 -- 172.21.15.88:0/1199272216 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa440057d20 con 0x7fa4440b4e90 2023-08-10T10:31:06.090 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:31:06.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 msgr2=0x7fa42806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 0x7fa42806d1a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa4440b4c50 tx=0x7fa434010000 comp rx=0 tx=0).stop 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 msgr2=0x7fa444152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa44000e9b0 tx=0x7fa44000ed70 comp rx=0 tx=0).stop 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 shutdown_connections 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa42806ace0 0x7fa42806d1a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa44415d1e0 0x7fa444154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa4440b4e90 0x7fa444152e40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 --2- 172.21.15.88:0/1199272216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4440d1060 0x7fa444145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 >> 172.21.15.88:0/1199272216 conn(0x7fa4440cf950 msgr2=0x7fa4440b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:06.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 shutdown_connections 2023-08-10T10:31:06.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.090+0000 7fa44bbff700 1 -- 172.21.15.88:0/1199272216 wait complete. 2023-08-10T10:31:06.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:31:06.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.306+0000 7f637adff700 1 Processor -- start 2023-08-10T10:31:06.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.306+0000 7f637adff700 1 -- start start 2023-08-10T10:31:06.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f637adff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63740b5210 0x7f6374167c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f637adff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63740b8e30 con 0x7f637415cf20 2023-08-10T10:31:06.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f637adff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63740ce010 con 0x7f63740b8870 2023-08-10T10:31:06.309 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f637adff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63740cde30 con 0x7f63740b5210 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f637939c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f63740b5210 0x7f6374167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f6378b9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f637415cf20 0x7f637415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58058/0 (socket says 172.21.15.88:58058) 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.307+0000 7f6378b9b700 1 -- 172.21.15.88:0/2355481294 learned_addr learned my addr 172.21.15.88:0/2355481294 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f637939c700 1 -- 172.21.15.88:0/2355481294 >> v1:172.21.15.187:6789/0 conn(0x7f63740b8870 legacy=0x7f63740b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f637939c700 1 -- 172.21.15.88:0/2355481294 >> v1:172.21.15.88:6789/0 conn(0x7f637415cf20 legacy=0x7f637415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f637939c700 1 -- 172.21.15.88:0/2355481294 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740ce2f0 con 0x7f63740b5210 2023-08-10T10:31:06.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f637939c700 1 --2- 172.21.15.88:0/2355481294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b5210 0x7f6374167c00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f636c009840 tx=0x7f636c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73c16b7cefebc81d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f63737fe700 1 -- 172.21.15.88:0/2355481294 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c011830 con 0x7f63740b5210 2023-08-10T10:31:06.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f63737fe700 1 -- 172.21.15.88:0/2355481294 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636c011990 con 0x7f63740b5210 2023-08-10T10:31:06.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.308+0000 7f63737fe700 1 -- 172.21.15.88:0/2355481294 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636c011d20 con 0x7f63740b5210 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 -- 172.21.15.88:0/2355481294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b5210 msgr2=0x7f6374167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 --2- 172.21.15.88:0/2355481294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b5210 0x7f6374167c00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f636c009840 tx=0x7f636c009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 -- 172.21.15.88:0/2355481294 shutdown_connections 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 --2- 172.21.15.88:0/2355481294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b5210 0x7f6374167c00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 -- 172.21.15.88:0/2355481294 >> 172.21.15.88:0/2355481294 conn(0x7f63740d3080 msgr2=0x7f63740d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:06.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 -- 172.21.15.88:0/2355481294 shutdown_connections 2023-08-10T10:31:06.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.309+0000 7f637adff700 1 -- 172.21.15.88:0/2355481294 wait complete. 2023-08-10T10:31:06.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.311+0000 7f637adff700 1 Processor -- start 2023-08-10T10:31:06.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.311+0000 7f637adff700 1 -- start start 2023-08-10T10:31:06.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63740b5210 0x7f63741576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f637415cf20 0x7f63740c7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740c8f10 con 0x7f63740b8870 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63741571b0 con 0x7f63740b5210 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637adff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63740c7d60 con 0x7f637415cf20 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50490/0 (socket says 172.21.15.88:50490) 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 -- 172.21.15.88:0/1644081798 learned_addr learned my addr 172.21.15.88:0/1644081798 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6378b9b700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63740b5210 0x7f63741576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f637939c700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f637415cf20 0x7f63740c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.315 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 -- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f637415cf20 msgr2=0x7f63740c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f637415cf20 0x7f63740c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 -- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63740b5210 msgr2=0x7f63741576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63740b5210 0x7f63741576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.312+0000 7f6373fff700 1 -- 172.21.15.88:0/1644081798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c0094a0 con 0x7f63740b8870 2023-08-10T10:31:06.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f6373fff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f636000c4e0 tx=0x7f636000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63600052d0 con 0x7f63740b8870 2023-08-10T10:31:06.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6360005430 con 0x7f63740b8870 2023-08-10T10:31:06.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63740c8570 con 0x7f63740b8870 2023-08-10T10:31:06.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63600038c0 con 0x7f63740b8870 2023-08-10T10:31:06.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.313+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63740c8b30 con 0x7f63740b8870 2023-08-10T10:31:06.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.314+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740c9050 con 0x7f63740b8870 2023-08-10T10:31:06.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.315+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6360003a20 con 0x7f63740b8870 2023-08-10T10:31:06.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.316+0000 7f63717fa700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 0x7f635806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.316+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f6360088b20 con 0x7f63740b8870 2023-08-10T10:31:06.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.316+0000 7f6378b9b700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 0x7f635806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.317+0000 7f6378b9b700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 0x7f635806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6368005c90 tx=0x7f6368009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.321+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f63740c9050 con 0x7f63740b8870 2023-08-10T10:31:06.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.570+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63740c9050 con 0x7f63740b8870 2023-08-10T10:31:06.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.571+0000 7f63717fa700 1 -- 172.21.15.88:0/1644081798 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f63740c9050 con 0x7f63740b8870 2023-08-10T10:31:06.573 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:06.573 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:31:06.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 msgr2=0x7f635806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 0x7f635806d1a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6368005c90 tx=0x7f6368009040 comp rx=0 tx=0).stop 2023-08-10T10:31:06.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 msgr2=0x7f6374156c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f636000c4e0 tx=0x7f636000c7f0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 shutdown_connections 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f635806ace0 0x7f635806d1a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f637415cf20 0x7f63740c7530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63740b5210 0x7f63741576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 --2- 172.21.15.88:0/1644081798 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f63740b8870 0x7f6374156c70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.573+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 >> 172.21.15.88:0/1644081798 conn(0x7f63740d3080 msgr2=0x7f63740b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:06.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.574+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 shutdown_connections 2023-08-10T10:31:06.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.574+0000 7f637adff700 1 -- 172.21.15.88:0/1644081798 wait complete. 2023-08-10T10:31:06.577 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:31:06.594 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:31:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.789+0000 7f8c143ff700 1 Processor -- start 2023-08-10T10:31:06.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.789+0000 7f8c143ff700 1 -- start start 2023-08-10T10:31:06.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.790+0000 7f8c143ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8c0c15cf20 0x7f8c0c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.790+0000 7f8c143ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c143ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c143ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0cde30 con 0x7f8c0c0b8870 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c143ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c0c0b54b0 con 0x7f8c0c15cf20 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c143ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c15e590 con 0x7f8c0c0b5040 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50506/0 (socket says 172.21.15.88:50506) 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 -- 172.21.15.88:0/437559513 learned_addr learned my addr 172.21.15.88:0/437559513 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1219b700 1 --2- 172.21.15.88:0/437559513 >> v2:172.21.15.187:3300/0 conn(0x7f8c0c15cf20 0x7f8c0c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1299c700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 -- 172.21.15.88:0/437559513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 msgr2=0x7f8c0c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 -- 172.21.15.88:0/437559513 >> v2:172.21.15.187:3300/0 conn(0x7f8c0c15cf20 msgr2=0x7f8c0c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 --2- 172.21.15.88:0/437559513 >> v2:172.21.15.187:3300/0 conn(0x7f8c0c15cf20 0x7f8c0c15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.791+0000 7f8c1199a700 1 -- 172.21.15.88:0/437559513 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0c0b8e30 con 0x7f8c0c0b8870 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c1199a700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06d190 tx=0x7f8bfc009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1be129644777894 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c11199700 1 -- 172.21.15.88:0/437559513 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011830 con 0x7f8c0c0b8870 2023-08-10T10:31:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c11199700 1 -- 172.21.15.88:0/437559513 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc011990 con 0x7f8c0c0b8870 2023-08-10T10:31:06.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c11199700 1 -- 172.21.15.88:0/437559513 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011d20 con 0x7f8c0c0b8870 2023-08-10T10:31:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 -- 172.21.15.88:0/437559513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 msgr2=0x7f8c0c0b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8c0c06d190 tx=0x7f8bfc009c00 comp rx=0 tx=0).stop 2023-08-10T10:31:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 -- 172.21.15.88:0/437559513 shutdown_connections 2023-08-10T10:31:06.798 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 --2- 172.21.15.88:0/437559513 >> v2:172.21.15.187:3300/0 conn(0x7f8c0c15cf20 0x7f8c0c15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 --2- 172.21.15.88:0/437559513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c0b4b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 -- 172.21.15.88:0/437559513 >> 172.21.15.88:0/437559513 conn(0x7f8c0c0d3080 msgr2=0x7f8c0c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.792+0000 7f8c143ff700 1 -- 172.21.15.88:0/437559513 shutdown_connections 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.793+0000 7f8c143ff700 1 -- 172.21.15.88:0/437559513 wait complete. 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.794+0000 7f8c143ff700 1 Processor -- start 2023-08-10T10:31:06.799 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.794+0000 7f8c143ff700 1 -- start start 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c0c15cf20 0x7f8c0c15a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c159980 con 0x7f8c0c0b8870 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1593d0 con 0x7f8c0c15cf20 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.795+0000 7f8c143ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1596a0 con 0x7f8c0c0b5040 2023-08-10T10:31:06.800 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1219b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50516/0 (socket says 172.21.15.88:50516) 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 -- 172.21.15.88:0/1324464354 learned_addr learned my addr 172.21.15.88:0/1324464354 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1219b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c158e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:47482/0 (socket says 172.21.15.88:47482) 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1299c700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c0c15cf20 0x7f8c0c15a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 -- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 msgr2=0x7f8c0c158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.801 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 -- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c0c15cf20 msgr2=0x7f8c0c15a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c0c15cf20 0x7f8c0c15a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 -- 172.21.15.88:0/1324464354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc009550 con 0x7f8c0c0b8870 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c1199a700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098f0 tx=0x7f8bfc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc004240 con 0x7f8c0c0b8870 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.796+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc01f070 con 0x7f8c0c0b8870 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.797+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c0ca1d0 con 0x7f8c0c0b8870 2023-08-10T10:31:06.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.797+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc0045c0 con 0x7f8c0c0b8870 2023-08-10T10:31:06.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.797+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c0ca790 con 0x7f8c0c0b8870 2023-08-10T10:31:06.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.798+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c0ca980 con 0x7f8c0c0b8870 2023-08-10T10:31:06.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.799+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8bfc021030 con 0x7f8c0c0b8870 2023-08-10T10:31:06.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.799+0000 7f8c02ffd700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 0x7f8bf006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:06.804 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.799+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8bfc08a840 con 0x7f8c0c0b8870 2023-08-10T10:31:06.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.800+0000 7f8c1219b700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 0x7f8bf006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:06.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.800+0000 7f8c1219b700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 0x7f8bf006d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009b40 tx=0x7f8c08009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:06.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.804+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8bfc0555f0 con 0x7f8c0c0b8870 2023-08-10T10:31:07.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:06.998+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8c0c04ecc0 con 0x7f8c0c0b8870 2023-08-10T10:31:07.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.000+0000 7f8c02ffd700 1 -- 172.21.15.88:0/1324464354 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7f8bfc0093b0 con 0x7f8c0c0b8870 2023-08-10T10:31:07.002 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:07.002 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:31:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 msgr2=0x7f8bf006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 0x7f8bf006d1a0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009b40 tx=0x7f8c08009210 comp rx=0 tx=0).stop 2023-08-10T10:31:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 msgr2=0x7f8c0c159ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc0098f0 tx=0x7f8bfc004750 comp rx=0 tx=0).stop 2023-08-10T10:31:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 shutdown_connections 2023-08-10T10:31:07.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c0c15cf20 0x7f8c0c15a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8bf006ace0 0x7f8bf006d1a0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c0c0b5040 0x7f8c0c158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 --2- 172.21.15.88:0/1324464354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c0c0b8870 0x7f8c0c159ff0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 >> 172.21.15.88:0/1324464354 conn(0x7f8c0c0d3080 msgr2=0x7f8c0c0b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:07.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 shutdown_connections 2023-08-10T10:31:07.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.002+0000 7f8c143ff700 1 -- 172.21.15.88:0/1324464354 wait complete. 2023-08-10T10:31:07.022 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:31:07.023 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:31:07.221 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.220+0000 7fa3d8bff700 1 Processor -- start 2023-08-10T10:31:07.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.220+0000 7fa3d8bff700 1 -- start start 2023-08-10T10:31:07.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.221+0000 7fa3d8bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3d40b5060 0x7fa3d40b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.221+0000 7fa3d8bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40d1840 con 0x7fa3d415d1e0 2023-08-10T10:31:07.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.221+0000 7fa3d8bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40d1b20 con 0x7fa3d40d27a0 2023-08-10T10:31:07.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.221+0000 7fa3d8bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40d2c50 con 0x7fa3d40b5060 2023-08-10T10:31:07.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d2d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa3d40b5060 0x7fa3d40b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.224 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d259c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa3d415d1e0 0x7fa3d40d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58060/0 (socket says 172.21.15.88:58060) 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d259c700 1 -- 172.21.15.88:0/1348281162 learned_addr learned my addr 172.21.15.88:0/1348281162 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d159a700 1 -- 172.21.15.88:0/1348281162 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 201885650 0 0) 0x7fa3d40d1840 con 0x7fa3d415d1e0 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d2d9d700 1 -- 172.21.15.88:0/1348281162 >> v1:172.21.15.187:6789/0 conn(0x7fa3d40d27a0 legacy=0x7fa3d40b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d2d9d700 1 -- 172.21.15.88:0/1348281162 >> v1:172.21.15.88:6789/0 conn(0x7fa3d415d1e0 legacy=0x7fa3d40d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d2d9d700 1 -- 172.21.15.88:0/1348281162 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40d1e00 con 0x7fa3d40b5060 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d2d9d700 1 --2- 172.21.15.88:0/1348281162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40b5060 0x7fa3d40b1940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009d90 tx=0x7fa3cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=480d8446be99a062 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.222+0000 7fa3d159a700 1 -- 172.21.15.88:0/1348281162 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc00e070 con 0x7fa3d40b5060 2023-08-10T10:31:07.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d159a700 1 -- 172.21.15.88:0/1348281162 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3cc00bbd0 con 0x7fa3d40b5060 2023-08-10T10:31:07.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d159a700 1 -- 172.21.15.88:0/1348281162 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3cc012430 con 0x7fa3d40b5060 2023-08-10T10:31:07.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 -- 172.21.15.88:0/1348281162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40b5060 msgr2=0x7fa3d40b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/1348281162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40b5060 0x7fa3d40b1940 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc009d90 tx=0x7fa3cc00b330 comp rx=0 tx=0).stop 2023-08-10T10:31:07.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 -- 172.21.15.88:0/1348281162 shutdown_connections 2023-08-10T10:31:07.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/1348281162 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40b5060 0x7fa3d40b1940 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 -- 172.21.15.88:0/1348281162 >> 172.21.15.88:0/1348281162 conn(0x7fa3d40cf950 msgr2=0x7fa3d40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:07.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 -- 172.21.15.88:0/1348281162 shutdown_connections 2023-08-10T10:31:07.227 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.223+0000 7fa3d8bff700 1 -- 172.21.15.88:0/1348281162 wait complete. 2023-08-10T10:31:07.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.225+0000 7fa3d8bff700 1 Processor -- start 2023-08-10T10:31:07.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.225+0000 7fa3d8bff700 1 -- start start 2023-08-10T10:31:07.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40b5060 0x7fa3d40cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d415d1e0 0x7fa3d414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41e9840 con 0x7fa3d40d27a0 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41e5850 con 0x7fa3d40b5060 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d8bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d415c2c0 con 0x7fa3d415d1e0 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50526/0 (socket says 172.21.15.88:50526) 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 -- 172.21.15.88:0/3244515465 learned_addr learned my addr 172.21.15.88:0/3244515465 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d259c700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40b5060 0x7fa3d40cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d2d9d700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d415d1e0 0x7fa3d414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 -- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d415d1e0 msgr2=0x7fa3d414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d415d1e0 0x7fa3d414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 -- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40b5060 msgr2=0x7fa3d40cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40b5060 0x7fa3d40cc210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.226+0000 7fa3d1d9b700 1 -- 172.21.15.88:0/3244515465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc009a70 con 0x7fa3d40d27a0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3d1d9b700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c700 tx=0x7fa3c800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80052d0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8005430 con 0x7fa3d40d27a0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d40cc7f0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8003880 con 0x7fa3d40d27a0 2023-08-10T10:31:07.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.227+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d41e5ac0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.228+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d41e5cb0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.229+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa3c80039e0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.230+0000 7fa3c2ffd700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 0x7fa3b406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.230+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7fa3c8088c50 con 0x7fa3d40d27a0 2023-08-10T10:31:07.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.230+0000 7fa3d259c700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 0x7fa3b406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.231+0000 7fa3d259c700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 0x7fa3b406d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000f60 tx=0x7fa3c4007d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.235 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.234+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa3c8053a30 con 0x7fa3d40d27a0 2023-08-10T10:31:07.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.431+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa3d40743a0 con 0x7fa3d40d27a0 2023-08-10T10:31:07.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.432+0000 7fa3c2ffd700 1 -- 172.21.15.88:0/3244515465 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa3c8057050 con 0x7fa3d40d27a0 2023-08-10T10:31:07.433 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:31:07.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 msgr2=0x7fa3b406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 0x7fa3b406d1a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4000f60 tx=0x7fa3c4007d90 comp rx=0 tx=0).stop 2023-08-10T10:31:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 msgr2=0x7fa3d41e9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c700 tx=0x7fa3c800cac0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 shutdown_connections 2023-08-10T10:31:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa3b406ace0 0x7fa3b406d1a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d415d1e0 0x7fa3d414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d40b5060 0x7fa3d40cc210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 --2- 172.21.15.88:0/3244515465 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa3d40d27a0 0x7fa3d41e9300 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 >> 172.21.15.88:0/3244515465 conn(0x7fa3d40cf950 msgr2=0x7fa3d40d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 shutdown_connections 2023-08-10T10:31:07.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.434+0000 7fa3d8bff700 1 -- 172.21.15.88:0/3244515465 wait complete. 2023-08-10T10:31:07.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:31:07.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.651+0000 7f305f9ff700 1 Processor -- start 2023-08-10T10:31:07.652 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.651+0000 7f305f9ff700 1 -- start start 2023-08-10T10:31:07.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305f9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f30580b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.653 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305f9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580d1840 con 0x7f30580b4e90 2023-08-10T10:31:07.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305f9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30580d1b20 con 0x7f305815d1e0 2023-08-10T10:31:07.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305f9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b5320 con 0x7f30580d27a0 2023-08-10T10:31:07.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305df9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f30580b4e90 0x7f30580b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58070/0 (socket says 172.21.15.88:58070) 2023-08-10T10:31:07.654 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305df9c700 1 -- 172.21.15.88:0/601167891 learned_addr learned my addr 172.21.15.88:0/601167891 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:07.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.652+0000 7f305cf9a700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f30580b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.656 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 445361637 0 0) 0x7f30580d1840 con 0x7f30580b4e90 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30440035b0 con 0x7f30580b4e90 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080409262 0 0) 0x7f30580d1b20 con 0x7f305815d1e0 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30580d1840 con 0x7f305815d1e0 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3443720797 0 0) 0x7f30440035b0 con 0x7f30580b4e90 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 msgr2=0x7f30580b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f30580b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.657 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 >> v1:172.21.15.187:6789/0 conn(0x7f305815d1e0 legacy=0x7f30580d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580d1e00 con 0x7f30580b4e90 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f30500019f0 con 0x7f30580b4e90 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 >> v1:172.21.15.88:6789/0 conn(0x7f30580b4e90 legacy=0x7f30580b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3044003bc0 0x7f3044003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3044004850 0x7f3044004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f3044005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580b5320 con 0x7f3044004850 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304400bac0 con 0x7f3044003bc0 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304400bc50 con 0x7f30580d27a0 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f305d79b700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3044003bc0 0x7f3044003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f305df9c700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f3044005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.653+0000 7f305cf9a700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3044004850 0x7f3044004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 -- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 msgr2=0x7f3044005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:07.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30580d27a0 0x7f3044005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 -- 172.21.15.88:0/601167891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3044004850 msgr2=0x7f3044004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:07.660 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3044004850 0x7f3044004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 -- 172.21.15.88:0/601167891 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440035b0 con 0x7f3044003bc0 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305cf9a700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3044004850 0x7f3044004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f305d79b700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3044003bc0 0x7f3044003fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3044005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78b7c963f13026fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054001430 con 0x7f3044003bc0 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30540052d0 con 0x7f3044003bc0 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.654+0000 7f304ffff700 1 -- 172.21.15.88:0/601167891 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054001d40 con 0x7f3044003bc0 2023-08-10T10:31:07.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 -- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3044003bc0 msgr2=0x7f3044003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 --2- 172.21.15.88:0/601167891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3044003bc0 0x7f3044003fc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3054007fd0 tx=0x7f3044005880 comp rx=0 tx=0).stop 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305df9c700 1 -- 172.21.15.88:0/601167891 reap_dead start 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 -- 172.21.15.88:0/601167891 shutdown_connections 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 -- 172.21.15.88:0/601167891 >> 172.21.15.88:0/601167891 conn(0x7f30580cf950 msgr2=0x7f30580cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 -- 172.21.15.88:0/601167891 shutdown_connections 2023-08-10T10:31:07.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.655+0000 7f305f9ff700 1 -- 172.21.15.88:0/601167891 wait complete. 2023-08-10T10:31:07.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.657+0000 7f305f9ff700 1 Processor -- start 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.657+0000 7f305f9ff700 1 -- start start 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3044003bc0 0x7f30580ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 0x7f30580cc900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580ac360 con 0x7f30580ab970 2023-08-10T10:31:07.665 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30580cce40 con 0x7f305815af10 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305f9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30580cb000 con 0x7f3044003bc0 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305df9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305df9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50542/0 (socket says 172.21.15.88:50542) 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305df9c700 1 -- 172.21.15.88:0/894019772 learned_addr learned my addr 172.21.15.88:0/894019772 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305d79b700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3044003bc0 0x7f30580ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.658+0000 7f305cf9a700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 0x7f30580cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 -- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3044003bc0 msgr2=0x7f30580ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3044003bc0 0x7f30580ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 -- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 msgr2=0x7f30580cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 0x7f30580cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 -- 172.21.15.88:0/894019772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30580cb2e0 con 0x7f30580ab970 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305cf9a700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 0x7f30580cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305df9c700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30580d2e80 tx=0x7f305000a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305000ae40 con 0x7f30580ab970 2023-08-10T10:31:07.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30500133f0 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30580cb5c0 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050013780 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.659+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30580cbb80 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.660+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30580cec90 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.661+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f30500138e0 con 0x7f30580ab970 2023-08-10T10:31:07.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.662+0000 7f304dffb700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 0x7f303c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:07.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.662+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f305008a1a0 con 0x7f30580ab970 2023-08-10T10:31:07.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.662+0000 7f305d79b700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 0x7f303c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:07.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.663+0000 7f305d79b700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 0x7f303c06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3054005040 tx=0x7f305400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:07.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.666+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3050054ff0 con 0x7f30580ab970 2023-08-10T10:31:07.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.861+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f30580743a0 con 0x7f30580ab970 2023-08-10T10:31:07.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.862+0000 7f304dffb700 1 -- 172.21.15.88:0/894019772 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v27) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3050058610 con 0x7f30580ab970 2023-08-10T10:31:07.863 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:31:07.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 msgr2=0x7f303c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 0x7f303c06d1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3054005040 tx=0x7f305400a000 comp rx=0 tx=0).stop 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 msgr2=0x7f30580abe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f30580d2e80 tx=0x7f305000a5b0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 shutdown_connections 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f30580ab970 0x7f30580abe20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f303c06ace0 0x7f303c06d1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3044003bc0 0x7f30580ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 --2- 172.21.15.88:0/894019772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f305815af10 0x7f30580cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 >> 172.21.15.88:0/894019772 conn(0x7f30580cf950 msgr2=0x7f30580b8040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 shutdown_connections 2023-08-10T10:31:07.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:07.864+0000 7f305f9ff700 1 -- 172.21.15.88:0/894019772 wait complete. 2023-08-10T10:31:07.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:31:08.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.080+0000 7f0be6fff700 1 Processor -- start 2023-08-10T10:31:08.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.080+0000 7f0be6fff700 1 -- start start 2023-08-10T10:31:08.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be6fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be015d1e0 0x7f0be00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be6fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0be00d1060 0x7f0be00b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be6fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0be00d1840 con 0x7f0be00b4e90 2023-08-10T10:31:08.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be6fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0be015d5c0 con 0x7f0be00d1060 2023-08-10T10:31:08.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be6fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be00b5300 con 0x7f0be015d1e0 2023-08-10T10:31:08.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0bdffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0be00d1060 0x7f0be00b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0bdffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0be00d1060 0x7f0be00b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50554/0 (socket says 172.21.15.88:50554) 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0bdffff700 1 -- 172.21.15.88:0/67164232 learned_addr learned my addr 172.21.15.88:0/67164232 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.081+0000 7f0be4d9b700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be015d1e0 0x7f0be00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdffff700 1 -- 172.21.15.88:0/67164232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be015d1e0 msgr2=0x7f0be00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdffff700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be015d1e0 0x7f0be00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdffff700 1 -- 172.21.15.88:0/67164232 >> v1:172.21.15.187:6789/0 conn(0x7f0be00b4e90 legacy=0x7f0be00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdffff700 1 -- 172.21.15.88:0/67164232 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be00d1b20 con 0x7f0be00d1060 2023-08-10T10:31:08.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdffff700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be00d1060 0x7f0be00b4950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009920 tx=0x7f0bcc009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32670f7fceb9b200 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdf7fe700 1 -- 172.21.15.88:0/67164232 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011830 con 0x7f0be00d1060 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdf7fe700 1 -- 172.21.15.88:0/67164232 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bcc011990 con 0x7f0be00d1060 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.082+0000 7f0bdf7fe700 1 -- 172.21.15.88:0/67164232 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011d20 con 0x7f0be00d1060 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 -- 172.21.15.88:0/67164232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be00d1060 msgr2=0x7f0be00b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be00d1060 0x7f0be00b4950 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc009920 tx=0x7f0bcc009c30 comp rx=0 tx=0).stop 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 -- 172.21.15.88:0/67164232 shutdown_connections 2023-08-10T10:31:08.086 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be015d1e0 0x7f0be00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 --2- 172.21.15.88:0/67164232 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be00d1060 0x7f0be00b4950 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 -- 172.21.15.88:0/67164232 >> 172.21.15.88:0/67164232 conn(0x7f0be00cf950 msgr2=0x7f0be00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:08.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 -- 172.21.15.88:0/67164232 shutdown_connections 2023-08-10T10:31:08.087 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.083+0000 7f0be6fff700 1 -- 172.21.15.88:0/67164232 wait complete. 2023-08-10T10:31:08.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.085+0000 7f0be6fff700 1 Processor -- start 2023-08-10T10:31:08.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.085+0000 7f0be6fff700 1 -- start start 2023-08-10T10:31:08.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be00b4e90 0x7f0be0152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be00d1060 0x7f0be0145290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be01f2cd0 con 0x7f0be015d1e0 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0153420 con 0x7f0be00b4e90 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be6fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0155930 con 0x7f0be00d1060 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be559c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0bdffff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be00d1060 0x7f0be0145290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be559c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50556/0 (socket says 172.21.15.88:50556) 2023-08-10T10:31:08.090 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be559c700 1 -- 172.21.15.88:0/16917115 learned_addr learned my addr 172.21.15.88:0/16917115 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.086+0000 7f0be4d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be00b4e90 0x7f0be0152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 -- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be00d1060 msgr2=0x7f0be0145290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be00d1060 0x7f0be0145290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 -- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be00b4e90 msgr2=0x7f0be0152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be00b4e90 0x7f0be0152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 -- 172.21.15.88:0/16917115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bcc009550 con 0x7f0be015d1e0 2023-08-10T10:31:08.091 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be559c700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800cb50 tx=0x7f0bd800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd8003c00 con 0x7f0be015d1e0 2023-08-10T10:31:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd8003d60 con 0x7f0be015d1e0 2023-08-10T10:31:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be0155c10 con 0x7f0be015d1e0 2023-08-10T10:31:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd800aa20 con 0x7f0be015d1e0 2023-08-10T10:31:08.092 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.087+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be0152850 con 0x7f0be015d1e0 2023-08-10T10:31:08.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.088+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be0156130 con 0x7f0be015d1e0 2023-08-10T10:31:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.089+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0bd800ab80 con 0x7f0be015d1e0 2023-08-10T10:31:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.091+0000 7f0bdd7fa700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 0x7f0bc406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.091+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f0bd8089820 con 0x7f0be015d1e0 2023-08-10T10:31:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.091+0000 7f0be4d9b700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 0x7f0bc406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.094 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.092+0000 7f0be4d9b700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 0x7f0bc406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009be0 tx=0x7f0bd4009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.095+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0be0156130 con 0x7f0be015d1e0 2023-08-10T10:31:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.291+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0be0156130 con 0x7f0be015d1e0 2023-08-10T10:31:08.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.292+0000 7f0bdd7fa700 1 -- 172.21.15.88:0/16917115 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0be0156130 con 0x7f0be015d1e0 2023-08-10T10:31:08.294 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:31:08.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 msgr2=0x7f0bc406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 0x7f0bc406d1a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0bd4009be0 tx=0x7f0bd4009210 comp rx=0 tx=0).stop 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 msgr2=0x7f0be0154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0bd800cb50 tx=0x7f0bd800ce60 comp rx=0 tx=0).stop 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 shutdown_connections 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0be015d1e0 0x7f0be0154a40 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0be00b4e90 0x7f0be0152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0bc406ace0 0x7f0bc406d1a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 --2- 172.21.15.88:0/16917115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0be00d1060 0x7f0be0145290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 >> 172.21.15.88:0/16917115 conn(0x7f0be00cf950 msgr2=0x7f0be00b6c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 shutdown_connections 2023-08-10T10:31:08.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.294+0000 7f0be6fff700 1 -- 172.21.15.88:0/16917115 wait complete. 2023-08-10T10:31:08.314 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:31:08.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.512+0000 7f02a6bff700 1 Processor -- start 2023-08-10T10:31:08.514 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.512+0000 7f02a6bff700 1 -- start start 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.513+0000 7f02a6bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f02a015d1e0 0x7f02a00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.513+0000 7f02a6bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00d1840 con 0x7f02a00b5060 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.513+0000 7f02a6bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02a00d1b20 con 0x7f02a00d1060 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.513+0000 7f02a6bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02a015d5c0 con 0x7f02a015d1e0 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f02a519c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f02a00b5060 0x7f02a00b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58082/0 (socket says 172.21.15.88:58082) 2023-08-10T10:31:08.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f02a519c700 1 -- 172.21.15.88:0/1327712597 learned_addr learned my addr 172.21.15.88:0/1327712597 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f02a499b700 1 --2- 172.21.15.88:0/1327712597 >> v2:172.21.15.187:3300/0 conn(0x7f02a015d1e0 0x7f02a00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3640143930 0 0) 0x7f02a00d1840 con 0x7f02a00b5060 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02900035b0 con 0x7f02a00b5060 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 714387376 0 0) 0x7f02900035b0 con 0x7f02a00b5060 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 >> v2:172.21.15.187:3300/0 conn(0x7f02a015d1e0 msgr2=0x7f02a00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:08.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 --2- 172.21.15.88:0/1327712597 >> v2:172.21.15.187:3300/0 conn(0x7f02a015d1e0 0x7f02a00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 >> v1:172.21.15.187:6789/0 conn(0x7f02a00d1060 legacy=0x7f02a00b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a00d1e00 con 0x7f02a00b5060 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f02980019f0 con 0x7f02a00b5060 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 >> v1:172.21.15.88:6789/0 conn(0x7f02a00b5060 legacy=0x7f02a00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290004850 0x7f0290004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.519 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 0x7f029000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015d5c0 con 0x7f0290005210 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f029000c0c0 con 0x7f0290004850 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.514+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f029000c280 con 0x7f0290003a00 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 0x7f029000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f029ffff700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290004850 0x7f0290004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.520 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a499b700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 -- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0290003a00 msgr2=0x7f0290003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0290003a00 0x7f0290003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 -- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290004850 msgr2=0x7f0290004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290004850 0x7f0290004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 -- 172.21.15.88:0/1327712597 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02900035b0 con 0x7f0290005210 2023-08-10T10:31:08.521 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 -- 172.21.15.88:0/1327712597 reap_dead start 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.515+0000 7f02a519c700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 0x7f029000ba10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f029800a830 tx=0x7f0290005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c69df832bfaef251 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029800a2f0 con 0x7f0290005210 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298012620 con 0x7f0290005210 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f029f7fe700 1 -- 172.21.15.88:0/1327712597 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02980129d0 con 0x7f0290005210 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 -- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 msgr2=0x7f029000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 0x7f029000ba10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f029800a830 tx=0x7f0290005880 comp rx=0 tx=0).stop 2023-08-10T10:31:08.522 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 -- 172.21.15.88:0/1327712597 shutdown_connections 2023-08-10T10:31:08.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 --2- 172.21.15.88:0/1327712597 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0290005210 0x7f029000ba10 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 -- 172.21.15.88:0/1327712597 >> 172.21.15.88:0/1327712597 conn(0x7f02a00cf950 msgr2=0x7f02a00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:08.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 -- 172.21.15.88:0/1327712597 shutdown_connections 2023-08-10T10:31:08.523 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.516+0000 7f02a6bff700 1 -- 172.21.15.88:0/1327712597 wait complete. 2023-08-10T10:31:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.519+0000 7f02a6bff700 1 Processor -- start 2023-08-10T10:31:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.519+0000 7f02a6bff700 1 -- start start 2023-08-10T10:31:08.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290005210 0x7f02a0159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02a015ad00 0x7f02a01558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a015a8e0 con 0x7f02a00c95f0 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0155e10 con 0x7f0290005210 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a6bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02a0159c60 con 0x7f02a015ad00 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a519c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.526 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a519c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50566/0 (socket says 172.21.15.88:50566) 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.520+0000 7f02a519c700 1 -- 172.21.15.88:0/2421027255 learned_addr learned my addr 172.21.15.88:0/2421027255 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a499b700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290005210 0x7f02a0159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f029ffff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02a015ad00 0x7f02a01558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 -- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02a015ad00 msgr2=0x7f02a01558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02a015ad00 0x7f02a01558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 -- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290005210 msgr2=0x7f02a0159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.527 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290005210 0x7f02a0159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 -- 172.21.15.88:0/2421027255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02a0159f40 con 0x7f02a00c95f0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a519c700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f02a00b5a70 tx=0x7f0298001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0298012ba0 con 0x7f02a00c95f0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0298012d20 con 0x7f02a00c95f0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02a015a220 con 0x7f02a00c95f0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.521+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f029801d660 con 0x7f02a00c95f0 2023-08-10T10:31:08.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.522+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02a00c9aa0 con 0x7f02a00c95f0 2023-08-10T10:31:08.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.523+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02a015aa20 con 0x7f02a00c95f0 2023-08-10T10:31:08.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.524+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f029801d7c0 con 0x7f02a00c95f0 2023-08-10T10:31:08.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.525+0000 7f029d7fa700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 0x7f028406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.525+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f029808b760 con 0x7f02a00c95f0 2023-08-10T10:31:08.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.525+0000 7f02a499b700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 0x7f028406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.525+0000 7f02a499b700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 0x7f028406d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0294009be0 tx=0x7f0294009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.529+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f02a015aa20 con 0x7f02a00c95f0 2023-08-10T10:31:08.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.722+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f02a015aa20 con 0x7f02a00c95f0 2023-08-10T10:31:08.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.722+0000 7f029d7fa700 1 -- 172.21.15.88:0/2421027255 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f02a015aa20 con 0x7f02a00c95f0 2023-08-10T10:31:08.724 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:31:08.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 msgr2=0x7f028406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 0x7f028406d1a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0294009be0 tx=0x7f0294009210 comp rx=0 tx=0).stop 2023-08-10T10:31:08.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 msgr2=0x7f02a00c73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f02a00b5a70 tx=0x7f0298001d80 comp rx=0 tx=0).stop 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 shutdown_connections 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f02a00c95f0 0x7f02a00c73a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0290005210 0x7f02a0159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f028406ace0 0x7f028406d1a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 --2- 172.21.15.88:0/2421027255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f02a015ad00 0x7f02a01558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 >> 172.21.15.88:0/2421027255 conn(0x7f02a00cf950 msgr2=0x7f02a015e290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:08.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 shutdown_connections 2023-08-10T10:31:08.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.725+0000 7f02a6bff700 1 -- 172.21.15.88:0/2421027255 wait complete. 2023-08-10T10:31:08.744 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:31:08.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.940+0000 7f766a1ff700 1 Processor -- start 2023-08-10T10:31:08.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.941+0000 7f766a1ff700 1 -- start start 2023-08-10T10:31:08.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f766a1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766415d1e0 0x7f76640d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f766a1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76640b5060 0x7f76640b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f766a1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76640d1840 con 0x7f76640d1060 2023-08-10T10:31:08.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f766a1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766415d5c0 con 0x7f76640b5060 2023-08-10T10:31:08.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f766a1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76640d1b20 con 0x7f766415d1e0 2023-08-10T10:31:08.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f7663fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f76640b5060 0x7f76640b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f765bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f76640d1060 0x7f76640b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58090/0 (socket says 172.21.15.88:58090) 2023-08-10T10:31:08.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f765bfff700 1 -- 172.21.15.88:0/1281954381 learned_addr learned my addr 172.21.15.88:0/1281954381 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:08.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.942+0000 7f76637fe700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766415d1e0 0x7f76640d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7663fff700 1 -- 172.21.15.88:0/1281954381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766415d1e0 msgr2=0x7f76640d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:08.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7663fff700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766415d1e0 0x7f76640d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7663fff700 1 -- 172.21.15.88:0/1281954381 >> v1:172.21.15.88:6789/0 conn(0x7f76640d1060 legacy=0x7f76640b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7663fff700 1 -- 172.21.15.88:0/1281954381 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76640d1e00 con 0x7f76640b5060 2023-08-10T10:31:08.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7662ffd700 1 -- 172.21.15.88:0/1281954381 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667019499 0 0) 0x7f76640d1840 con 0x7f76640d1060 2023-08-10T10:31:08.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7663fff700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76640b5060 0x7f76640b1940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f765c009d90 tx=0x7f765c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d67c94a9c0b6d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7662ffd700 1 -- 172.21.15.88:0/1281954381 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c00e070 con 0x7f76640b5060 2023-08-10T10:31:08.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7662ffd700 1 -- 172.21.15.88:0/1281954381 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c00bb20 con 0x7f76640b5060 2023-08-10T10:31:08.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.943+0000 7f7662ffd700 1 -- 172.21.15.88:0/1281954381 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c012430 con 0x7f76640b5060 2023-08-10T10:31:08.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 -- 172.21.15.88:0/1281954381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76640b5060 msgr2=0x7f76640b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76640b5060 0x7f76640b1940 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f765c009d90 tx=0x7f765c00b330 comp rx=0 tx=0).stop 2023-08-10T10:31:08.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 -- 172.21.15.88:0/1281954381 shutdown_connections 2023-08-10T10:31:08.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f76640b5060 0x7f76640b1940 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 --2- 172.21.15.88:0/1281954381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766415d1e0 0x7f76640d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 -- 172.21.15.88:0/1281954381 >> 172.21.15.88:0/1281954381 conn(0x7f76640cf950 msgr2=0x7f76640cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:08.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 -- 172.21.15.88:0/1281954381 shutdown_connections 2023-08-10T10:31:08.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.944+0000 7f766a1ff700 1 -- 172.21.15.88:0/1281954381 wait complete. 2023-08-10T10:31:08.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.945+0000 7f766a1ff700 1 Processor -- start 2023-08-10T10:31:08.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.946+0000 7f766a1ff700 1 -- start start 2023-08-10T10:31:08.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 0x7f766414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 0x7f766415dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640cb6d0 con 0x7f766415d1e0 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76640c8a10 con 0x7f76640d1060 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f766a1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f766415e690 con 0x7f76640b5060 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50588/0 (socket says 172.21.15.88:50588) 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 -- 172.21.15.88:0/2844184844 learned_addr learned my addr 172.21.15.88:0/2844184844 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:08.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f76637fe700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 0x7f766414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f765bfff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 0x7f766415dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 -- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 msgr2=0x7f766414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 0x7f766414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 -- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 msgr2=0x7f766415dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 0x7f766415dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 -- 172.21.15.88:0/2844184844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f765c009a70 con 0x7f766415d1e0 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f76637fe700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 0x7f766414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:31:08.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f765bfff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 0x7f766415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.947+0000 7f7663fff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f765c014040 tx=0x7f765c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.948+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c012430 con 0x7f766415d1e0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.948+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c020070 con 0x7f766415d1e0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.948+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c004280 con 0x7f766415d1e0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.948+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76640c83c0 con 0x7f766415d1e0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.948+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76640c7fe0 con 0x7f766415d1e0 2023-08-10T10:31:08.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.949+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f766415e850 con 0x7f766415d1e0 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.950+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f765c0043e0 con 0x7f766415d1e0 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.951+0000 7f7660ff9700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 0x7f764406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.951+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f765c022070 con 0x7f766415d1e0 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.951+0000 7f76637fe700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 0x7f764406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.952+0000 7f76637fe700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 0x7f764406d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f766415ea60 tx=0x7f7654008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:08.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:08.956+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f765c0562e0 con 0x7f766415d1e0 2023-08-10T10:31:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.151+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f76640c8b80 con 0x7f766415d1e0 2023-08-10T10:31:09.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.152+0000 7f7660ff9700 1 -- 172.21.15.88:0/2844184844 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f765c059900 con 0x7f766415d1e0 2023-08-10T10:31:09.154 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:31:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 msgr2=0x7f764406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 0x7f764406d1a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f766415ea60 tx=0x7f7654008040 comp rx=0 tx=0).stop 2023-08-10T10:31:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 msgr2=0x7f76640c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f765c014040 tx=0x7f765c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 shutdown_connections 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f766415d1e0 0x7f76640c8ea0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f764406ace0 0x7f764406d1a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76640b5060 0x7f766414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 --2- 172.21.15.88:0/2844184844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640d1060 0x7f766415dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.154+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 >> 172.21.15.88:0/2844184844 conn(0x7f76640cf950 msgr2=0x7f766406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.155+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 shutdown_connections 2023-08-10T10:31:09.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.155+0000 7f766a1ff700 1 -- 172.21.15.88:0/2844184844 wait complete. 2023-08-10T10:31:09.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:31:09.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.370+0000 7efc421ff700 1 Processor -- start 2023-08-10T10:31:09.372 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.371+0000 7efc421ff700 1 -- start start 2023-08-10T10:31:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc421ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc3c15cf20 0x7efc3c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc421ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efc3c0b5210 0x7efc3c0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc421ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c15e590 con 0x7efc3c0b8870 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc421ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0cde30 con 0x7efc3c15cf20 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc421ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc3c0b8e30 con 0x7efc3c0b5210 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7efc3c15cf20 0x7efc3c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc33fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7efc3c0b8870 0x7efc3c0b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58098/0 (socket says 172.21.15.88:58098) 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc33fff700 1 -- 172.21.15.88:0/3343152540 learned_addr learned my addr 172.21.15.88:0/3343152540 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:09.374 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3bfff700 1 --2- 172.21.15.88:0/3343152540 >> v2:172.21.15.187:3300/0 conn(0x7efc3c0b5210 0x7efc3c0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3affd700 1 -- 172.21.15.88:0/3343152540 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653891718 0 0) 0x7efc3c15e590 con 0x7efc3c0b8870 2023-08-10T10:31:09.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3affd700 1 -- 172.21.15.88:0/3343152540 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc280035b0 con 0x7efc3c0b8870 2023-08-10T10:31:09.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3b7fe700 1 -- 172.21.15.88:0/3343152540 >> v2:172.21.15.187:3300/0 conn(0x7efc3c0b5210 msgr2=0x7efc3c0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:09.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.372+0000 7efc3b7fe700 1 --2- 172.21.15.88:0/3343152540 >> v2:172.21.15.187:3300/0 conn(0x7efc3c0b5210 0x7efc3c0d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3b7fe700 1 -- 172.21.15.88:0/3343152540 >> v1:172.21.15.88:6789/0 conn(0x7efc3c0b8870 legacy=0x7efc3c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3b7fe700 1 -- 172.21.15.88:0/3343152540 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c0ce010 con 0x7efc3c15cf20 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3b7fe700 1 --2- 172.21.15.88:0/3343152540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c15e050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0cd840 tx=0x7efc2c009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0abbc71b315f3d7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3affd700 1 -- 172.21.15.88:0/3343152540 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c011830 con 0x7efc3c15cf20 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3affd700 1 -- 172.21.15.88:0/3343152540 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c011990 con 0x7efc3c15cf20 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.373+0000 7efc3affd700 1 -- 172.21.15.88:0/3343152540 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc2c011d20 con 0x7efc3c15cf20 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 -- 172.21.15.88:0/3343152540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 msgr2=0x7efc3c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 --2- 172.21.15.88:0/3343152540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c15e050 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7efc3c0cd840 tx=0x7efc2c009b20 comp rx=0 tx=0).stop 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 -- 172.21.15.88:0/3343152540 shutdown_connections 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 --2- 172.21.15.88:0/3343152540 >> v2:172.21.15.187:3300/0 conn(0x7efc3c0b5210 0x7efc3c0d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 --2- 172.21.15.88:0/3343152540 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c15e050 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 -- 172.21.15.88:0/3343152540 >> 172.21.15.88:0/3343152540 conn(0x7efc3c0d3080 msgr2=0x7efc3c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 -- 172.21.15.88:0/3343152540 shutdown_connections 2023-08-10T10:31:09.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.374+0000 7efc421ff700 1 -- 172.21.15.88:0/3343152540 wait complete. 2023-08-10T10:31:09.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.375+0000 7efc421ff700 1 Processor -- start 2023-08-10T10:31:09.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.376+0000 7efc421ff700 1 -- start start 2023-08-10T10:31:09.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.376+0000 7efc421ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc3c0b5210 0x7efc3c1f68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.376+0000 7efc421ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc3c0b8870 0x7efc3c1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc421ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc421ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c14b130 con 0x7efc3c15cf20 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc421ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c1f6e00 con 0x7efc3c0b5210 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc421ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c14a4b0 con 0x7efc3c0b8870 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50602/0 (socket says 172.21.15.88:50602) 2023-08-10T10:31:09.381 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 -- 172.21.15.88:0/1765629198 learned_addr learned my addr 172.21.15.88:0/1765629198 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3b7fe700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc3c0b5210 0x7efc3c1f68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc33fff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc3c0b8870 0x7efc3c1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 -- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc3c0b8870 msgr2=0x7efc3c1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc3c0b8870 0x7efc3c1586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 -- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc3c0b5210 msgr2=0x7efc3c1f68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc3c0b5210 0x7efc3c1f68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 -- 172.21.15.88:0/1765629198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2c0094a0 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.377+0000 7efc3bfff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efc3400efc0 tx=0x7efc3400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.378+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400cb30 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.378+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400f040 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.378+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c14a790 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.378+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34014480 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.378+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c14ad50 con 0x7efc3c15cf20 2023-08-10T10:31:09.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.379+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c04ecc0 con 0x7efc3c15cf20 2023-08-10T10:31:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.380+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7efc340147f0 con 0x7efc3c15cf20 2023-08-10T10:31:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.380+0000 7efc38ff9700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 0x7efc1c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.381+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7efc3408a5d0 con 0x7efc3c15cf20 2023-08-10T10:31:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.381+0000 7efc3b7fe700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 0x7efc1c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.381+0000 7efc3b7fe700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 0x7efc1c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009790 tx=0x7efc2c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.385+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7efc34055380 con 0x7efc3c15cf20 2023-08-10T10:31:09.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.627+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc3c15e310 con 0x7efc3c15cf20 2023-08-10T10:31:09.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.627+0000 7efc38ff9700 1 -- 172.21.15.88:0/1765629198 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7efc340589a0 con 0x7efc3c15cf20 2023-08-10T10:31:09.629 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:09.629 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:31:09.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 msgr2=0x7efc1c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 0x7efc1c06d1a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7efc2c009790 tx=0x7efc2c01c040 comp rx=0 tx=0).stop 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 msgr2=0x7efc3c1f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7efc3400efc0 tx=0x7efc3400c3a0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 shutdown_connections 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7efc3c15cf20 0x7efc3c1f1d70 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc3c0b5210 0x7efc3c1f68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7efc1c06ace0 0x7efc1c06d1a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 --2- 172.21.15.88:0/1765629198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc3c0b8870 0x7efc3c1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 >> 172.21.15.88:0/1765629198 conn(0x7efc3c0d3080 msgr2=0x7efc3c15a380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:09.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 shutdown_connections 2023-08-10T10:31:09.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.630+0000 7efc421ff700 1 -- 172.21.15.88:0/1765629198 wait complete. 2023-08-10T10:31:09.633 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:31:09.649 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:31:09.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.842+0000 7ff5b3fff700 1 Processor -- start 2023-08-10T10:31:09.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.842+0000 7ff5b3fff700 1 -- start start 2023-08-10T10:31:09.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.843+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.843+0000 7ff5b3fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 0x7ff5ac070de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.843+0000 7ff5b3fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac0c9890 con 0x7ff5ac15ad10 2023-08-10T10:31:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.843+0000 7ff5b3fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac0b2870 con 0x7ff5ac070990 2023-08-10T10:31:09.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.843+0000 7ff5b3fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac071320 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b259c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 0x7ff5ac070de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b1d9b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff5ac15ad10 0x7ff5ac06b230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:39778/0 (socket says 172.21.15.88:39778) 2023-08-10T10:31:09.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b1d9b700 1 -- 172.21.15.88:0/1796482680 learned_addr learned my addr 172.21.15.88:0/1796482680 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:09.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:47604/0 (socket says 172.21.15.88:47604) 2023-08-10T10:31:09.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 -- 172.21.15.88:0/1796482680 >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 msgr2=0x7ff5ac070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:09.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 --2- 172.21.15.88:0/1796482680 >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 0x7ff5ac070de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 -- 172.21.15.88:0/1796482680 >> v1:172.21.15.187:6789/0 conn(0x7ff5ac15ad10 legacy=0x7ff5ac06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b159a700 1 -- 172.21.15.88:0/1796482680 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac15f820 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.844+0000 7ff5b259c700 1 --2- 172.21.15.88:0/1796482680 >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 0x7ff5ac070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:31:09.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b159a700 1 --2- 172.21.15.88:0/1796482680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009840 tx=0x7ff59c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e135b8b99738829 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b0d99700 1 -- 172.21.15.88:0/1796482680 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c011830 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b0d99700 1 -- 172.21.15.88:0/1796482680 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c011990 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b0d99700 1 -- 172.21.15.88:0/1796482680 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c011d20 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1796482680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 msgr2=0x7ff5ac0b2330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.845+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1796482680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009840 tx=0x7ff59c009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:09.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1796482680 shutdown_connections 2023-08-10T10:31:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1796482680 >> v2:172.21.15.187:3300/0 conn(0x7ff5ac070990 0x7ff5ac070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1796482680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac0b1eb0 0x7ff5ac0b2330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1796482680 >> 172.21.15.88:0/1796482680 conn(0x7ff5ac0ced50 msgr2=0x7ff5ac0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:09.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1796482680 shutdown_connections 2023-08-10T10:31:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.846+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1796482680 wait complete. 2023-08-10T10:31:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.848+0000 7ff5b3fff700 1 Processor -- start 2023-08-10T10:31:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.848+0000 7ff5b3fff700 1 -- start start 2023-08-10T10:31:09.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5ac070990 0x7ff5ac1540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac15ad10 0x7ff5ac15b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1f2ef0 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1545f0 con 0x7ff5ac070990 2023-08-10T10:31:09.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.849+0000 7ff5b3fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac1f2550 con 0x7ff5ac15ad10 2023-08-10T10:31:09.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50606/0 (socket says 172.21.15.88:50606) 2023-08-10T10:31:09.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 -- 172.21.15.88:0/1418890259 learned_addr learned my addr 172.21.15.88:0/1418890259 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b1d9b700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5ac070990 0x7ff5ac1540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b259c700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac15ad10 0x7ff5ac15b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 -- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac15ad10 msgr2=0x7ff5ac15b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac15ad10 0x7ff5ac15b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 -- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5ac070990 msgr2=0x7ff5ac1540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5ac070990 0x7ff5ac1540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 -- 172.21.15.88:0/1418890259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a4009a70 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5b159a700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.850+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0045d0 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.851+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c01f070 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.851+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59c0094a0 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.851+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0038e0 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.851+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac1f2b10 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.852+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac04ecc0 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.853+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff59c003a40 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.853+0000 7ff5a27fc700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 0x7ff59006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.854+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7ff59c021070 con 0x7ff5ac0b1eb0 2023-08-10T10:31:09.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.854+0000 7ff5b1d9b700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 0x7ff59006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.854+0000 7ff5b1d9b700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 0x7ff59006d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8005910 tx=0x7ff5a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:09.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:09.858+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff59c055d90 con 0x7ff5ac0b1eb0 2023-08-10T10:31:10.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.052+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5ac071a60 con 0x7ff5ac0b1eb0 2023-08-10T10:31:10.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.053+0000 7ff5a27fc700 1 -- 172.21.15.88:0/1418890259 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+20084 (secure 0 0 0) 0x7ff59c015090 con 0x7ff5ac0b1eb0 2023-08-10T10:31:10.055 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:10.056 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":27,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:30:38.869254+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:31:10.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 msgr2=0x7ff59006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 0x7ff59006d1a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8005910 tx=0x7ff5a8009040 comp rx=0 tx=0).stop 2023-08-10T10:31:10.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 msgr2=0x7ff5ac15b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0090b0 tx=0x7ff59c004750 comp rx=0 tx=0).stop 2023-08-10T10:31:10.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 shutdown_connections 2023-08-10T10:31:10.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff59006ace0 0x7ff59006d1a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5ac15ad10 0x7ff5ac15b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5ac070990 0x7ff5ac1540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 --2- 172.21.15.88:0/1418890259 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5ac0b1eb0 0x7ff5ac15b0f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 >> 172.21.15.88:0/1418890259 conn(0x7ff5ac0ced50 msgr2=0x7ff5ac0c2730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 shutdown_connections 2023-08-10T10:31:10.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.056+0000 7ff5b3fff700 1 -- 172.21.15.88:0/1418890259 wait complete. 2023-08-10T10:31:10.076 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:31:10.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.270+0000 7f8b6cfff700 1 Processor -- start 2023-08-10T10:31:10.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.270+0000 7f8b6cfff700 1 -- start start 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.271+0000 7f8b6cfff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 0x7f8b6815d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.271+0000 7f8b6cfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b680716d0 0x7f8b68070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.271+0000 7f8b6cfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b68071b50 0x7f8b68070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.271+0000 7f8b6cfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b6806a170 con 0x7f8b68071b50 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.271+0000 7f8b6cfff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b680cdeb0 con 0x7f8b68159d00 2023-08-10T10:31:10.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b6cfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b680ce190 con 0x7f8b680716d0 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b6659c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 0x7f8b6815d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b68071b50 0x7f8b68070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b6659c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 0x7f8b6815d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:51146/0 (socket says 172.21.15.88:51146) 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8b68071b50 0x7f8b68070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50610/0 (socket says 172.21.15.88:50610) 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b65d9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b680716d0 0x7f8b68070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b6659c700 1 -- 172.21.15.88:0/4055704516 learned_addr learned my addr 172.21.15.88:0/4055704516 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:10.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 -- 172.21.15.88:0/4055704516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b680716d0 msgr2=0x7f8b68070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:10.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 --2- 172.21.15.88:0/4055704516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b680716d0 0x7f8b68070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 -- 172.21.15.88:0/4055704516 >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 msgr2=0x7f8b6815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:10.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 --2- 172.21.15.88:0/4055704516 >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 0x7f8b6815d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.272+0000 7f8b66d9d700 1 -- 172.21.15.88:0/4055704516 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b680ce470 con 0x7f8b68071b50 2023-08-10T10:31:10.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.273+0000 7f8b66d9d700 1 --2- 172.21.15.88:0/4055704516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68070ed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b6806e0a0 tx=0x7f8b6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74fcce74aebb4d11 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.274+0000 7f8b6559a700 1 -- 172.21.15.88:0/4055704516 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b6000e070 con 0x7f8b68071b50 2023-08-10T10:31:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.274+0000 7f8b6559a700 1 -- 172.21.15.88:0/4055704516 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b6000bb20 con 0x7f8b68071b50 2023-08-10T10:31:10.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.274+0000 7f8b6559a700 1 -- 172.21.15.88:0/4055704516 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b60012430 con 0x7f8b68071b50 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 -- 172.21.15.88:0/4055704516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 msgr2=0x7f8b68070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/4055704516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68070ed0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8b6806e0a0 tx=0x7f8b6000b330 comp rx=0 tx=0).stop 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 -- 172.21.15.88:0/4055704516 shutdown_connections 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/4055704516 >> v2:172.21.15.187:3300/0 conn(0x7f8b68159d00 0x7f8b6815d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/4055704516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68070ed0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/4055704516 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b680716d0 0x7f8b68070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 -- 172.21.15.88:0/4055704516 >> 172.21.15.88:0/4055704516 conn(0x7f8b680ced50 msgr2=0x7f8b680cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:10.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 -- 172.21.15.88:0/4055704516 shutdown_connections 2023-08-10T10:31:10.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.275+0000 7f8b6cfff700 1 -- 172.21.15.88:0/4055704516 wait complete. 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.276+0000 7f8b6cfff700 1 Processor -- start 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.277+0000 7f8b6cfff700 1 -- start start 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b680716d0 0x7f8b6815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b68159d00 0x7f8b68152ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b681538c0 con 0x7f8b68071b50 2023-08-10T10:31:10.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68162e30 con 0x7f8b680716d0 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6cfff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b68166210 con 0x7f8b68159d00 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b65d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b65d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50624/0 (socket says 172.21.15.88:50624) 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b65d9b700 1 -- 172.21.15.88:0/538576107 learned_addr learned my addr 172.21.15.88:0/538576107 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b6659c700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b680716d0 0x7f8b6815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.278+0000 7f8b66d9d700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b68159d00 0x7f8b68152ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 -- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b68159d00 msgr2=0x7f8b68152ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b68159d00 0x7f8b68152ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 -- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b680716d0 msgr2=0x7f8b6815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b680716d0 0x7f8b6815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 -- 172.21.15.88:0/538576107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b60009a70 con 0x7f8b68071b50 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b65d9b700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00e870 tx=0x7f8b5c00eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c013680 con 0x7f8b68071b50 2023-08-10T10:31:10.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b5c0137e0 con 0x7f8b68071b50 2023-08-10T10:31:10.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b681664f0 con 0x7f8b68071b50 2023-08-10T10:31:10.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b5c013b90 con 0x7f8b68071b50 2023-08-10T10:31:10.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.279+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b68166ab0 con 0x7f8b68071b50 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.280+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b68162fa0 con 0x7f8b68071b50 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.281+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8b5c013cf0 con 0x7f8b68071b50 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.282+0000 7f8b56ffd700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 0x7f8b4806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.282+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f8b5c089580 con 0x7f8b68071b50 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.283+0000 7f8b6659c700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 0x7f8b4806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:10.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.283+0000 7f8b6659c700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 0x7f8b4806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009bd0 tx=0x7f8b580092c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:10.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.286+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8b5c054330 con 0x7f8b68071b50 2023-08-10T10:31:10.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.529+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b6804ecc0 con 0x7f8b68071b50 2023-08-10T10:31:10.531 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.529+0000 7f8b56ffd700 1 -- 172.21.15.88:0/538576107 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f8b5c057950 con 0x7f8b68071b50 2023-08-10T10:31:10.531 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:31:10.531 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:31:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.531+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 msgr2=0x7f8b4806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.531+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 0x7f8b4806d1a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8b58009bd0 tx=0x7f8b580092c0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.531+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 msgr2=0x7f8b68152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:10.533 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.531+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8b5c00e870 tx=0x7f8b5c00eb80 comp rx=0 tx=0).stop 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 shutdown_connections 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8b4806ace0 0x7f8b4806d1a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b68159d00 0x7f8b68152ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b680716d0 0x7f8b6815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 --2- 172.21.15.88:0/538576107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8b68071b50 0x7f8b68152960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 >> 172.21.15.88:0/538576107 conn(0x7f8b680ced50 msgr2=0x7f8b6806d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:10.534 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 shutdown_connections 2023-08-10T10:31:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:10.532+0000 7f8b6cfff700 1 -- 172.21.15.88:0/538576107 wait complete. 2023-08-10T10:31:10.535 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:31:10.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-10T10:30:33.791781+0000', 'modified': '2023-08-10T10:30:55.423262+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4293}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4293': {'gid': 4293, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6834/2975223265', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6832', 'nonce': 2975223265}, {'type': 'v1', 'addr': '172.21.15.187:6834', 'nonce': 2975223265}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4, 5], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-10T10:31:10.954 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-10T10:31:10.954 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-08-10T10:31:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.153+0000 7f75591ff700 1 Processor -- start 2023-08-10T10:31:11.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.153+0000 7f75591ff700 1 -- start start 2023-08-10T10:31:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.154+0000 7f75591ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 0x7f75540b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f75591ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540b5480 con 0x7f75540b5040 2023-08-10T10:31:11.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f75591ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75540b8e30 con 0x7f755415cf20 2023-08-10T10:31:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f75591ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cde30 con 0x7f75540b8870 2023-08-10T10:31:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755359e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f75540b5040 0x7f75540d1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58114/0 (socket says 172.21.15.88:58114) 2023-08-10T10:31:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755359e700 1 -- 172.21.15.88:0/2983609132 learned_addr learned my addr 172.21.15.88:0/2983609132 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:11.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755259c700 1 --2- 172.21.15.88:0/2983609132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 0x7f75540b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747949762 0 0) 0x7f75540b5480 con 0x7f75540b5040 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f753c0035b0 con 0x7f75540b5040 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394274702 0 0) 0x7f75540b8e30 con 0x7f755415cf20 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755259c700 1 -- 172.21.15.88:0/2983609132 >> v1:172.21.15.187:6789/0 conn(0x7f755415cf20 legacy=0x7f755415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755259c700 1 -- 172.21.15.88:0/2983609132 >> v1:172.21.15.88:6789/0 conn(0x7f75540b5040 legacy=0x7f75540d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.155+0000 7f755259c700 1 -- 172.21.15.88:0/2983609132 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75540ce010 con 0x7f75540b8870 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f755259c700 1 --2- 172.21.15.88:0/2983609132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 0x7f75540b4b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f7548009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e745fe422b5b0471 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548011830 con 0x7f75540b8870 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548011990 con 0x7f75540b8870 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f7551d9b700 1 -- 172.21.15.88:0/2983609132 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548011d20 con 0x7f75540b8870 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f75591ff700 1 -- 172.21.15.88:0/2983609132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 msgr2=0x7f75540b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.156+0000 7f75591ff700 1 --2- 172.21.15.88:0/2983609132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 0x7f75540b4b00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f7548009b80 comp rx=0 tx=0).stop 2023-08-10T10:31:11.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.157+0000 7f75591ff700 1 -- 172.21.15.88:0/2983609132 shutdown_connections 2023-08-10T10:31:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.157+0000 7f75591ff700 1 --2- 172.21.15.88:0/2983609132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75540b8870 0x7f75540b4b00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.157+0000 7f75591ff700 1 -- 172.21.15.88:0/2983609132 >> 172.21.15.88:0/2983609132 conn(0x7f75540d3080 msgr2=0x7f75540d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.157+0000 7f75591ff700 1 -- 172.21.15.88:0/2983609132 shutdown_connections 2023-08-10T10:31:11.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.157+0000 7f75591ff700 1 -- 172.21.15.88:0/2983609132 wait complete. 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.158+0000 7f75591ff700 1 Processor -- start 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.158+0000 7f75591ff700 1 -- start start 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75540b8870 0x7f75540cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f755415cf20 0x7f75541f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cca80 con 0x7f75540b5040 2023-08-10T10:31:11.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cbe70 con 0x7f75540b8870 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.159+0000 7f75591ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75540cc150 con 0x7f755415cf20 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50636/0 (socket says 172.21.15.88:50636) 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 -- 172.21.15.88:0/2576263476 learned_addr learned my addr 172.21.15.88:0/2576263476 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f755259c700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75540b8870 0x7f75540cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f755359e700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f755415cf20 0x7f75541f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 -- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f755415cf20 msgr2=0x7f75541f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f755415cf20 0x7f75541f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 -- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75540b8870 msgr2=0x7f75540cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75540b8870 0x7f75540cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 -- 172.21.15.88:0/2576263476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480094a0 con 0x7f75540b5040 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.160+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f75440011e0 tx=0x7f754400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.161+0000 7f753b7fe700 1 -- 172.21.15.88:0/2576263476 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75440054e0 con 0x7f75540b5040 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.161+0000 7f753b7fe700 1 -- 172.21.15.88:0/2576263476 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7544003680 con 0x7f75540b5040 2023-08-10T10:31:11.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.161+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75540cc430 con 0x7f75540b5040 2023-08-10T10:31:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.161+0000 7f753b7fe700 1 -- 172.21.15.88:0/2576263476 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7544003a30 con 0x7f75540b5040 2023-08-10T10:31:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.161+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755414ddd0 con 0x7f75540b5040 2023-08-10T10:31:11.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.163+0000 7f753b7fe700 1 -- 172.21.15.88:0/2576263476 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7544003b90 con 0x7f75540b5040 2023-08-10T10:31:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.164+0000 7f753b7fe700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 0x7f754006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.164+0000 7f753b7fe700 1 -- 172.21.15.88:0/2576263476 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f7544088c60 con 0x7f75540b5040 2023-08-10T10:31:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.164+0000 7f755259c700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 0x7f754006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.165+0000 7f755259c700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 0x7f754006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75480097c0 tx=0x7f754801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.165+0000 7f756cbe9b80 1 Processor -- start 2023-08-10T10:31:11.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 -- start start 2023-08-10T10:31:11.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315d22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d26ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315c70ab0 con 0x55d315cfc230 2023-08-10T10:31:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315c55440 con 0x55d315d26660 2023-08-10T10:31:11.172 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.166+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d315c52ba0 con 0x55d315cf9920 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50638/0 (socket says 172.21.15.88:50638) 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 -- 172.21.15.88:0/3887666446 learned_addr learned my addr 172.21.15.88:0/3887666446 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f755259c700 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315d22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f755359e700 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d26ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 -- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 msgr2=0x55d315d22b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315d22b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 -- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 msgr2=0x55d315d26ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d26ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 -- 172.21.15.88:0/3887666446 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d315a41790 con 0x55d315cfc230 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7552d9d700 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75440050a0 tx=0x7f7544057070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa6cd6d8158d975 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.167+0000 7f7538ff9700 1 -- 172.21.15.88:0/3887666446 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754405f990 con 0x55d315cfc230 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f7538ff9700 1 -- 172.21.15.88:0/3887666446 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440559e0 con 0x55d315cfc230 2023-08-10T10:31:11.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f7538ff9700 1 -- 172.21.15.88:0/3887666446 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754405f740 con 0x55d315cfc230 2023-08-10T10:31:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 -- 172.21.15.88:0/3887666446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 msgr2=0x55d315cfc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f75440050a0 tx=0x7f7544057070 comp rx=0 tx=0).stop 2023-08-10T10:31:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 -- 172.21.15.88:0/3887666446 shutdown_connections 2023-08-10T10:31:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d26ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.178 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315cfc610 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/3887666446 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315d22b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 -- 172.21.15.88:0/3887666446 >> 172.21.15.88:0/3887666446 conn(0x55d315c5c3a0 msgr2=0x55d315d41380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 -- 172.21.15.88:0/3887666446 shutdown_connections 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.168+0000 7f756cbe9b80 1 -- 172.21.15.88:0/3887666446 wait complete. 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.169+0000 7f756cbe9b80 1 -- start start 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.169+0000 7f756cbe9b80 1 Processor -- start 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cf9920 0x55d315d27520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.179 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315d26660 0x55d315d29290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315c4e490 con 0x55d315cfc230 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315c0b5b0 con 0x55d315cf9920 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d315bf1910 con 0x55d315d26660 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f756cbe9b80 10 client.0 _ll_register_callbacks cb 0x55d315a4aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:31:11.180 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.170+0000 7f755259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50648/0 (socket says 172.21.15.88:50648) 2023-08-10T10:31:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 -- 172.21.15.88:0/2587698913 learned_addr learned my addr 172.21.15.88:0/2587698913 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cf9920 0x55d315d27520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755359e700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315d26660 0x55d315d29290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 -- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315d26660 msgr2=0x55d315d29290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315d26660 0x55d315d29290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 -- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cf9920 msgr2=0x55d315d27520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cf9920 0x55d315d27520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 -- 172.21.15.88:0/2587698913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755414ddd0 con 0x55d315cfc230 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f755259c700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7548011960 tx=0x7f754800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87a85e485f16bf8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f7531ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-08-10T10:31:11.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754802d040 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f754801f040 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.171+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d315ceecc0 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7548031420 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 10 client.4890 fetch_fsmap learned FSMap version 9 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d315b2e0a0 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d315ceecc0 con 0x55d315cfc230 2023-08-10T10:31:11.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f7548031580 con 0x55d315cfc230 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 10 client.4890 fetch_fsmap finished waiting for FSMap version 9 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 10 client.4890 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 20 client.4890 populate_metadata read hostname 'smithi088' 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d1bca0 0x55d315d24f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 4 client.4890 mds_command: new command op to 4293 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 --> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d315ccba90 con 0x55d315d1bca0 2023-08-10T10:31:11.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.172+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d1bca0 0x55d315d24f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.173+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d1bca0 0x55d315d24f20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed2f8e01656d965d server_cookie=ae389d86d4fc5dec in_seq=0 out_seq=0 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.173+0000 7f7531ffb700 10 client.4890 ms_handle_connect on v2:172.21.15.187:6832/2975223265 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f7531ffb700 1 -- 172.21.15.88:0/2587698913 <== mds.0 v2:172.21.15.187:6832/2975223265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18017 (crc 0 0 0) 0x55d315ccba90 con 0x55d315d1bca0 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f7531ffb700 10 client.4890 handle_command_reply: tid=0 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 client.4890 shutdown 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 msgr2=0x55d315d16b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f7548011960 tx=0x7f754800e000 comp rx=0 tx=0).stop 2023-08-10T10:31:11.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 shutdown_connections 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d1bca0 0x55d315d24f20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315d26660 0x55d315d29290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cf9920 0x55d315d27520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f7531ffb700 0 client.4890 ms_handle_reset on v2:172.21.15.187:6832/2975223265 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2587698913 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d16b90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 >> 172.21.15.88:0/2587698913 conn(0x55d315c5c3a0 msgr2=0x55d315cfb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 shutdown_connections 2023-08-10T10:31:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.174+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2587698913 wait complete. 2023-08-10T10:31:11.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.175+0000 7f756cbe9b80 20 client.4890 trim_cache size 0 max 16384 2023-08-10T10:31:11.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.192+0000 7f756cbe9b80 1 Processor -- start 2023-08-10T10:31:11.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.192+0000 7f756cbe9b80 1 -- start start 2023-08-10T10:31:11.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cfc230 0x55d315d27f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315a42390 con 0x55d315d26660 2023-08-10T10:31:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315d23770 con 0x55d315cfc230 2023-08-10T10:31:11.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.193+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d315cfd670 con 0x55d315cf9920 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50654/0 (socket says 172.21.15.88:50654) 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 -- 172.21.15.88:0/692837809 learned_addr learned my addr 172.21.15.88:0/692837809 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755259c700 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cfc230 0x55d315d27f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f7552d9d700 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 -- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 msgr2=0x55d315cf7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 -- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cfc230 msgr2=0x55d315d27f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cfc230 0x55d315d27f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 -- 172.21.15.88:0/692837809 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d315cfccd0 con 0x55d315d26660 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f755359e700 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f754c015490 tx=0x7f754c0157a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7dd61a56efd103 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f75397fa700 1 -- 172.21.15.88:0/692837809 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c01f470 con 0x55d315d26660 2023-08-10T10:31:11.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f75397fa700 1 -- 172.21.15.88:0/692837809 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c01f5d0 con 0x55d315d26660 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.194+0000 7f75397fa700 1 -- 172.21.15.88:0/692837809 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754c01f940 con 0x55d315d26660 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 -- 172.21.15.88:0/692837809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 msgr2=0x55d315d24ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f754c015490 tx=0x7f754c0157a0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 -- 172.21.15.88:0/692837809 shutdown_connections 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315d26660 0x55d315d24ef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/692837809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315cfc230 0x55d315d27f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 -- 172.21.15.88:0/692837809 >> 172.21.15.88:0/692837809 conn(0x55d315c5c3a0 msgr2=0x55d315cf2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 -- 172.21.15.88:0/692837809 shutdown_connections 2023-08-10T10:31:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.195+0000 7f756cbe9b80 1 -- 172.21.15.88:0/692837809 wait complete. 2023-08-10T10:31:11.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.196+0000 7f756cbe9b80 1 -- start start 2023-08-10T10:31:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.196+0000 7f756cbe9b80 1 Processor -- start 2023-08-10T10:31:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d9adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315d1f620 con 0x55d315cfc230 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d315d28670 con 0x55d315d26660 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d315d28ba0 con 0x55d315cf9920 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f756cbe9b80 10 client.0 _ll_register_callbacks cb 0x55d315a4aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:50666/0 (socket says 172.21.15.88:50666) 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755259c700 1 -- 172.21.15.88:0/2978850263 learned_addr learned my addr 172.21.15.88:0/2978850263 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:11.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755359e700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d9adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755259c700 1 -- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 msgr2=0x55d315cf7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.197+0000 7f755259c700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f755259c700 1 -- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 msgr2=0x55d315d9adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f755259c700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d9adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f755259c700 1 -- 172.21.15.88:0/2978850263 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f753c0035b0 con 0x55d315cfc230 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f755359e700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d9adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:11.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f755259c700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75480090b0 tx=0x7f7548011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65812ee17256a20c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 10 client.0 ms_handle_connect on v2:172.21.15.88:3300/0 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754802d040 con 0x55d315cfc230 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f75440559e0 con 0x55d315cfc230 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mon.0 v2:172.21.15.88:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f754801f070 con 0x55d315cfc230 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7548037460 con 0x55d315cfc230 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 10 client.4896 fetch_fsmap learned FSMap version 9 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x55d315c13b10 con 0x55d315cfc230 2023-08-10T10:31:11.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mon.0 v2:172.21.15.88:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75440559e0 con 0x55d315cfc230 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mon.0 v2:172.21.15.88:3300/0 5 ==== fsmap(e 9) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f7548037760 con 0x55d315cfc230 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 10 client.4896 fetch_fsmap finished waiting for FSMap version 9 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 10 client.4896 resolve_mds: resolved name 'd' to daemon mds.d 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.198+0000 7f756cbe9b80 20 client.4896 populate_metadata read hostname 'smithi088' 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d18d90 0x55d315d19170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f756cbe9b80 4 client.4896 mds_command: new command op to 4293 tid=0[{"prefix": "status"}] 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 --> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d315c475d0 con 0x55d315d18d90 2023-08-10T10:31:11.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d18d90 0x55d315d19170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f7552d9d700 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d18d90 0x55d315d19170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0b3f7082b7142c1 server_cookie=79d8652d74554ce1 in_seq=0 out_seq=0 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.199+0000 7f7531ffb700 10 client.4896 ms_handle_connect on v2:172.21.15.187:6832/2975223265 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f7531ffb700 1 -- 172.21.15.88:0/2978850263 <== mds.0 v2:172.21.15.187:6832/2975223265 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55d315c475d0 con 0x55d315d18d90 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f7531ffb700 10 client.4896 handle_command_reply: tid=0 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 client.4896 shutdown 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 msgr2=0x55d315d44c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f75480090b0 tx=0x7f7548011000 comp rx=0 tx=0).stop 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 shutdown_connections 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:6832/2975223265,v1:172.21.15.187:6834/2975223265] conn(0x55d315d18d90 0x55d315d19170 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d315d26660 0x55d315d9adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d315cf9920 0x55d315cf7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 --2- 172.21.15.88:0/2978850263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x55d315cfc230 0x55d315d44c10 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 >> 172.21.15.88:0/2978850263 conn(0x55d315c5c3a0 msgr2=0x55d315d27f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f7531ffb700 0 client.4896 ms_handle_reset on v2:172.21.15.187:6832/2975223265 2023-08-10T10:31:11.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 shutdown_connections 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 1 -- 172.21.15.88:0/2978850263 wait complete. 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.200+0000 7f756cbe9b80 20 client.4896 trim_cache size 0 max 16384 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stdout: "cluster_fsid": "bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c", 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stdout: "whoami": 0, 2023-08-10T10:31:11.210 INFO:teuthology.orchestra.run.smithi088.stdout: "id": 4293, 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "want_state": "up:active", 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "state": "up:active", 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "fs_name": "cephfs", 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "rank_uptime": 36.879114293000001, 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "mdsmap_epoch": 9, 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch": 27, 2023-08-10T10:31:11.211 INFO:teuthology.orchestra.run.smithi088.stdout: "osdmap_epoch_barrier": 27, 2023-08-10T10:31:11.212 INFO:teuthology.orchestra.run.smithi088.stdout: "uptime": 42.723306721 2023-08-10T10:31:11.212 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:31:11.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 msgr2=0x7f754006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 0x7f754006d1a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f75480097c0 tx=0x7f754801c040 comp rx=0 tx=0).stop 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 msgr2=0x7f75540cb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f75440011e0 tx=0x7f754400ca30 comp rx=0 tx=0).stop 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 shutdown_connections 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f754006ace0 0x7f754006d1a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f755415cf20 0x7f75541f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75540b5040 0x7f75540cb2b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 --2- 172.21.15.88:0/2576263476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75540b8870 0x7f75540cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 >> 172.21.15.88:0/2576263476 conn(0x7f75540d3080 msgr2=0x7f75540d1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 shutdown_connections 2023-08-10T10:31:11.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:11.201+0000 7f75591ff700 1 -- 172.21.15.88:0/2576263476 wait complete. 2023-08-10T10:31:11.219 INFO:teuthology.run_tasks:Running task kclient... 2023-08-10T10:31:11.231 INFO:tasks.kclient:Mounting kernel clients... 2023-08-10T10:31:11.232 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-10T10:31:11.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.232 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:31:11.278 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-10T10:31:11.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-10T10:31:11.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.390 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-08-10T10:31:11.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.497 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:31:11.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.548 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-08-10T10:31:11.621 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-08-10T10:31:11.624 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:31:11.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.625 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:31:11.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.678 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-08-10T10:31:11.755 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-08-10T10:31:11.757 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:31:11.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.758 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:31:11.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:11.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-08-10T10:31:11.917 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-08-10T10:31:11.919 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:31:11.920 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-08-10T10:31:11.920 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:31:11.921 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:11.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:31:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.116+0000 7f39975ff700 1 Processor -- start 2023-08-10T10:31:12.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.116+0000 7f39975ff700 1 -- start start 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f399015cf20 0x7f399015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b8870 0x7f39900b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39900b5040 0x7f399006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39900cde30 con 0x7f399015cf20 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39900b5480 con 0x7f39900b5040 2023-08-10T10:31:12.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.117+0000 7f39975ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f399015e590 con 0x7f39900b8870 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f399015cf20 0x7f399015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f399015cf20 0x7f399015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37858/0 (socket says 172.21.15.88:37858) 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 -- 172.21.15.88:0/2928892640 learned_addr learned my addr 172.21.15.88:0/2928892640 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f3994b9a700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b8870 0x7f39900b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f3995b9c700 1 --2- 172.21.15.88:0/2928892640 >> v2:172.21.15.187:3300/0 conn(0x7f39900b5040 0x7f399006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 -- 172.21.15.88:0/2928892640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b8870 msgr2=0x7f39900b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b8870 0x7f39900b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 -- 172.21.15.88:0/2928892640 >> v2:172.21.15.187:3300/0 conn(0x7f39900b5040 msgr2=0x7f399006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 --2- 172.21.15.88:0/2928892640 >> v2:172.21.15.187:3300/0 conn(0x7f39900b5040 0x7f399006a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 -- 172.21.15.88:0/2928892640 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39900b8e30 con 0x7f399015cf20 2023-08-10T10:31:12.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.118+0000 7f399539b700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f399015e050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39900d2920 tx=0x7f398c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7140a852d2d4dd68 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f3987fff700 1 -- 172.21.15.88:0/2928892640 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c011830 con 0x7f399015cf20 2023-08-10T10:31:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f3987fff700 1 -- 172.21.15.88:0/2928892640 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398c011990 con 0x7f399015cf20 2023-08-10T10:31:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f3987fff700 1 -- 172.21.15.88:0/2928892640 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398c011d20 con 0x7f399015cf20 2023-08-10T10:31:12.123 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 -- 172.21.15.88:0/2928892640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 msgr2=0x7f399015e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f399015e050 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f39900d2920 tx=0x7f398c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 -- 172.21.15.88:0/2928892640 shutdown_connections 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 --2- 172.21.15.88:0/2928892640 >> v2:172.21.15.187:3300/0 conn(0x7f39900b5040 0x7f399006a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f399015e050 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 --2- 172.21.15.88:0/2928892640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b8870 0x7f39900b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.124 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 -- 172.21.15.88:0/2928892640 >> 172.21.15.88:0/2928892640 conn(0x7f39900d3080 msgr2=0x7f39900d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.119+0000 7f39975ff700 1 -- 172.21.15.88:0/2928892640 shutdown_connections 2023-08-10T10:31:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.120+0000 7f39975ff700 1 -- 172.21.15.88:0/2928892640 wait complete. 2023-08-10T10:31:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.121+0000 7f39975ff700 1 Processor -- start 2023-08-10T10:31:12.125 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.121+0000 7f39975ff700 1 -- start start 2023-08-10T10:31:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 0x7f39900b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.126 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39900b8870 0x7f39900ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900b3dd0 con 0x7f399015cf20 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39900cd040 con 0x7f39900b8870 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.122+0000 7f39975ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39900b3150 con 0x7f39900b5040 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.127 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37864/0 (socket says 172.21.15.88:37864) 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 -- 172.21.15.88:0/4030867367 learned_addr learned my addr 172.21.15.88:0/4030867367 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3994b9a700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39900b8870 0x7f39900ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f399539b700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 0x7f39900b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 -- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 msgr2=0x7f39900b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 0x7f39900b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 -- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39900b8870 msgr2=0x7f39900ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:12.128 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39900b8870 0x7f39900ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 -- 172.21.15.88:0/4030867367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398c009550 con 0x7f399015cf20 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f399539b700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 0x7f39900b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.123+0000 7f3995b9c700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f398800eed0 tx=0x7f398800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.124+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988010040 con 0x7f399015cf20 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.124+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f398800ba70 con 0x7f399015cf20 2023-08-10T10:31:12.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.124+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800be20 con 0x7f399015cf20 2023-08-10T10:31:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.124+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39900b3430 con 0x7f399015cf20 2023-08-10T10:31:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.124+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39900b39f0 con 0x7f399015cf20 2023-08-10T10:31:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.125+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39900b3f10 con 0x7f399015cf20 2023-08-10T10:31:12.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.126+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f398801d400 con 0x7f399015cf20 2023-08-10T10:31:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.127+0000 7f3985ffb700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 0x7f397406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.127+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6813+0+0 (secure 0 0 0) 0x7f3988089da0 con 0x7f399015cf20 2023-08-10T10:31:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.127+0000 7f399539b700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 0x7f397406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:12.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.127+0000 7f399539b700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 0x7f397406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f398c014040 tx=0x7f398c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:12.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.131+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f39900b3f10 con 0x7f399015cf20 2023-08-10T10:31:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.371+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f39900b3f10 con 0x7f399015cf20 2023-08-10T10:31:12.373 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.372+0000 7f3985ffb700 1 -- 172.21.15.88:0/4030867367 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f39900b3f10 con 0x7f399015cf20 2023-08-10T10:31:12.374 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:31:12.375 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 msgr2=0x7f397406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 0x7f397406d1a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f398c014040 tx=0x7f398c008030 comp rx=0 tx=0).stop 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 msgr2=0x7f39901f5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f398800eed0 tx=0x7f398800ef00 comp rx=0 tx=0).stop 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 shutdown_connections 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f399015cf20 0x7f39901f5d90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f397406ace0 0x7f397406d1a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.376 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39900b5040 0x7f39900b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 --2- 172.21.15.88:0/4030867367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39900b8870 0x7f39900ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:12.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 >> 172.21.15.88:0/4030867367 conn(0x7f39900d3080 msgr2=0x7f399015faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:12.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 shutdown_connections 2023-08-10T10:31:12.377 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:12.374+0000 7f39975ff700 1 -- 172.21.15.88:0/4030867367 wait complete. 2023-08-10T10:31:12.393 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:31:12.394 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:31:12.394 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-08-10T10:31:12.394 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-10T10:31:12.394 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:12.394 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:31:12.395 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:31:12.395 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:31:12.395 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:31:12.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.395 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:12.442 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-08-10T10:31:12.443 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 41856sec preferred_lft 41856sec 2023-08-10T10:31:12.444 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-08-10T10:31:12.445 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:12.446 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:31:12.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.447 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:12.447 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:12.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:31:12.447 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-08-10T10:31:12.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-08-10T10:31:12.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:31:12.448 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:12.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.681 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:31:12.750 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-08-10T10:31:12.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.753 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-08-10T10:31:12.802 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-08-10T10:31:12.802 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:31:12.803 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:31:12.803 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:31:12.803 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:31:12.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.804 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:12.805 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:12.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:31:12.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:31:12.805 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:31:12.806 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:12.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:12.975 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:31:13.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:13.022 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-08-10T10:31:13.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:13.109 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:13.110 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:13.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:31:13.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-10T10:31:13.110 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:13.253 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-10T10:31:13.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:13.254 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:13.254 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:13.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-10T10:31:13.254 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:31:13.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-10T10:31:13.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-10T10:31:13.255 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-10T10:31:13.255 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:13.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:13.501 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:13.502 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:13.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-08-10T10:31:13.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:31:13.502 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:13.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:13.675 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:13.721 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-10T10:31:13.721 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:13.722 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:13.806 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-08-10T10:31:13.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:13.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:13.950 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:13.950 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:14.402 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:14.402 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:14.402 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-08-10T10:31:14.402 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 0@bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.cephfs=/ 2023-08-10T10:31:14.403 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.88:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-08-10T10:31:14.408 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:31:14.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:14.409 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:14.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:14.479 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:14.568 INFO:teuthology.orchestra.run.smithi088.stdout:client4905 2023-08-10T10:31:14.568 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:31:14.569 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:31:14.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:14.615 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:14.741 INFO:teuthology.orchestra.run.smithi088.stdout:client4905 2023-08-10T10:31:14.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:14.742 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:14.830 INFO:teuthology.orchestra.run.smithi088.stdout:client4905 2023-08-10T10:31:14.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:14.831 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.client4905/status') 2023-08-10T10:31:14.937 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.4905 (3)192.168.0.1:0/4090994053 2023-08-10T10:31:14.938 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2023-08-10T10:31:14.938 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2023-08-10T10:31:14.938 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2023-08-10T10:31:14.939 INFO:teuthology.orchestra.run.smithi088.stderr:69 bytes copied, 5.9931e-05 s, 1.2 MB/s 2023-08-10T10:31:14.940 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-08-10T10:31:14.941 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:31:14.941 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:14.941 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:31:15.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.135+0000 7f6e023ff700 1 Processor -- start 2023-08-10T10:31:15.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.135+0000 7f6e023ff700 1 -- start start 2023-08-10T10:31:15.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.136+0000 7f6e023ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e023ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6dfc0716d0 0x7f6dfc070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e023ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dfc06a170 con 0x7f6dfc071b50 2023-08-10T10:31:15.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e023ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dfc0cdeb0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e023ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0ce190 con 0x7f6dfc159d00 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e0099c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6dfc071b50 0x7f6dfc06a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55664/0 (socket says 172.21.15.88:55664) 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6e0099c700 1 -- 172.21.15.88:0/1096060574 learned_addr learned my addr 172.21.15.88:0/1096060574 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/1096060574 >> v2:172.21.15.187:3300/0 conn(0x7f6dfc0716d0 0x7f6dfc070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfbfff700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfaffd700 1 -- 172.21.15.88:0/1096060574 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243443562 0 0) 0x7f6dfc06a170 con 0x7f6dfc071b50 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfaffd700 1 -- 172.21.15.88:0/1096060574 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6de40035b0 con 0x7f6dfc071b50 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfb7fe700 1 -- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 msgr2=0x7f6dfc15d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:15.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.137+0000 7f6dfb7fe700 1 -- 172.21.15.88:0/1096060574 >> v1:172.21.15.88:6789/0 conn(0x7f6dfc071b50 legacy=0x7f6dfc06a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.138+0000 7f6dfb7fe700 1 -- 172.21.15.88:0/1096060574 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dfc0ce470 con 0x7f6dfc0716d0 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.138+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc070990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009840 tx=0x7f6df0009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9902efe1bb9c65d3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.138+0000 7f6dfaffd700 1 -- 172.21.15.88:0/1096060574 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0011830 con 0x7f6dfc0716d0 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.138+0000 7f6dfaffd700 1 -- 172.21.15.88:0/1096060574 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df0011990 con 0x7f6dfc0716d0 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.138+0000 7f6dfaffd700 1 -- 172.21.15.88:0/1096060574 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0011d00 con 0x7f6dfc0716d0 2023-08-10T10:31:15.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 -- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc0716d0 msgr2=0x7f6dfc070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc070990 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009840 tx=0x7f6df0009b50 comp rx=0 tx=0).stop 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 -- 172.21.15.88:0/1096060574 shutdown_connections 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 --2- 172.21.15.88:0/1096060574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc070990 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 -- 172.21.15.88:0/1096060574 >> 172.21.15.88:0/1096060574 conn(0x7f6dfc0ced50 msgr2=0x7f6dfc0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 -- 172.21.15.88:0/1096060574 shutdown_connections 2023-08-10T10:31:15.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.139+0000 7f6e023ff700 1 -- 172.21.15.88:0/1096060574 wait complete. 2023-08-10T10:31:15.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.141+0000 7f6e023ff700 1 Processor -- start 2023-08-10T10:31:15.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.142+0000 7f6e023ff700 1 -- start start 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 0x7f6dfc14dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0c6850 con 0x7f6dfc0716d0 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0c8b50 con 0x7f6dfc071b50 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6e023ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dfc0c5eb0 con 0x7f6dfc159d00 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:15.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37872/0 (socket says 172.21.15.88:37872) 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 -- 172.21.15.88:0/729444083 learned_addr learned my addr 172.21.15.88:0/729444083 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 -- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 msgr2=0x7f6dfc15c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 0x7f6dfc14dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 -- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 msgr2=0x7f6dfc14dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 0x7f6dfc14dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfbfff700 1 -- 172.21.15.88:0/729444083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df00094a0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.143+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 0x7f6dfc14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6dfbfff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e870 tx=0x7f6dec00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec009590 con 0x7f6dfc0716d0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec00ee70 con 0x7f6dfc0716d0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dfc0c6190 con 0x7f6dfc0716d0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec00ca50 con 0x7f6dfc0716d0 2023-08-10T10:31:15.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.144+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dfc0c87b0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.145+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dfc04ecc0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.146+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6dec00cbb0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.147+0000 7f6df8ff9700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 0x7f6de806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:15.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.147+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6dec0896f0 con 0x7f6dfc0716d0 2023-08-10T10:31:15.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.147+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 0x7f6de806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:15.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.148+0000 7f6dfb7fe700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 0x7f6de806d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009fd0 tx=0x7f6df0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:15.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.151+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6dec057f90 con 0x7f6dfc0716d0 2023-08-10T10:31:15.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.394+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6dfc1e4690 con 0x7f6dfc0716d0 2023-08-10T10:31:15.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.395+0000 7f6df8ff9700 1 -- 172.21.15.88:0/729444083 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6dec021070 con 0x7f6dfc0716d0 2023-08-10T10:31:15.396 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 msgr2=0x7f6de806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 0x7f6de806d1a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009fd0 tx=0x7f6df0008030 comp rx=0 tx=0).stop 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 msgr2=0x7f6dfc0c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6dec00e870 tx=0x7f6dec00ec30 comp rx=0 tx=0).stop 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 shutdown_connections 2023-08-10T10:31:15.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6de806ace0 0x7f6de806d1a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dfc159d00 0x7f6dfc15c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6dfc0716d0 0x7f6dfc0c8270 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 --2- 172.21.15.88:0/729444083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dfc071b50 0x7f6dfc14dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 >> 172.21.15.88:0/729444083 conn(0x7f6dfc0ced50 msgr2=0x7f6dfc0b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 shutdown_connections 2023-08-10T10:31:15.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:15.397+0000 7f6e023ff700 1 -- 172.21.15.88:0/729444083 wait complete. 2023-08-10T10:31:15.415 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:31:15.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:31:15.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-08-10T10:31:15.416 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-10T10:31:15.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:15.417 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:31:15.417 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:31:15.417 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:31:15.417 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:31:15.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.418 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-08-10T10:31:15.464 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:15.464 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:15.464 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:15.464 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:15.465 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 41853sec preferred_lft 41853sec 2023-08-10T10:31:15.466 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether ce:11:43:f5:72:b0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::546a:50ff:fec7:f9b7/64 scope link 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.467 INFO:teuthology.orchestra.run.smithi088.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:31:15.468 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether ce:11:43:f5:72:b0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:31:15.468 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::cc11:43ff:fef5:72b0/64 scope link tentative 2023-08-10T10:31:15.468 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:15.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.469 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:31:15.579 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-08-10T10:31:15.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.582 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-08-10T10:31:15.632 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-08-10T10:31:15.632 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:31:15.633 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:31:15.633 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:31:15.633 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:31:15.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.633 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:15.634 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:15.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:31:15.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:31:15.634 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:31:15.635 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:15.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.804 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:31:15.850 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:31:15.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.851 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-08-10T10:31:15.897 INFO:teuthology.orchestra.run.smithi088.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-10T10:31:15.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:15.899 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:15.900 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:15.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:31:15.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-10T10:31:15.901 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:16.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:31:16.153 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:16.153 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 62:69:31:9c:ad:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.154 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::6069:31ff:fe9c:ad0d/64 scope link 2023-08-10T10:31:16.155 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.156 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-10T10:31:16.226 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:16.227 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 62:69:31:9c:ad:0d brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:31:16.228 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:31:16.228 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.228 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::6069:31ff:fe9c:ad0d/64 scope link 2023-08-10T10:31:16.228 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:16.229 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-10T10:31:16.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.230 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:16.230 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:16.230 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-10T10:31:16.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:31:16.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-10T10:31:16.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-10T10:31:16.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-10T10:31:16.231 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:16.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.477 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-08-10T10:31:16.477 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-08-10T10:31:16.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.1 up 2023-08-10T10:31:16.477 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:31:16.478 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-08-10T10:31:16.649 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:16.649 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:16.695 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-10T10:31:16.696 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:16.696 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:16.779 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-08-10T10:31:16.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:16.924 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:16.924 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:16.952 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:16.953 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:16.953 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-08-10T10:31:16.953 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 2@bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.cephfs=/ 2023-08-10T10:31:16.953 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.88:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-08-10T10:31:16.958 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:31:16.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:16.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:17.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:17.027 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:17.115 INFO:teuthology.orchestra.run.smithi088.stdout:client4914 2023-08-10T10:31:17.115 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:31:17.115 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:31:17.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:17.161 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:17.289 INFO:teuthology.orchestra.run.smithi088.stdout:client4914 2023-08-10T10:31:17.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:17.290 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:17.378 INFO:teuthology.orchestra.run.smithi088.stdout:client4914 2023-08-10T10:31:17.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:17.379 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.client4914/status') 2023-08-10T10:31:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:instance: client.4914 (3)192.168.0.2:0/2303994769 2023-08-10T10:31:17.488 INFO:teuthology.orchestra.run.smithi088.stdout:blocklisted: false 2023-08-10T10:31:17.489 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records in 2023-08-10T10:31:17.489 INFO:teuthology.orchestra.run.smithi088.stderr:0+1 records out 2023-08-10T10:31:17.489 INFO:teuthology.orchestra.run.smithi088.stderr:69 bytes copied, 5.1683e-05 s, 1.3 MB/s 2023-08-10T10:31:17.491 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-08-10T10:31:17.491 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:31:17.492 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:17.492 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:31:17.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.688+0000 7f5cf57ff700 1 Processor -- start 2023-08-10T10:31:17.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.688+0000 7f5cf57ff700 1 -- start start 2023-08-10T10:31:17.692 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.689+0000 7f5cf57ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.689+0000 7f5cf57ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5cf00b5210 0x7f5cf00d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.693 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cf57ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf015e590 con 0x7f5cf00b8870 2023-08-10T10:31:17.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cf57ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf00cde30 con 0x7f5cf00b5210 2023-08-10T10:31:17.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cf57ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf00b8e30 con 0x7f5cf015cf20 2023-08-10T10:31:17.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.694 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cef7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5cf00b5210 0x7f5cf00d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:50704/0 (socket says 172.21.15.88:50704) 2023-08-10T10:31:17.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5ceeffd700 1 -- 172.21.15.88:0/1395657542 learned_addr learned my addr 172.21.15.88:0/1395657542 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:17.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cef7fe700 1 -- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 msgr2=0x7f5cf015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:17.695 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cef7fe700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cef7fe700 1 -- 172.21.15.88:0/1395657542 >> v1:172.21.15.187:6789/0 conn(0x7f5cf00b8870 legacy=0x7f5cf00b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5cef7fe700 1 -- 172.21.15.88:0/1395657542 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00ce010 con 0x7f5cf00b5210 2023-08-10T10:31:17.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.690+0000 7f5ceeffd700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:31:17.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.691+0000 7f5cef7fe700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b5210 0x7f5cf00d1350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009d90 tx=0x7f5ce800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db0a828a31da0cb5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:17.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.691+0000 7f5cedffb700 1 -- 172.21.15.88:0/1395657542 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800e070 con 0x7f5cf00b5210 2023-08-10T10:31:17.697 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.691+0000 7f5cedffb700 1 -- 172.21.15.88:0/1395657542 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800bb20 con 0x7f5cf00b5210 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.691+0000 7f5cedffb700 1 -- 172.21.15.88:0/1395657542 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8012430 con 0x7f5cf00b5210 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 -- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b5210 msgr2=0x7f5cf00d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b5210 0x7f5cf00d1350 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009d90 tx=0x7f5ce800b330 comp rx=0 tx=0).stop 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 -- 172.21.15.88:0/1395657542 shutdown_connections 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b5210 0x7f5cf00d1350 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.698 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/1395657542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 -- 172.21.15.88:0/1395657542 >> 172.21.15.88:0/1395657542 conn(0x7f5cf00d3080 msgr2=0x7f5cf00d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 -- 172.21.15.88:0/1395657542 shutdown_connections 2023-08-10T10:31:17.699 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.692+0000 7f5cf57ff700 1 -- 172.21.15.88:0/1395657542 wait complete. 2023-08-10T10:31:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.693+0000 7f5cf57ff700 1 Processor -- start 2023-08-10T10:31:17.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.693+0000 7f5cf57ff700 1 -- start start 2023-08-10T10:31:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 0x7f5cf015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf00c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.702 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf0149db0 con 0x7f5cf00b5210 2023-08-10T10:31:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf014dfa0 con 0x7f5cf00b8870 2023-08-10T10:31:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.694+0000 7f5cf57ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf01f6090 con 0x7f5cf015cf20 2023-08-10T10:31:17.703 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37874/0 (socket says 172.21.15.88:37874) 2023-08-10T10:31:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 -- 172.21.15.88:0/350482628 learned_addr learned my addr 172.21.15.88:0/350482628 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5cef7fe700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf00c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5cee7fc700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 0x7f5cf015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 -- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 msgr2=0x7f5cf00c9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf00c9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 -- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 msgr2=0x7f5cf015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 0x7f5cf015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 -- 172.21.15.88:0/350482628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce0009550 con 0x7f5cf00b5210 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5cee7fc700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 0x7f5cf015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.695+0000 7f5ceeffd700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000ebe0 tx=0x7f5ce000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:17.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.696+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000c850 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.696+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce000c9b0 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.696+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce000cd20 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.696+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce8009a70 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.696+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf01f6650 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.697+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf004ecc0 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.698+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f5ce0013470 con 0x7f5cf00b5210 2023-08-10T10:31:17.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.699+0000 7f5cd77fe700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 0x7f5cdc06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:17.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.699+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5ce0089910 con 0x7f5cf00b5210 2023-08-10T10:31:17.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.699+0000 7f5cee7fc700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 0x7f5cdc06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:17.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.700+0000 7f5cee7fc700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 0x7f5cdc06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00d1f20 tx=0x7f5ce4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:17.707 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.704+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f5ce0054680 con 0x7f5cf00b5210 2023-08-10T10:31:17.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.946+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5cf00d3600 con 0x7f5cf00b5210 2023-08-10T10:31:17.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.946+0000 7f5cd77fe700 1 -- 172.21.15.88:0/350482628 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5ce0057ca0 con 0x7f5cf00b5210 2023-08-10T10:31:17.947 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:31:17.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.948+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 msgr2=0x7f5cdc06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 0x7f5cdc06d1a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00d1f20 tx=0x7f5ce4009040 comp rx=0 tx=0).stop 2023-08-10T10:31:17.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 msgr2=0x7f5cf01f5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000ebe0 tx=0x7f5ce000eef0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 shutdown_connections 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f5cdc06ace0 0x7f5cdc06d1a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cf015cf20 0x7f5cf00c9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5cf00b5210 0x7f5cf01f5ab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 --2- 172.21.15.88:0/350482628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cf00b8870 0x7f5cf015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:17.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 >> 172.21.15.88:0/350482628 conn(0x7f5cf00d3080 msgr2=0x7f5cf0157fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:17.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 shutdown_connections 2023-08-10T10:31:17.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:17.949+0000 7f5cf57ff700 1 -- 172.21.15.88:0/350482628 wait complete. 2023-08-10T10:31:17.967 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:31:17.967 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:31:17.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-08-10T10:31:17.968 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-10T10:31:17.968 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:17.968 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:31:17.968 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:31:17.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:31:17.969 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:31:17.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:17.969 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-08-10T10:31:18.021 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:18.021 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:18.021 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:18.022 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:31:18.023 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:18.024 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:31:18.024 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 41883sec preferred_lft 41883sec 2023-08-10T10:31:18.024 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-08-10T10:31:18.024 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:18.025 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-10T10:31:18.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:18.026 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:18.026 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:18.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-08-10T10:31:18.026 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-08-10T10:31:18.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-08-10T10:31:18.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-10T10:31:18.027 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:18.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:18.459 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:31:18.530 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-08-10T10:31:18.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:18.534 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-08-10T10:31:18.594 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-08-10T10:31:18.594 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:31:18.594 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:31:18.594 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:31:18.595 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:31:18.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:18.596 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:18.597 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:18.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:31:18.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:31:18.597 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:31:18.597 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:19.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:19.278 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:31:19.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:19.327 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-08-10T10:31:19.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:19.373 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:19.373 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:19.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:31:19.374 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-10T10:31:19.374 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:19.558 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-10T10:31:19.558 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:19.559 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:19.559 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:19.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-10T10:31:19.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-10T10:31:19.559 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-10T10:31:19.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-10T10:31:19.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-10T10:31:19.560 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:19.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:19.835 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:19.835 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:19.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-08-10T10:31:19.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-08-10T10:31:19.836 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:20.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:20.007 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:20.053 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-10T10:31:20.053 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:20.054 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:20.138 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-08-10T10:31:20.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:20.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:20.283 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:20.283 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:20.742 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:20.743 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:20.743 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-08-10T10:31:20.743 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 1@bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.cephfs=/ 2023-08-10T10:31:20.743 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.88:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-08-10T10:31:20.750 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:31:20.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:20.750 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:20.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:20.821 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:20.919 INFO:teuthology.orchestra.run.smithi187.stdout:client4920 2023-08-10T10:31:20.920 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:31:20.920 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:31:20.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:20.966 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:21.093 INFO:teuthology.orchestra.run.smithi187.stdout:client4920 2023-08-10T10:31:21.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.094 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:21.181 INFO:teuthology.orchestra.run.smithi187.stdout:client4920 2023-08-10T10:31:21.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.182 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.client4920/status') 2023-08-10T10:31:21.290 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4920 (3)172.21.15.187:0/3074898564 2023-08-10T10:31:21.291 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-08-10T10:31:21.291 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-08-10T10:31:21.291 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-08-10T10:31:21.291 INFO:teuthology.orchestra.run.smithi187.stderr:71 bytes copied, 4.9282e-05 s, 1.4 MB/s 2023-08-10T10:31:21.293 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-08-10T10:31:21.294 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-10T10:31:21.294 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:21.294 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-10T10:31:21.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.499+0000 7f8d111ff700 1 Processor -- start 2023-08-10T10:31:21.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.500+0000 7f8d111ff700 1 -- start start 2023-08-10T10:31:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d111ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d0c15ad10 0x7f8d0c06b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d111ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d0c06b770 0x7f8d0c0b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d111ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0c0c9890 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d111ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c0b2800 con 0x7f8d0c06b770 2023-08-10T10:31:21.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d111ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d0c15f820 con 0x7f8d0c15ad10 2023-08-10T10:31:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d0b59e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f8d0c0b23f0 0x7f8d0c070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:55666/0 (socket says 172.21.15.88:55666) 2023-08-10T10:31:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d03fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d0c06b770 0x7f8d0c0b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d0b59e700 1 -- 172.21.15.88:0/1244921812 learned_addr learned my addr 172.21.15.88:0/1244921812 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:31:21.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.501+0000 7f8d0ad9d700 1 --2- 172.21.15.88:0/1244921812 >> v2:172.21.15.187:3300/0 conn(0x7f8d0c15ad10 0x7f8d0c06b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d03fff700 1 -- 172.21.15.88:0/1244921812 >> v2:172.21.15.187:3300/0 conn(0x7f8d0c15ad10 msgr2=0x7f8d0c06b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d03fff700 1 --2- 172.21.15.88:0/1244921812 >> v2:172.21.15.187:3300/0 conn(0x7f8d0c15ad10 0x7f8d0c06b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d03fff700 1 -- 172.21.15.88:0/1244921812 >> v1:172.21.15.88:6789/0 conn(0x7f8d0c0b23f0 legacy=0x7f8d0c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d03fff700 1 -- 172.21.15.88:0/1244921812 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0c15f540 con 0x7f8d0c06b770 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d0a59c700 1 -- 172.21.15.88:0/1244921812 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 762224843 0 0) 0x7f8d0c0c9890 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d03fff700 1 --2- 172.21.15.88:0/1244921812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0b1eb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0cea90 tx=0x7f8cf4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf4342c0b4d0ad3 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:21.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d0a59c700 1 -- 172.21.15.88:0/1244921812 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4011830 con 0x7f8d0c06b770 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d0a59c700 1 -- 172.21.15.88:0/1244921812 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf4011990 con 0x7f8d0c06b770 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.502+0000 7f8d0a59c700 1 -- 172.21.15.88:0/1244921812 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4011d20 con 0x7f8d0c06b770 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 -- 172.21.15.88:0/1244921812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c06b770 msgr2=0x7f8d0c0b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 --2- 172.21.15.88:0/1244921812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0b1eb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c0cea90 tx=0x7f8cf4009b20 comp rx=0 tx=0).stop 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 -- 172.21.15.88:0/1244921812 shutdown_connections 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 --2- 172.21.15.88:0/1244921812 >> v2:172.21.15.187:3300/0 conn(0x7f8d0c15ad10 0x7f8d0c06b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 --2- 172.21.15.88:0/1244921812 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0b1eb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 -- 172.21.15.88:0/1244921812 >> 172.21.15.88:0/1244921812 conn(0x7f8d0c0ced50 msgr2=0x7f8d0c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 -- 172.21.15.88:0/1244921812 shutdown_connections 2023-08-10T10:31:21.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.503+0000 7f8d111ff700 1 -- 172.21.15.88:0/1244921812 wait complete. 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.504+0000 7f8d111ff700 1 Processor -- start 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.505+0000 7f8d111ff700 1 -- start start 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.505+0000 7f8d111ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.505+0000 7f8d111ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d111ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d0c15ad10 0x7f8d0c0c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d111ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c0c5f90 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d111ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c1f3040 con 0x7f8d0c06b770 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d111ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0c1565a0 con 0x7f8d0c15ad10 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d0ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:37896/0 (socket says 172.21.15.88:37896) 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 -- 172.21.15.88:0/184378603 learned_addr learned my addr 172.21.15.88:0/184378603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d0b59e700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d0c15ad10 0x7f8d0c0c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 -- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d0c15ad10 msgr2=0x7f8d0c0c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d0c15ad10 0x7f8d0c0c8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 -- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 msgr2=0x7f8d0c0c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 -- 172.21.15.88:0/184378603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf40094a0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d0ad9d700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.506+0000 7f8d03fff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4014040 tx=0x7f8cf4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.507+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf40036a0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.507+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf401e070 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.507+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0c1f34d0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.507+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf4003a20 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.507+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0c1f29f0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.508+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0c04ecc0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.509+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f8cf4003b80 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.510+0000 7f8d037fe700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 0x7f8cec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.510+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f8cf408a6d0 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.510+0000 7f8d0ad9d700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 0x7f8cec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:31:21.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.511+0000 7f8d0ad9d700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 0x7f8cec06d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c1f0160 tx=0x7f8cfc009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:31:21.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.515+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f8cf4055440 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.755+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8d0c071a60 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.756+0000 7f8d037fe700 1 -- 172.21.15.88:0/184378603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8cf4020070 con 0x7f8d0c0b23f0 2023-08-10T10:31:21.757 INFO:teuthology.orchestra.run.smithi088.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-10T10:31:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 msgr2=0x7f8cec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 0x7f8cec06d1a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d0c1f0160 tx=0x7f8cfc009210 comp rx=0 tx=0).stop 2023-08-10T10:31:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 msgr2=0x7f8d0c156060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:31:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4014040 tx=0x7f8cf4004750 comp rx=0 tx=0).stop 2023-08-10T10:31:21.759 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 shutdown_connections 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f8cec06ace0 0x7f8cec06d1a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d0c15ad10 0x7f8d0c0c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d0c06b770 0x7f8d0c0c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 --2- 172.21.15.88:0/184378603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d0c0b23f0 0x7f8d0c156060 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.758+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 >> 172.21.15.88:0/184378603 conn(0x7f8d0c0ced50 msgr2=0x7f8d0c0ae670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.759+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 shutdown_connections 2023-08-10T10:31:21.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:31:21.759+0000 7f8d111ff700 1 -- 172.21.15.88:0/184378603 wait complete. 2023-08-10T10:31:21.777 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-10T10:31:21.777 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-10T10:31:21.777 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-08-10T10:31:21.777 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-10T10:31:21.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:21.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-10T10:31:21.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-10T10:31:21.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-10T10:31:21.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:31:21.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.779 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-08-10T10:31:21.826 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:21.826 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:21.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:21.828 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 41879sec preferred_lft 41879sec 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:21.829 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 42:52:77:9f:35:a5 brd ff:ff:ff:ff:ff:ff 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::5cbd:4eff:fe2a:9ae2/64 scope link 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 42:52:77:9f:35:a5 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:31:21.830 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::4052:77ff:fe9f:35a5/64 scope link 2023-08-10T10:31:21.831 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:21.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.832 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-10T10:31:21.899 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-08-10T10:31:21.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.902 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-08-10T10:31:21.951 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-08-10T10:31:21.951 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-10T10:31:21.951 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-10T10:31:21.952 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-10T10:31:21.952 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-10T10:31:21.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:21.952 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:21.953 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:21.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-10T10:31:21.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-10T10:31:21.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-10T10:31:21.953 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:22.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.123 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:31:22.169 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:31:22.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.171 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-08-10T10:31:22.216 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-10T10:31:22.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.217 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:22.218 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:22.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:31:22.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-10T10:31:22.218 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:22.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:31:22.473 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:22.473 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 56:61:98:23:60:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:31:22.474 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:31:22.475 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.475 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::5461:98ff:fe23:6042/64 scope link 2023-08-10T10:31:22.475 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.476 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-08-10T10:31:22.547 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 56:61:98:23:60:42 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::5461:98ff:fe23:6042/64 scope link 2023-08-10T10:31:22.548 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-08-10T10:31:22.550 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-10T10:31:22.550 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.551 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:22.551 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:22.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-10T10:31:22.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-10T10:31:22.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-10T10:31:22.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-10T10:31:22.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-10T10:31:22.555 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:22.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:22.805 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-08-10T10:31:22.806 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-08-10T10:31:22.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-08-10T10:31:22.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-08-10T10:31:22.806 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-08-10T10:31:22.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:22.979 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:23.025 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-10T10:31:23.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-10T10:31:23.026 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:23.110 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-08-10T10:31:23.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.110 DEBUG:teuthology.orchestra.run.smithi187:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:23.255 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:23.255 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:23.284 INFO:teuthology.orchestra.run.smithi187.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-08-10T10:31:23.285 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-08-10T10:31:23.285 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: resolved to: "172.21.15.88:3300,172.21.15.187:3300,172.21.15.187:3301" 2023-08-10T10:31:23.285 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: trying mount with new device syntax: 3@bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.cephfs=/ 2023-08-10T10:31:23.285 INFO:teuthology.orchestra.run.smithi187.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.88:3300/172.21.15.187:3300/172.21.15.187:3301" will pass to kernel 2023-08-10T10:31:23.289 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-08-10T10:31:23.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.290 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:23.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.361 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:23.449 INFO:teuthology.orchestra.run.smithi187.stdout:client4932 2023-08-10T10:31:23.449 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:31:23.449 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:31:23.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.495 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:23.623 INFO:teuthology.orchestra.run.smithi187.stdout:client4932 2023-08-10T10:31:23.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.623 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-08-10T10:31:23.711 INFO:teuthology.orchestra.run.smithi187.stdout:client4932 2023-08-10T10:31:23.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:31:23.712 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c.client4932/status') 2023-08-10T10:31:23.821 INFO:teuthology.orchestra.run.smithi187.stdout:instance: client.4932 (3)172.21.15.187:0/612415074 2023-08-10T10:31:23.821 INFO:teuthology.orchestra.run.smithi187.stdout:blocklisted: false 2023-08-10T10:31:23.821 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records in 2023-08-10T10:31:23.822 INFO:teuthology.orchestra.run.smithi187.stderr:0+1 records out 2023-08-10T10:31:23.822 INFO:teuthology.orchestra.run.smithi187.stderr:70 bytes copied, 5.1714e-05 s, 1.4 MB/s 2023-08-10T10:31:23.824 INFO:teuthology.run_tasks:Running task workunit... 2023-08-10T10:31:23.837 INFO:tasks.workunit:Pulling workunits from ref a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:31:23.838 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-08-10T10:31:23.838 INFO:tasks.workunit:timeout=3h 2023-08-10T10:31:23.838 INFO:tasks.workunit:cleanup=True 2023-08-10T10:31:23.838 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:23.890 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 2bh/43d Inode: 1 Links: 2 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:30:34.324293899 +0000 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:30:46.353190740 +0000 2023-08-10T10:31:23.891 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:30:34.324293899 +0000 2023-08-10T10:31:23.892 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-08-10T10:31:23.892 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-08-10T10:31:23.971 DEBUG:teuthology.orchestra.run.smithi088:> stat -- /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:24.018 INFO:teuthology.orchestra.run.smithi088.stdout: File: /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 2dh/45d Inode: 1 Links: 3 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-08-10 10:31:23.962333956 +0000 2023-08-10T10:31:24.019 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-08-10 10:31:23.962333956 +0000 2023-08-10T10:31:24.020 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2023-08-10 10:30:34.324293899 +0000 2023-08-10T10:31:24.020 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.2 2023-08-10T10:31:24.020 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/mnt.2 && sudo install -d -m 0755 --owner=ubuntu -- client.2 2023-08-10T10:31:24.095 DEBUG:teuthology.orchestra.run.smithi187:> stat -- /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:24.142 INFO:teuthology.orchestra.run.smithi187.stdout: File: /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 2 Blocks: 0 IO Block: 65536 directory 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 2bh/43d Inode: 1 Links: 4 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:31:24.088331446 +0000 2023-08-10T10:31:24.143 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:31:24.088331446 +0000 2023-08-10T10:31:24.144 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:30:34.324293899 +0000 2023-08-10T10:31:24.144 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2023-08-10T10:31:24.144 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2023-08-10T10:31:24.222 DEBUG:teuthology.orchestra.run.smithi187:> stat -- /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:24.269 INFO:teuthology.orchestra.run.smithi187.stdout: File: /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 3 Blocks: 0 IO Block: 65536 directory 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 2dh/45d Inode: 1 Links: 5 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:cephfs_t:s0 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-08-10 10:31:24.213324372 +0000 2023-08-10T10:31:24.270 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-08-10 10:31:24.213324372 +0000 2023-08-10T10:31:24.271 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-08-10 10:30:34.324293899 +0000 2023-08-10T10:31:24.271 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.3 2023-08-10T10:31:24.271 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/mnt.3 && sudo install -d -m 0755 --owner=ubuntu -- client.3 2023-08-10T10:31:24.348 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:31:24.349 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/clone.client.2 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.2 && cd /home/ubuntu/cephtest/clone.client.2 && git checkout a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:31:24.349 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:31:24.350 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/clone.client.3 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.3 && cd /home/ubuntu/cephtest/clone.client.3 && git checkout a8bf445f2d27d8e12e060dff0fd151d481b5290b 2023-08-10T10:31:24.399 INFO:tasks.workunit.client.1.smithi187.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2023-08-10T10:31:24.400 INFO:tasks.workunit.client.0.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-08-10T10:31:24.401 INFO:tasks.workunit.client.3.smithi187.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.3'... 2023-08-10T10:31:24.402 INFO:tasks.workunit.client.2.smithi088.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.2'... 2023-08-10T10:31:25.826 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:25.831 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:55.959 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:31:55.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:26.141 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:26.157 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:50.399 INFO:tasks.workunit.client.0.smithi088.stderr:Updating files: 62% (7301/11710) Updating files: 63% (7378/11710) Updating files: 64% (7495/11710) Updating files: 65% (7612/11710) Updating files: 66% (7729/11710) Updating files: 67% (7846/11710) Updating files: 68% (7963/11710) Updating files: 69% (8080/11710) Updating files: 70% (8197/11710) Updating files: 71% (8315/11710) Updating files: 72% (8432/11710) Updating files: 73% (8549/11710) Updating files: 74% (8666/11710) Updating files: 75% (8783/11710) Updating files: 76% (8900/11710) Updating files: 77% (9017/11710) Updating files: 78% (9134/11710) Updating files: 79% (9251/11710) Updating files: 80% (9368/11710) Updating files: 81% (9486/11710) Updating files: 82% (9603/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 97% (11432/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-08-10T10:32:50.402 INFO:tasks.workunit.client.2.smithi088.stderr:Updating files: 62% (7284/11710) Updating files: 63% (7378/11710) Updating files: 64% (7495/11710) Updating files: 65% (7612/11710) Updating files: 66% (7729/11710) Updating files: 67% (7846/11710) Updating files: 68% (7963/11710) Updating files: 69% (8080/11710) Updating files: 70% (8197/11710) Updating files: 71% (8315/11710) Updating files: 72% (8432/11710) Updating files: 73% (8549/11710) Updating files: 74% (8666/11710) Updating files: 75% (8783/11710) Updating files: 76% (8900/11710) Updating files: 77% (9017/11710) Updating files: 78% (9134/11710) Updating files: 79% (9251/11710) Updating files: 80% (9368/11710) Updating files: 81% (9486/11710) Updating files: 82% (9603/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 97% (11403/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-08-10T10:32:50.647 INFO:tasks.workunit.client.3.smithi187.stderr:Updating files: 61% (7241/11710) Updating files: 62% (7261/11710) Updating files: 63% (7378/11710) Updating files: 64% (7495/11710) Updating files: 65% (7612/11710) Updating files: 66% (7729/11710) Updating files: 67% (7846/11710) Updating files: 68% (7963/11710) Updating files: 69% (8080/11710) Updating files: 70% (8197/11710) Updating files: 71% (8315/11710) Updating files: 72% (8432/11710) Updating files: 73% (8549/11710) Updating files: 74% (8666/11710) Updating files: 75% (8783/11710) Updating files: 76% (8900/11710) Updating files: 77% (9017/11710) Updating files: 78% (9134/11710) Updating files: 79% (9251/11710) Updating files: 80% (9368/11710) Updating files: 81% (9486/11710) Updating files: 82% (9603/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 98% (11476/11710) Updating files: 98% (11494/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-08-10T10:32:50.656 INFO:tasks.workunit.client.1.smithi187.stderr:Updating files: 61% (7232/11710) Updating files: 62% (7261/11710) Updating files: 63% (7378/11710) Updating files: 64% (7495/11710) Updating files: 65% (7612/11710) Updating files: 66% (7729/11710) Updating files: 67% (7846/11710) Updating files: 68% (7963/11710) Updating files: 69% (8080/11710) Updating files: 70% (8197/11710) Updating files: 71% (8315/11710) Updating files: 72% (8432/11710) Updating files: 73% (8549/11710) Updating files: 74% (8666/11710) Updating files: 75% (8783/11710) Updating files: 76% (8900/11710) Updating files: 77% (9017/11710) Updating files: 78% (9134/11710) Updating files: 79% (9251/11710) Updating files: 80% (9368/11710) Updating files: 81% (9486/11710) Updating files: 82% (9603/11710) Updating files: 83% (9720/11710) Updating files: 84% (9837/11710) Updating files: 85% (9954/11710) Updating files: 86% (10071/11710) Updating files: 87% (10188/11710) Updating files: 88% (10305/11710) Updating files: 89% (10422/11710) Updating files: 90% (10539/11710) Updating files: 91% (10657/11710) Updating files: 92% (10774/11710) Updating files: 93% (10891/11710) Updating files: 94% (11008/11710) Updating files: 95% (11125/11710) Updating files: 96% (11242/11710) Updating files: 97% (11359/11710) Updating files: 97% (11463/11710) Updating files: 98% (11476/11710) Updating files: 99% (11593/11710) Updating files: 100% (11710/11710) Updating files: 100% (11710/11710), done. 2023-08-10T10:32:51.194 INFO:tasks.workunit.client.2.smithi088.stderr:Note: switching to 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'. 2023-08-10T10:32:51.194 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.194 INFO:tasks.workunit.client.2.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-10T10:32:51.194 INFO:tasks.workunit.client.2.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr:state without impacting any branches by switching back to a branch. 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr: git switch -c 2023-08-10T10:32:51.195 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr:Or undo this operation with: 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr: git switch - 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr: 2023-08-10T10:32:51.196 INFO:tasks.workunit.client.2.smithi088.stderr:HEAD is now at a8bf445f2d2 Merge remote-tracking branch 'rishabh/fs-auth-subcmd' into wip-rishabh-2023Aug1-3 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr:Note: switching to 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'. 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr:state without impacting any branches by switching back to a branch. 2023-08-10T10:32:51.197 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr: git switch -c 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr:Or undo this operation with: 2023-08-10T10:32:51.198 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.199 INFO:tasks.workunit.client.0.smithi088.stderr: git switch - 2023-08-10T10:32:51.199 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.199 INFO:tasks.workunit.client.0.smithi088.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-10T10:32:51.199 INFO:tasks.workunit.client.0.smithi088.stderr: 2023-08-10T10:32:51.199 INFO:tasks.workunit.client.0.smithi088.stderr:HEAD is now at a8bf445f2d2 Merge remote-tracking branch 'rishabh/fs-auth-subcmd' into wip-rishabh-2023Aug1-3 2023-08-10T10:32:51.212 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.2/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.2 2023-08-10T10:32:51.213 DEBUG:teuthology.orchestra.run.smithi088:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-08-10T10:32:51.310 INFO:tasks.workunit.client.0.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-10T10:32:51.311 INFO:tasks.workunit.client.2.smithi088.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-10T10:32:51.316 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-10T10:32:51.316 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-10T10:32:51.316 INFO:tasks.workunit.client.2.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-08-10T10:32:51.316 INFO:tasks.workunit.client.2.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-10T10:32:51.590 INFO:tasks.workunit.client.3.smithi187.stderr:Note: switching to 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'. 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr:state without impacting any branches by switching back to a branch. 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.591 INFO:tasks.workunit.client.3.smithi187.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr: git switch -c 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr:Or undo this operation with: 2023-08-10T10:32:51.592 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.593 INFO:tasks.workunit.client.3.smithi187.stderr: git switch - 2023-08-10T10:32:51.593 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.593 INFO:tasks.workunit.client.3.smithi187.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-10T10:32:51.593 INFO:tasks.workunit.client.3.smithi187.stderr: 2023-08-10T10:32:51.593 INFO:tasks.workunit.client.3.smithi187.stderr:HEAD is now at a8bf445f2d2 Merge remote-tracking branch 'rishabh/fs-auth-subcmd' into wip-rishabh-2023Aug1-3 2023-08-10T10:32:51.601 INFO:tasks.workunit.client.1.smithi187.stderr:Note: switching to 'a8bf445f2d27d8e12e060dff0fd151d481b5290b'. 2023-08-10T10:32:51.601 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.601 INFO:tasks.workunit.client.1.smithi187.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-10T10:32:51.601 INFO:tasks.workunit.client.1.smithi187.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-10T10:32:51.601 INFO:tasks.workunit.client.1.smithi187.stderr:state without impacting any branches by switching back to a branch. 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr: git switch -c 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr:Or undo this operation with: 2023-08-10T10:32:51.602 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.603 INFO:tasks.workunit.client.1.smithi187.stderr: git switch - 2023-08-10T10:32:51.603 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.603 INFO:tasks.workunit.client.1.smithi187.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-10T10:32:51.603 INFO:tasks.workunit.client.1.smithi187.stderr: 2023-08-10T10:32:51.603 INFO:tasks.workunit.client.1.smithi187.stderr:HEAD is now at a8bf445f2d2 Merge remote-tracking branch 'rishabh/fs-auth-subcmd' into wip-rishabh-2023Aug1-3 2023-08-10T10:32:51.609 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/clone.client.3/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.3 2023-08-10T10:32:51.619 DEBUG:teuthology.orchestra.run.smithi187:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2023-08-10T10:32:51.666 INFO:tasks.workunit.client.3.smithi187.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-10T10:32:51.670 INFO:tasks.workunit.client.3.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-08-10T10:32:51.671 INFO:tasks.workunit.client.3.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-10T10:32:51.706 INFO:tasks.workunit.client.1.smithi187.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-10T10:32:51.711 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-08-10T10:32:51.711 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-10T10:32:51.953 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-10T10:32:51.954 INFO:tasks.workunit.client.2.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-10T10:32:52.051 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-10T10:32:52.052 INFO:tasks.workunit.client.2.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-10T10:32:52.116 INFO:tasks.workunit.client.2.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/direct_io' 2023-08-10T10:32:52.117 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-10T10:32:52.120 INFO:tasks.workunit.client.2.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-08-10T10:32:52.120 INFO:tasks.workunit.client.2.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-10T10:32:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-10T10:32:52.121 INFO:tasks.workunit.client.0.smithi088.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-10T10:32:52.184 INFO:tasks.workunit.client.2.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.2/qa/workunits/fs' 2023-08-10T10:32:52.184 INFO:tasks.workunit.client.0.smithi088.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-10T10:32:52.192 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:32:52.192 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.2 of=/dev/stdout 2023-08-10T10:32:52.193 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:32:52.193 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-08-10T10:32:52.278 INFO:tasks.workunit:Running workunits matching fs/quota on client.2... 2023-08-10T10:32:52.279 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-10T10:32:52.279 DEBUG:teuthology.orchestra.run.smithi088:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && cd -- /home/ubuntu/cephtest/mnt.2/client.2/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="2" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.2 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.2 CEPH_MNT=/home/ubuntu/cephtest/mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.2/qa/workunits/fs/quota/quota.sh 2023-08-10T10:32:52.281 INFO:tasks.workunit:Running workunits matching fs/quota on client.0... 2023-08-10T10:32:52.282 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-10T10:32:52.282 DEBUG:teuthology.orchestra.run.smithi088:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh 2023-08-10T10:32:52.361 INFO:tasks.workunit.client.3.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-10T10:32:52.362 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-10T10:32:52.384 INFO:tasks.workunit.client.2.smithi088.stderr:+ mkdir quota-test 2023-08-10T10:32:52.385 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir quota-test 2023-08-10T10:32:52.388 INFO:tasks.workunit.client.2.smithi088.stderr:+ cd quota-test 2023-08-10T10:32:52.388 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-10T10:32:52.389 INFO:tasks.workunit.client.0.smithi088.stderr:+ cd quota-test 2023-08-10T10:32:52.389 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-10T10:32:52.399 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file big 1000 2023-08-10T10:32:52.399 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:52.399 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file big 1000 2023-08-10T10:32:52.399 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:32:52.400 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file big 1000 2023-08-10T10:32:52.400 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:52.400 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file big 1000 2023-08-10T10:32:52.400 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:32:52.469 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-10T10:32:52.469 INFO:tasks.workunit.client.3.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-10T10:32:52.534 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2023-08-10T10:32:52.534 INFO:tasks.workunit.client.3.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/direct_io' 2023-08-10T10:32:52.538 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-08-10T10:32:52.538 INFO:tasks.workunit.client.1.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-10T10:32:52.538 INFO:tasks.workunit.client.3.smithi187.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-08-10T10:32:52.538 INFO:tasks.workunit.client.3.smithi187.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-10T10:32:52.602 INFO:tasks.workunit.client.1.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2023-08-10T10:32:52.602 INFO:tasks.workunit.client.3.smithi187.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.3/qa/workunits/fs' 2023-08-10T10:32:52.609 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:32:52.609 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2023-08-10T10:32:52.610 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:32:52.610 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/home/ubuntu/cephtest/workunits.list.client.3 of=/dev/stdout 2023-08-10T10:32:52.697 INFO:tasks.workunit:Running workunits matching fs/quota on client.1... 2023-08-10T10:32:52.699 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-10T10:32:52.700 DEBUG:teuthology.orchestra.run.smithi187:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh 2023-08-10T10:32:52.702 INFO:tasks.workunit:Running workunits matching fs/quota on client.3... 2023-08-10T10:32:52.703 INFO:tasks.workunit:Running workunit fs/quota/quota.sh... 2023-08-10T10:32:52.703 DEBUG:teuthology.orchestra.run.smithi187:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh 2023-08-10T10:32:52.803 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir quota-test 2023-08-10T10:32:52.805 INFO:tasks.workunit.client.3.smithi187.stderr:+ mkdir quota-test 2023-08-10T10:32:52.806 INFO:tasks.workunit.client.1.smithi187.stderr:+ cd quota-test 2023-08-10T10:32:52.807 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-10T10:32:52.808 INFO:tasks.workunit.client.3.smithi187.stderr:+ cd quota-test 2023-08-10T10:32:52.808 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100M 2023-08-10T10:32:52.825 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file big 1000 2023-08-10T10:32:52.825 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:32:52.826 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file big 1000 2023-08-10T10:32:52.826 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:32:52.826 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file big 1000 2023-08-10T10:32:52.826 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:32:52.827 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file big 1000 2023-08-10T10:32:52.827 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:32:56.372 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:56.377 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:32:58.187 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 105906176 2023-08-10T10:32:58.188 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:32:58.188 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:58.188 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file second 10 2023-08-10T10:32:58.189 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:58.189 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file second 10 2023-08-10T10:32:58.189 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:32:58.192 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:58.192 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:32:58.193 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:58.193 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-10T10:32:58.196 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 105906176 2023-08-10T10:32:58.196 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:32:58.197 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:58.197 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file second 10 2023-08-10T10:32:58.197 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:58.197 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file second 10 2023-08-10T10:32:58.197 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:32:58.199 INFO:tasks.workunit.client.0.smithi088.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-10T10:32:58.200 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:58.201 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:32:58.201 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:58.201 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-10T10:32:58.207 INFO:tasks.workunit.client.2.smithi088.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-10T10:32:58.219 INFO:tasks.workunit.client.0.smithi088.stderr:10+0 records in 2023-08-10T10:32:58.219 INFO:tasks.workunit.client.0.smithi088.stderr:10+0 records out 2023-08-10T10:32:58.219 INFO:tasks.workunit.client.0.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0166658 s, 629 MB/s 2023-08-10T10:32:58.220 INFO:tasks.workunit.client.0.smithi088.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-10T10:32:58.228 INFO:tasks.workunit.client.2.smithi088.stderr:10+0 records in 2023-08-10T10:32:58.228 INFO:tasks.workunit.client.2.smithi088.stderr:10+0 records out 2023-08-10T10:32:58.228 INFO:tasks.workunit.client.2.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.017094 s, 613 MB/s 2023-08-10T10:32:58.228 INFO:tasks.workunit.client.2.smithi088.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-10T10:32:58.566 INFO:tasks.workunit.client.0.smithi088.stderr:100+0 records in 2023-08-10T10:32:58.566 INFO:tasks.workunit.client.0.smithi088.stderr:100+0 records out 2023-08-10T10:32:58.566 INFO:tasks.workunit.client.0.smithi088.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.343795 s, 305 MB/s 2023-08-10T10:32:58.595 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf big big2 second third 2023-08-10T10:32:58.610 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.629 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir ok 2023-08-10T10:32:58.633 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch ok/1 2023-08-10T10:32:58.636 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch ok/2 2023-08-10T10:32:58.637 INFO:tasks.workunit.client.2.smithi088.stderr:100+0 records in 2023-08-10T10:32:58.637 INFO:tasks.workunit.client.2.smithi088.stderr:100+0 records out 2023-08-10T10:32:58.637 INFO:tasks.workunit.client.2.smithi088.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.406123 s, 258 MB/s 2023-08-10T10:32:58.638 INFO:tasks.workunit.client.2.smithi088.stderr:+ rm -rf big big2 second third 2023-08-10T10:32:58.639 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch 3 2023-08-10T10:32:58.641 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false touch shouldbefail 2023-08-10T10:32:58.641 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:58.642 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch shouldbefail 2023-08-10T10:32:58.643 INFO:tasks.workunit.client.0.smithi088.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.644 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:58.644 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false touch ok/shouldbefail 2023-08-10T10:32:58.645 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:58.645 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch ok/shouldbefail 2023-08-10T10:32:58.645 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.646 INFO:tasks.workunit.client.0.smithi088.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.646 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:58.647 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-10T10:32:58.655 INFO:tasks.workunit.client.2.smithi088.stderr:+ mkdir ok 2023-08-10T10:32:58.655 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch shouldbecreated 2023-08-10T10:32:58.656 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 105906176 2023-08-10T10:32:58.656 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:32:58.657 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:32:58.657 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file second 10 2023-08-10T10:32:58.657 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:32:58.657 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file second 10 2023-08-10T10:32:58.657 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:32:58.658 INFO:tasks.workunit.client.0.smithi088.stderr:+ touch shouldbecreated2 2023-08-10T10:32:58.659 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch ok/1 2023-08-10T10:32:58.660 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 1048576 2023-08-10T10:32:58.661 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:32:58.661 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:32:58.661 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-10T10:32:58.662 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch ok/2 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 105906176 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file second 10 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:32:58.663 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file second 10 2023-08-10T10:32:58.664 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:32:58.664 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch 3 2023-08-10T10:32:58.668 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false touch shouldbefail 2023-08-10T10:32:58.669 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:58.669 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch shouldbefail 2023-08-10T10:32:58.669 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 1048576 2023-08-10T10:32:58.669 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-10T10:32:58.670 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:32:58.670 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:32:58.670 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0 2023-08-10T10:32:58.671 INFO:tasks.workunit.client.2.smithi088.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.671 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:58.671 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false touch ok/shouldbefail 2023-08-10T10:32:58.671 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:58.671 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch ok/shouldbefail 2023-08-10T10:32:58.672 INFO:tasks.workunit.client.1.smithi187.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-10T10:32:58.672 INFO:tasks.workunit.client.2.smithi088.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.673 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:58.673 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-10T10:32:58.686 INFO:tasks.workunit.client.3.smithi187.stderr:+ dd if=/dev/zero of=third bs=1M count=10 2023-08-10T10:32:58.691 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch shouldbecreated 2023-08-10T10:32:58.692 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir bytes bytes/files 2023-08-10T10:32:58.694 INFO:tasks.workunit.client.2.smithi088.stderr:+ touch shouldbecreated2 2023-08-10T10:32:58.696 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-10T10:32:58.700 INFO:tasks.workunit.client.1.smithi187.stderr:10+0 records in 2023-08-10T10:32:58.700 INFO:tasks.workunit.client.1.smithi187.stderr:10+0 records out 2023-08-10T10:32:58.700 INFO:tasks.workunit.client.1.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0255698 s, 410 MB/s 2023-08-10T10:32:58.701 INFO:tasks.workunit.client.1.smithi187.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-10T10:32:58.709 INFO:tasks.workunit.client.2.smithi088.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-10T10:32:58.712 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.718 INFO:tasks.workunit.client.3.smithi187.stderr:10+0 records in 2023-08-10T10:32:58.718 INFO:tasks.workunit.client.3.smithi187.stderr:10+0 records out 2023-08-10T10:32:58.719 INFO:tasks.workunit.client.3.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0283788 s, 369 MB/s 2023-08-10T10:32:58.719 INFO:tasks.workunit.client.3.smithi187.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100 2023-08-10T10:32:58.721 INFO:tasks.workunit.client.0.smithi088.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-10T10:32:58.731 INFO:tasks.workunit.client.0.smithi088.stderr:4+0 records in 2023-08-10T10:32:58.731 INFO:tasks.workunit.client.0.smithi088.stderr:4+0 records out 2023-08-10T10:32:58.731 INFO:tasks.workunit.client.0.smithi088.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00607347 s, 691 MB/s 2023-08-10T10:32:58.731 INFO:tasks.workunit.client.0.smithi088.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-10T10:32:58.733 INFO:tasks.workunit.client.2.smithi088.stderr:+ mkdir bytes bytes/files 2023-08-10T10:32:58.745 INFO:tasks.workunit.client.0.smithi088.stderr:4+0 records in 2023-08-10T10:32:58.745 INFO:tasks.workunit.client.0.smithi088.stderr:4+0 records out 2023-08-10T10:32:58.745 INFO:tasks.workunit.client.0.smithi088.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00574841 s, 730 MB/s 2023-08-10T10:32:58.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-10T10:32:58.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:58.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file bytes/files/3 1000 2023-08-10T10:32:58.746 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:32:58.746 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-10T10:32:58.758 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.775 INFO:tasks.workunit.client.2.smithi088.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-10T10:32:58.784 INFO:tasks.workunit.client.2.smithi088.stderr:4+0 records in 2023-08-10T10:32:58.784 INFO:tasks.workunit.client.2.smithi088.stderr:4+0 records out 2023-08-10T10:32:58.785 INFO:tasks.workunit.client.2.smithi088.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00580555 s, 722 MB/s 2023-08-10T10:32:58.785 INFO:tasks.workunit.client.2.smithi088.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-10T10:32:58.796 INFO:tasks.workunit.client.2.smithi088.stderr:4+0 records in 2023-08-10T10:32:58.796 INFO:tasks.workunit.client.2.smithi088.stderr:4+0 records out 2023-08-10T10:32:58.796 INFO:tasks.workunit.client.2.smithi088.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.0085296 s, 492 MB/s 2023-08-10T10:32:58.797 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-10T10:32:58.797 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:58.797 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file bytes/files/3 1000 2023-08-10T10:32:58.797 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:32:58.869 INFO:tasks.workunit.client.1.smithi187.stderr:100+0 records in 2023-08-10T10:32:58.869 INFO:tasks.workunit.client.1.smithi187.stderr:100+0 records out 2023-08-10T10:32:58.870 INFO:tasks.workunit.client.1.smithi187.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.16558 s, 633 MB/s 2023-08-10T10:32:58.871 INFO:tasks.workunit.client.1.smithi187.stderr:+ rm -rf big big2 second third 2023-08-10T10:32:58.879 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.887 INFO:tasks.workunit.client.3.smithi187.stderr:100+0 records in 2023-08-10T10:32:58.888 INFO:tasks.workunit.client.3.smithi187.stderr:100+0 records out 2023-08-10T10:32:58.888 INFO:tasks.workunit.client.3.smithi187.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.166217 s, 631 MB/s 2023-08-10T10:32:58.888 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir ok 2023-08-10T10:32:58.889 INFO:tasks.workunit.client.3.smithi187.stderr:+ rm -rf big big2 second third 2023-08-10T10:32:58.892 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch ok/1 2023-08-10T10:32:58.896 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch ok/2 2023-08-10T10:32:58.898 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch 3 2023-08-10T10:32:58.898 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr . -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.902 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false touch shouldbefail 2023-08-10T10:32:58.902 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:32:58.902 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch shouldbefail 2023-08-10T10:32:58.904 INFO:tasks.workunit.client.1.smithi187.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.905 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:32:58.905 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false touch ok/shouldbefail 2023-08-10T10:32:58.905 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:32:58.905 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch ok/shouldbefail 2023-08-10T10:32:58.907 INFO:tasks.workunit.client.1.smithi187.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.907 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:32:58.907 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-10T10:32:58.909 INFO:tasks.workunit.client.3.smithi187.stderr:+ mkdir ok 2023-08-10T10:32:58.913 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch ok/1 2023-08-10T10:32:58.917 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch ok/2 2023-08-10T10:32:58.919 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch 3 2023-08-10T10:32:58.922 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false touch shouldbefail 2023-08-10T10:32:58.922 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:32:58.922 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch shouldbefail 2023-08-10T10:32:58.924 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch shouldbecreated 2023-08-10T10:32:58.925 INFO:tasks.workunit.client.3.smithi187.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.925 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:32:58.925 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false touch ok/shouldbefail 2023-08-10T10:32:58.925 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:32:58.926 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch ok/shouldbefail 2023-08-10T10:32:58.927 INFO:tasks.workunit.client.3.smithi187.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded 2023-08-10T10:32:58.927 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:32:58.928 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr . -n ceph.quota.max_files -v 0 2023-08-10T10:32:58.928 INFO:tasks.workunit.client.1.smithi187.stderr:+ touch shouldbecreated2 2023-08-10T10:32:58.934 INFO:tasks.workunit.client.1.smithi187.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-10T10:32:58.935 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch shouldbecreated 2023-08-10T10:32:58.938 INFO:tasks.workunit.client.3.smithi187.stderr:+ touch shouldbecreated2 2023-08-10T10:32:58.946 INFO:tasks.workunit.client.3.smithi187.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2 2023-08-10T10:32:58.953 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir bytes bytes/files 2023-08-10T10:32:58.957 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-10T10:32:58.968 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.969 INFO:tasks.workunit.client.3.smithi187.stderr:+ mkdir bytes bytes/files 2023-08-10T10:32:58.974 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10M 2023-08-10T10:32:58.976 INFO:tasks.workunit.client.1.smithi187.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-10T10:32:58.982 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5 2023-08-10T10:32:58.987 INFO:tasks.workunit.client.1.smithi187.stderr:4+0 records in 2023-08-10T10:32:58.988 INFO:tasks.workunit.client.1.smithi187.stderr:4+0 records out 2023-08-10T10:32:58.988 INFO:tasks.workunit.client.1.smithi187.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00757737 s, 554 MB/s 2023-08-10T10:32:58.988 INFO:tasks.workunit.client.1.smithi187.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-10T10:32:58.989 INFO:tasks.workunit.client.3.smithi187.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4 2023-08-10T10:32:58.998 INFO:tasks.workunit.client.3.smithi187.stderr:4+0 records in 2023-08-10T10:32:58.999 INFO:tasks.workunit.client.3.smithi187.stderr:4+0 records out 2023-08-10T10:32:58.999 INFO:tasks.workunit.client.3.smithi187.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00653231 s, 642 MB/s 2023-08-10T10:32:58.999 INFO:tasks.workunit.client.3.smithi187.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4 2023-08-10T10:32:59.000 INFO:tasks.workunit.client.1.smithi187.stderr:4+0 records in 2023-08-10T10:32:59.000 INFO:tasks.workunit.client.1.smithi187.stderr:4+0 records out 2023-08-10T10:32:59.000 INFO:tasks.workunit.client.1.smithi187.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00639021 s, 656 MB/s 2023-08-10T10:32:59.001 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-10T10:32:59.001 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:32:59.001 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file bytes/files/3 1000 2023-08-10T10:32:59.001 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:32:59.010 INFO:tasks.workunit.client.3.smithi187.stderr:4+0 records in 2023-08-10T10:32:59.010 INFO:tasks.workunit.client.3.smithi187.stderr:4+0 records out 2023-08-10T10:32:59.011 INFO:tasks.workunit.client.3.smithi187.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00683777 s, 613 MB/s 2023-08-10T10:32:59.011 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file bytes/files/3 1000 2023-08-10T10:32:59.012 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:32:59.012 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file bytes/files/3 1000 2023-08-10T10:32:59.012 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:32:59.823 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 19922944 2023-08-10T10:32:59.824 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:32:59.824 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:59.825 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-10T10:32:59.825 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:59.825 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file bytes/files/4 1000 2023-08-10T10:32:59.825 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:32:59.825 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 20971520 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file bytes/files/4 1000 2023-08-10T10:32:59.826 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:32:59.827 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:59.828 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:32:59.828 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:59.829 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-10T10:32:59.829 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:59.829 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file bytes/files/5 1000 2023-08-10T10:32:59.829 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:32:59.830 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:59.830 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:32:59.830 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:59.830 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-10T10:32:59.831 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:59.831 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file bytes/files/5 1000 2023-08-10T10:32:59.831 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:32:59.831 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:59.832 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:32:59.832 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:59.832 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-10T10:32:59.832 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 1048576 2023-08-10T10:32:59.833 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:32:59.833 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:59.833 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-10T10:32:59.833 INFO:tasks.workunit.client.2.smithi088.stdout:bytes/files/1 4194304 2023-08-10T10:32:59.834 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-10T10:32:59.834 INFO:tasks.workunit.client.0.smithi088.stdout:bytes/files/1 4194304 2023-08-10T10:32:59.834 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-10T10:32:59.835 INFO:tasks.workunit.client.2.smithi088.stdout:bytes/files/2 4194304 2023-08-10T10:32:59.835 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-10T10:32:59.836 INFO:tasks.workunit.client.0.smithi088.stdout:bytes/files/2 4194304 2023-08-10T10:32:59.836 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-10T10:32:59.837 INFO:tasks.workunit.client.2.smithi088.stdout:bytes/files/3 18874368 2023-08-10T10:32:59.837 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-10T10:32:59.838 INFO:tasks.workunit.client.0.smithi088.stdout:bytes/files/3 19922944 2023-08-10T10:32:59.839 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-10T10:32:59.840 INFO:tasks.workunit.client.2.smithi088.stdout:bytes/files/4 0 2023-08-10T10:32:59.840 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false stat bytes/files/5 2023-08-10T10:32:59.840 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:59.840 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat bytes/files/5 2023-08-10T10:32:59.841 INFO:tasks.workunit.client.0.smithi088.stdout:bytes/files/4 0 2023-08-10T10:32:59.841 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false stat bytes/files/5 2023-08-10T10:32:59.842 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:59.842 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat bytes/files/5 2023-08-10T10:32:59.842 INFO:tasks.workunit.client.2.smithi088.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-10T10:32:59.843 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:59.844 INFO:tasks.workunit.client.0.smithi088.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-10T10:32:59.844 INFO:tasks.workunit.client.2.smithi088.stderr:+ rm -rf bytes 2023-08-10T10:32:59.844 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:59.845 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf bytes 2023-08-10T10:32:59.880 INFO:tasks.workunit.client.2.smithi088.stderr:+ mkdir files limit 2023-08-10T10:32:59.883 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir files limit 2023-08-10T10:32:59.885 INFO:tasks.workunit.client.2.smithi088.stderr:+ truncate files/file -s 10G 2023-08-10T10:32:59.887 INFO:tasks.workunit.client.0.smithi088.stderr:+ truncate files/file -s 10G 2023-08-10T10:32:59.895 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-10T10:32:59.896 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-10T10:32:59.904 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false mv files limit/ 2023-08-10T10:32:59.904 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:32:59.905 INFO:tasks.workunit.client.2.smithi088.stderr:+ mv files limit/ 2023-08-10T10:32:59.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false mv files limit/ 2023-08-10T10:32:59.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:32:59.905 INFO:tasks.workunit.client.0.smithi088.stderr:+ mv files limit/ 2023-08-10T10:32:59.925 INFO:tasks.workunit.client.0.smithi088.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-10T10:32:59.926 INFO:tasks.workunit.client.2.smithi088.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-10T10:32:59.936 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:32:59.936 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:32:59.937 INFO:tasks.workunit.client.2.smithi088.stderr:+ rm -rf files limit 2023-08-10T10:32:59.937 INFO:tasks.workunit.client.0.smithi088.stderr:+ rm -rf files limit 2023-08-10T10:32:59.970 INFO:tasks.workunit.client.2.smithi088.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-10T10:32:59.973 INFO:tasks.workunit.client.0.smithi088.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-10T10:32:59.984 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-10T10:32:59.987 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-10T10:32:59.995 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-10T10:32:59.996 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-10T10:33:00.001 INFO:tasks.workunit.client.2.smithi088.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.001 INFO:tasks.workunit.client.2.smithi088.stderr:+ set -x 2023-08-10T10:33:00.001 INFO:tasks.workunit.client.2.smithi088.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.001 INFO:tasks.workunit.client.2.smithi088.stderr:+ set +x 2023-08-10T10:33:00.002 INFO:tasks.workunit.client.0.smithi088.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.002 INFO:tasks.workunit.client.0.smithi088.stderr:+ set -x 2023-08-10T10:33:00.002 INFO:tasks.workunit.client.0.smithi088.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.003 INFO:tasks.workunit.client.0.smithi088.stderr:+ set +x 2023-08-10T10:33:00.031 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 19922944 2023-08-10T10:33:00.031 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:33:00.032 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:00.032 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-10T10:33:00.032 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:33:00.032 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file bytes/files/4 1000 2023-08-10T10:33:00.032 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:33:00.034 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 1048576 2023-08-10T10:33:00.035 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:33:00.035 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:00.035 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-10T10:33:00.036 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:33:00.036 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file bytes/files/5 1000 2023-08-10T10:33:00.036 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:33:00.037 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 1048576 2023-08-10T10:33:00.037 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:33:00.038 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:00.038 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-10T10:33:00.038 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 19922944 2023-08-10T10:33:00.038 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:33:00.039 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:00.039 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file bytes/files/4 1000 2023-08-10T10:33:00.039 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:33:00.039 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file bytes/files/4 1000 2023-08-10T10:33:00.039 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:33:00.040 INFO:tasks.workunit.client.1.smithi187.stdout:bytes/files/1 4194304 2023-08-10T10:33:00.040 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-10T10:33:00.042 INFO:tasks.workunit.client.1.smithi187.stdout:bytes/files/2 4194304 2023-08-10T10:33:00.043 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-10T10:33:00.043 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 1048576 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file bytes/files/5 1000 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file bytes/files/5 1000 2023-08-10T10:33:00.044 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:33:00.045 INFO:tasks.workunit.client.1.smithi187.stdout:bytes/files/3 18874368 2023-08-10T10:33:00.045 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 1048576 2023-08-10T10:33:00.045 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:33:00.046 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:00.046 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-10T10:33:00.046 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/1 2023-08-10T10:33:00.047 INFO:tasks.workunit.client.3.smithi187.stdout:bytes/files/1 4194304 2023-08-10T10:33:00.048 INFO:tasks.workunit.client.1.smithi187.stdout:bytes/files/4 0 2023-08-10T10:33:00.048 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/2 2023-08-10T10:33:00.049 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false stat bytes/files/5 2023-08-10T10:33:00.049 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:33:00.049 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat bytes/files/5 2023-08-10T10:33:00.050 INFO:tasks.workunit.client.3.smithi187.stdout:bytes/files/2 4194304 2023-08-10T10:33:00.050 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/3 2023-08-10T10:33:00.051 INFO:tasks.workunit.client.1.smithi187.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-10T10:33:00.051 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:00.052 INFO:tasks.workunit.client.1.smithi187.stderr:+ rm -rf bytes 2023-08-10T10:33:00.053 INFO:tasks.workunit.client.3.smithi187.stdout:bytes/files/3 18874368 2023-08-10T10:33:00.053 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat '--printf=%n %s\n' bytes/files/4 2023-08-10T10:33:00.056 INFO:tasks.workunit.client.3.smithi187.stdout:bytes/files/4 0 2023-08-10T10:33:00.057 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false stat bytes/files/5 2023-08-10T10:33:00.057 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:33:00.057 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat bytes/files/5 2023-08-10T10:33:00.059 INFO:tasks.workunit.client.3.smithi187.stderr:stat: cannot statx 'bytes/files/5': No such file or directory 2023-08-10T10:33:00.059 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:00.061 INFO:tasks.workunit.client.3.smithi187.stderr:+ rm -rf bytes 2023-08-10T10:33:00.085 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir files limit 2023-08-10T10:33:00.090 INFO:tasks.workunit.client.1.smithi187.stderr:+ truncate files/file -s 10G 2023-08-10T10:33:00.092 INFO:tasks.workunit.client.3.smithi187.stderr:+ mkdir files limit 2023-08-10T10:33:00.097 INFO:tasks.workunit.client.3.smithi187.stderr:+ truncate files/file -s 10G 2023-08-10T10:33:00.108 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-10T10:33:00.108 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1M 2023-08-10T10:33:00.118 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false mv files limit/ 2023-08-10T10:33:00.119 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:33:00.119 INFO:tasks.workunit.client.3.smithi187.stderr:+ mv files limit/ 2023-08-10T10:33:00.119 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false mv files limit/ 2023-08-10T10:33:00.119 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:33:00.120 INFO:tasks.workunit.client.1.smithi187.stderr:+ mv files limit/ 2023-08-10T10:33:00.140 INFO:tasks.workunit.client.1.smithi187.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-10T10:33:00.140 INFO:tasks.workunit.client.3.smithi187.stderr:mv: error writing 'limit/files/file': Disk quota exceeded 2023-08-10T10:33:00.148 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:00.149 INFO:tasks.workunit.client.1.smithi187.stderr:+ rm -rf files limit 2023-08-10T10:33:00.151 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:00.151 INFO:tasks.workunit.client.3.smithi187.stderr:+ rm -rf files limit 2023-08-10T10:33:00.181 INFO:tasks.workunit.client.1.smithi187.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-10T10:33:00.185 INFO:tasks.workunit.client.3.smithi187.stderr:+ mkdir -p ancestor/p1/p2/parent/p3 2023-08-10T10:33:00.189 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-10T10:33:00.193 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr ancestor -n ceph.quota.max_bytes -v 1M 2023-08-10T10:33:00.205 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-10T10:33:00.206 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr ancestor/p1/p2/parent -n ceph.quota.max_bytes -v 1G 2023-08-10T10:33:00.212 INFO:tasks.workunit.client.1.smithi187.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.213 INFO:tasks.workunit.client.1.smithi187.stderr:+ set -x 2023-08-10T10:33:00.213 INFO:tasks.workunit.client.1.smithi187.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.213 INFO:tasks.workunit.client.1.smithi187.stderr:+ set +x 2023-08-10T10:33:00.214 INFO:tasks.workunit.client.3.smithi187.stderr:+ expect_false write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.214 INFO:tasks.workunit.client.3.smithi187.stderr:+ set -x 2023-08-10T10:33:00.214 INFO:tasks.workunit.client.3.smithi187.stderr:+ write_file ancestor/p1/p2/parent/p3/file1 900 2023-08-10T10:33:00.214 INFO:tasks.workunit.client.3.smithi187.stderr:+ set +x 2023-08-10T10:33:01.289 INFO:tasks.workunit.client.1.smithi187.stdout:Try to write 19922944 2023-08-10T10:33:01.289 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 1 2023-08-10T10:33:01.289 INFO:tasks.workunit.client.1.smithi187.stderr:+ return 0 2023-08-10T10:33:01.289 INFO:tasks.workunit.client.1.smithi187.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-10T10:33:01.290 INFO:tasks.workunit.client.3.smithi187.stdout:Try to write 19922944 2023-08-10T10:33:01.290 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 1 2023-08-10T10:33:01.290 INFO:tasks.workunit.client.3.smithi187.stderr:+ return 0 2023-08-10T10:33:01.290 INFO:tasks.workunit.client.3.smithi187.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-10T10:33:01.292 INFO:tasks.workunit.client.1.smithi187.stdout:ancestor/p1/p2/parent/p3/file1 18874368 2023-08-10T10:33:01.292 INFO:tasks.workunit.client.3.smithi187.stdout:ancestor/p1/p2/parent/p3/file1 18874368 2023-08-10T10:33:01.293 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-10T10:33:01.293 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-10T10:33:01.298 INFO:tasks.workunit.client.1.smithi187.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-10T10:33:01.300 INFO:tasks.workunit.client.3.smithi187.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-10T10:33:01.301 INFO:tasks.workunit.client.1.smithi187.stderr:setfattr: .: Invalid argument 2023-08-10T10:33:01.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:01.303 INFO:tasks.workunit:Stopping ['fs/quota'] on client.1... 2023-08-10T10:33:01.303 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2023-08-10T10:33:01.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:01.305 INFO:tasks.workunit.client.3.smithi187.stderr:setfattr: .: Invalid argument 2023-08-10T10:33:01.305 INFO:tasks.workunit:Stopping ['fs/quota'] on client.3... 2023-08-10T10:33:01.305 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.3 /home/ubuntu/cephtest/clone.client.3 2023-08-10T10:33:02.075 INFO:tasks.workunit.client.0.smithi088.stdout:Try to write 37748736 2023-08-10T10:33:02.075 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 1 2023-08-10T10:33:02.075 INFO:tasks.workunit.client.0.smithi088.stderr:+ return 0 2023-08-10T10:33:02.076 INFO:tasks.workunit.client.0.smithi088.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-10T10:33:02.076 INFO:tasks.workunit.client.2.smithi088.stdout:Try to write 37748736 2023-08-10T10:33:02.076 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 1 2023-08-10T10:33:02.077 INFO:tasks.workunit.client.2.smithi088.stderr:+ return 0 2023-08-10T10:33:02.077 INFO:tasks.workunit.client.2.smithi088.stderr:+ stat '--printf=%n %s\n' ancestor/p1/p2/parent/p3/file1 2023-08-10T10:33:02.078 INFO:tasks.workunit.client.0.smithi088.stdout:ancestor/p1/p2/parent/p3/file1 36700160 2023-08-10T10:33:02.079 INFO:tasks.workunit.client.2.smithi088.stdout:ancestor/p1/p2/parent/p3/file1 36700160 2023-08-10T10:33:02.079 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-10T10:33:02.079 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr -n ceph.quota.max_bytes -v 0 . 2023-08-10T10:33:02.085 INFO:tasks.workunit.client.0.smithi088.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-10T10:33:02.086 INFO:tasks.workunit.client.2.smithi088.stderr:+ setfattr -n ceph.quota.max_bytes -v 1 . 2023-08-10T10:33:02.089 INFO:tasks.workunit.client.0.smithi088.stderr:setfattr: .: Invalid argument 2023-08-10T10:33:02.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:02.090 INFO:tasks.workunit:Stopping ['fs/quota'] on client.0... 2023-08-10T10:33:02.091 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-08-10T10:33:02.092 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:02.092 INFO:tasks.workunit.client.2.smithi088.stderr:setfattr: .: Invalid argument 2023-08-10T10:33:02.093 INFO:tasks.workunit:Stopping ['fs/quota'] on client.2... 2023-08-10T10:33:02.093 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.2 /home/ubuntu/cephtest/clone.client.2 2023-08-10T10:33:02.771 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-08-10T10:33:02.834 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e8b988dea60d4b799cb4d37f29bee8dd Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8bf445f2d27d8e12e060dff0fd151d481b5290b/qa/tasks/workunit.py", line 424, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_7fda95956ac10132c9b74016ba832db907df09fa/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi187 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh' 2023-08-10T10:33:02.837 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-08-10T10:33:02.846 INFO:tasks.kclient:Unmounting kernel clients... 2023-08-10T10:33:02.846 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:33:02.846 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:02.933 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:33:02.934 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:03.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:33:03.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.386+0000 7f3f23dff700 1 Processor -- start 2023-08-10T10:33:03.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.386+0000 7f3f23dff700 1 -- start start 2023-08-10T10:33:03.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 0x7f3f1c0d1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd870 0x7f3f1c0cdcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f1c06bf90 0x7f3f1c06c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c0d21b0 con 0x7f3f1c15ced0 2023-08-10T10:33:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c06c960 con 0x7f3f1c06bf90 2023-08-10T10:33:03.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.388+0000 7f3f23dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0ce610 con 0x7f3f1c0cd870 2023-08-10T10:33:03.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.390+0000 7f3f2239c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f1c06bf90 0x7f3f1c06c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.390+0000 7f3f2239c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f1c06bf90 0x7f3f1c06c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45446/0 (socket says 172.21.15.88:45446) 2023-08-10T10:33:03.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.390+0000 7f3f2239c700 1 -- 172.21.15.88:0/1454729023 learned_addr learned my addr 172.21.15.88:0/1454729023 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.390+0000 7f3f21b9b700 1 --2- 172.21.15.88:0/1454729023 >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 0x7f3f1c0d1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.390+0000 7f3f2139a700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd870 0x7f3f1c0cdcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f2239c700 1 -- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd870 msgr2=0x7f3f1c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f2239c700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd870 0x7f3f1c0cdcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f2239c700 1 -- 172.21.15.88:0/1454729023 >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 msgr2=0x7f3f1c0d1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f2239c700 1 --2- 172.21.15.88:0/1454729023 >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 0x7f3f1c0d1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f2239c700 1 -- 172.21.15.88:0/1454729023 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0ce330 con 0x7f3f1c06bf90 2023-08-10T10:33:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.391+0000 7f3f21b9b700 1 --2- 172.21.15.88:0/1454729023 >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 0x7f3f1c0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.392+0000 7f3f2239c700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c06c420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0ce230 tx=0x7f3f1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d82b4eeda5ec0906 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.392+0000 7f3f20b99700 1 -- 172.21.15.88:0/1454729023 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400e070 con 0x7f3f1c06bf90 2023-08-10T10:33:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.393+0000 7f3f20b99700 1 -- 172.21.15.88:0/1454729023 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1400b910 con 0x7f3f1c06bf90 2023-08-10T10:33:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.393+0000 7f3f20b99700 1 -- 172.21.15.88:0/1454729023 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1400bcc0 con 0x7f3f1c06bf90 2023-08-10T10:33:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 -- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c06bf90 msgr2=0x7f3f1c06c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c06c420 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0ce230 tx=0x7f3f1400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 -- 172.21.15.88:0/1454729023 shutdown_connections 2023-08-10T10:33:03.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c06c420 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1454729023 >> v2:172.21.15.88:3300/0 conn(0x7f3f1c15ced0 0x7f3f1c0d1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1454729023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd870 0x7f3f1c0cdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.394+0000 7f3f23dff700 1 -- 172.21.15.88:0/1454729023 >> 172.21.15.88:0/1454729023 conn(0x7f3f1c0d31f0 msgr2=0x7f3f1c0d35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:03.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.395+0000 7f3f23dff700 1 -- 172.21.15.88:0/1454729023 shutdown_connections 2023-08-10T10:33:03.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.396+0000 7f3f23dff700 1 -- 172.21.15.88:0/1454729023 wait complete. 2023-08-10T10:33:03.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.399+0000 7f3f23dff700 1 Processor -- start 2023-08-10T10:33:03.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.401+0000 7f3f23dff700 1 -- start start 2023-08-10T10:33:03.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c1feed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c15ced0 0x7f3f1c0b7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c202cb0 con 0x7f3f1c06bf90 2023-08-10T10:33:03.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c202f90 con 0x7f3f1c0cd870 2023-08-10T10:33:03.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.403+0000 7f3f23dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c203270 con 0x7f3f1c15ced0 2023-08-10T10:33:03.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f21b9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c1feed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45462/0 (socket says 172.21.15.88:45462) 2023-08-10T10:33:03.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 -- 172.21.15.88:0/1758192890 learned_addr learned my addr 172.21.15.88:0/1758192890 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:03.407 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 -- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c15ced0 msgr2=0x7f3f1c0b7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:03.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c15ced0 0x7f3f1c0b7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 -- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f1c06bf90 msgr2=0x7f3f1c1feed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:03.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c1feed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.405+0000 7f3f2139a700 1 -- 172.21.15.88:0/1758192890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14009b30 con 0x7f3f1c0cd870 2023-08-10T10:33:03.408 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.406+0000 7f3f2139a700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e930 tx=0x7f3f1000ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.406+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000ee80 con 0x7f3f1c0cd870 2023-08-10T10:33:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.406+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1000c850 con 0x7f3f1c0cd870 2023-08-10T10:33:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.406+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1000cbe0 con 0x7f3f1c0cd870 2023-08-10T10:33:03.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.406+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c203550 con 0x7f3f1c0cd870 2023-08-10T10:33:03.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.407+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c203ba0 con 0x7f3f1c0cd870 2023-08-10T10:33:03.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.408+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc0052f0 con 0x7f3f1c0cd870 2023-08-10T10:33:03.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.411+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f1000cd40 con 0x7f3f1c0cd870 2023-08-10T10:33:03.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.413+0000 7f3f1a7fc700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 0x7f3f0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:03.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.413+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f10089f90 con 0x7f3f1c0cd870 2023-08-10T10:33:03.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.414+0000 7f3f21b9b700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 0x7f3f0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:03.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.415+0000 7f3f21b9b700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 0x7f3f0806d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00c940 tx=0x7f3f0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:03.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.417+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f10058780 con 0x7f3f1c0cd870 2023-08-10T10:33:03.831 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.830+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3efc005870 con 0x7f3f1c0cd870 2023-08-10T10:33:03.833 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.833+0000 7f3f1a7fc700 1 -- 172.21.15.88:0/1758192890 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f3f10058310 con 0x7f3f1c0cd870 2023-08-10T10:33:03.834 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:03.834 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:33:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.837+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 msgr2=0x7f3f0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:03.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.837+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 0x7f3f0806d1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00c940 tx=0x7f3f0c008040 comp rx=0 tx=0).stop 2023-08-10T10:33:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 msgr2=0x7f3f1c06dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000e930 tx=0x7f3f1000ec40 comp rx=0 tx=0).stop 2023-08-10T10:33:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 shutdown_connections 2023-08-10T10:33:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0806ace0 0x7f3f0806d1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c15ced0 0x7f3f1c0b7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f1c06bf90 0x7f3f1c1feed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 --2- 172.21.15.88:0/1758192890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c0cd870 0x7f3f1c06dd20 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:03.840 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 >> 172.21.15.88:0/1758192890 conn(0x7f3f1c0d31f0 msgr2=0x7f3f1c15d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 shutdown_connections 2023-08-10T10:33:03.841 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:03.838+0000 7f3f23dff700 1 -- 172.21.15.88:0/1758192890 wait complete. 2023-08-10T10:33:03.869 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:33:03.870 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:33:04.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.200+0000 7f9eec5ff700 1 Processor -- start 2023-08-10T10:33:04.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.201+0000 7f9eec5ff700 1 -- start start 2023-08-10T10:33:04.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee4158250 0x7f9ee406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9ee406dac0 0x7f9ee406a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ee406a920 0x7f9ee4164de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee406df40 con 0x7f9ee406dac0 2023-08-10T10:33:04.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ee40ccef0 con 0x7f9ee406a920 2023-08-10T10:33:04.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eec5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee406b180 con 0x7f9ee4158250 2023-08-10T10:33:04.205 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.203+0000 7f9eeab9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ee406a920 0x7f9ee4164de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ee406a920 0x7f9ee4164de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45470/0 (socket says 172.21.15.88:45470) 2023-08-10T10:33:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2074640348 learned_addr learned my addr 172.21.15.88:0/2074640348 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9ee9b9a700 1 --2- 172.21.15.88:0/2074640348 >> v2:172.21.15.88:3300/0 conn(0x7f9ee406dac0 0x7f9ee406a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eea39b700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee4158250 0x7f9ee406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee4158250 msgr2=0x7f9ee406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:04.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee4158250 0x7f9ee406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2074640348 >> v2:172.21.15.88:3300/0 conn(0x7f9ee406dac0 msgr2=0x7f9ee406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:04.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2074640348 >> v2:172.21.15.88:3300/0 conn(0x7f9ee406dac0 0x7f9ee406a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.204+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2074640348 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee406b460 con 0x7f9ee406a920 2023-08-10T10:33:04.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.205+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee4164de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40cc640 tx=0x7f9edc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3872ccab8feba946 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:04.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.205+0000 7f9ee9399700 1 -- 172.21.15.88:0/2074640348 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e070 con 0x7f9ee406a920 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.206+0000 7f9ee9399700 1 -- 172.21.15.88:0/2074640348 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc00b910 con 0x7f9ee406a920 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.206+0000 7f9ee9399700 1 -- 172.21.15.88:0/2074640348 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00bcc0 con 0x7f9ee406a920 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.206+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 msgr2=0x7f9ee4164de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.206+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee4164de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40cc640 tx=0x7f9edc00b330 comp rx=0 tx=0).stop 2023-08-10T10:33:04.209 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2074640348 shutdown_connections 2023-08-10T10:33:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee4164de0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2074640348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee4158250 0x7f9ee406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2074640348 >> v2:172.21.15.88:3300/0 conn(0x7f9ee406dac0 0x7f9ee406a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.210 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2074640348 >> 172.21.15.88:0/2074640348 conn(0x7f9ee40cb570 msgr2=0x7f9ee40cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2074640348 shutdown_connections 2023-08-10T10:33:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.207+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2074640348 wait complete. 2023-08-10T10:33:04.211 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.209+0000 7f9eec5ff700 1 Processor -- start 2023-08-10T10:33:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.209+0000 7f9eec5ff700 1 -- start start 2023-08-10T10:33:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee414e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.212 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 0x7f9ee40c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 0x7f9ee40c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c7190 con 0x7f9ee4158250 2023-08-10T10:33:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c68f0 con 0x7f9ee406a920 2023-08-10T10:33:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eec5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40c6bd0 con 0x7f9ee406dac0 2023-08-10T10:33:04.213 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.211+0000 7f9eea39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee414e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eea39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee414e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45484/0 (socket says 172.21.15.88:45484) 2023-08-10T10:33:04.214 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eea39b700 1 -- 172.21.15.88:0/2267149867 learned_addr learned my addr 172.21.15.88:0/2267149867 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 0x7f9ee40c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9ee9b9a700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 0x7f9ee40c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 msgr2=0x7f9ee40c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 0x7f9ee40c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.215 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 msgr2=0x7f9ee414e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee414e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.212+0000 7f9eeab9c700 1 -- 172.21.15.88:0/2267149867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc009b30 con 0x7f9ee4158250 2023-08-10T10:33:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.213+0000 7f9ee9b9a700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 0x7f9ee40c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:04.216 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.213+0000 7f9eeab9c700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 0x7f9ee40c8040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9edc015000 tx=0x7f9edc004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.214+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0092e0 con 0x7f9ee4158250 2023-08-10T10:33:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.214+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc004250 con 0x7f9ee4158250 2023-08-10T10:33:04.217 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.214+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc004600 con 0x7f9ee4158250 2023-08-10T10:33:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.214+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee40c6eb0 con 0x7f9ee4158250 2023-08-10T10:33:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.214+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee414e6f0 con 0x7f9ee4158250 2023-08-10T10:33:04.218 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.216+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee406e900 con 0x7f9ee4158250 2023-08-10T10:33:04.220 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.219+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9edc004760 con 0x7f9ee4158250 2023-08-10T10:33:04.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.221+0000 7f9edaffd700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 0x7f9ec806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.221+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9edc08afd0 con 0x7f9ee4158250 2023-08-10T10:33:04.222 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.221+0000 7f9eea39b700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 0x7f9ec806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.223 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.223+0000 7f9eea39b700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 0x7f9ec806d1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0007a70 tx=0x7f9ee0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:04.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.225+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9edc055dc0 con 0x7f9ee4158250 2023-08-10T10:33:04.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.559+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ee41eaf90 con 0x7f9ee4158250 2023-08-10T10:33:04.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.560+0000 7f9edaffd700 1 -- 172.21.15.88:0/2267149867 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9edc020020 con 0x7f9ee4158250 2023-08-10T10:33:04.561 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:33:04.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 msgr2=0x7f9ec806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 0x7f9ec806d1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0007a70 tx=0x7f9ee0008040 comp rx=0 tx=0).stop 2023-08-10T10:33:04.563 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 msgr2=0x7f9ee40c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 0x7f9ee40c8040 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9edc015000 tx=0x7f9edc004ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 shutdown_connections 2023-08-10T10:33:04.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ee4158250 0x7f9ee40c8040 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.564 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee406a920 0x7f9ee414e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9ec806ad30 0x7f9ec806d1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 --2- 172.21.15.88:0/2267149867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ee406dac0 0x7f9ee40c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.562+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 >> 172.21.15.88:0/2267149867 conn(0x7f9ee40cb570 msgr2=0x7f9ee40c3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.563+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 shutdown_connections 2023-08-10T10:33:04.565 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.563+0000 7f9eec5ff700 1 -- 172.21.15.88:0/2267149867 wait complete. 2023-08-10T10:33:04.590 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:33:04.941 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.939+0000 7fee695ff700 1 Processor -- start 2023-08-10T10:33:04.942 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.940+0000 7fee695ff700 1 -- start start 2023-08-10T10:33:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.942+0000 7fee695ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee64158250 0x7fee6406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.942+0000 7fee695ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6406aaf0 0x7fee640cd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.943+0000 7fee695ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee6406af40 con 0x7fee6406dac0 2023-08-10T10:33:04.943 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.943+0000 7fee695ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee6406df70 con 0x7fee64158250 2023-08-10T10:33:04.944 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.943+0000 7fee695ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee640ccef0 con 0x7fee6406aaf0 2023-08-10T10:33:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.944+0000 7fee627fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee6406dac0 0x7fee6406a3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58354/0 (socket says 172.21.15.88:58354) 2023-08-10T10:33:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.944+0000 7fee627fc700 1 -- 172.21.15.88:0/2037750712 learned_addr learned my addr 172.21.15.88:0/2037750712 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:04.945 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.944+0000 7fee62ffd700 1 --2- 172.21.15.88:0/2037750712 >> v2:172.21.15.88:3300/0 conn(0x7fee64158250 0x7fee6406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.946 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.944+0000 7fee637fe700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6406aaf0 0x7fee640cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.947 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee61ffb700 1 -- 172.21.15.88:0/2037750712 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552464654 0 0) 0x7fee58001110 con 0x7fee6406dac0 2023-08-10T10:33:04.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee61ffb700 1 -- 172.21.15.88:0/2037750712 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee4c0035b0 con 0x7fee6406dac0 2023-08-10T10:33:04.948 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee62ffd700 1 -- 172.21.15.88:0/2037750712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6406aaf0 msgr2=0x7fee640cd380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:04.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee62ffd700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6406aaf0 0x7fee640cd380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.949 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee62ffd700 1 -- 172.21.15.88:0/2037750712 >> v1:172.21.15.88:6789/0 conn(0x7fee6406dac0 legacy=0x7fee6406a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee62ffd700 1 -- 172.21.15.88:0/2037750712 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee6406b180 con 0x7fee64158250 2023-08-10T10:33:04.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.945+0000 7fee62ffd700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee64158250 0x7fee6406d580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee54009840 tx=0x7fee54009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f12761dedc7e032 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:04.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.946+0000 7fee61ffb700 1 -- 172.21.15.88:0/2037750712 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011830 con 0x7fee64158250 2023-08-10T10:33:04.950 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.946+0000 7fee61ffb700 1 -- 172.21.15.88:0/2037750712 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee54011990 con 0x7fee64158250 2023-08-10T10:33:04.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.946+0000 7fee61ffb700 1 -- 172.21.15.88:0/2037750712 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee54011d20 con 0x7fee64158250 2023-08-10T10:33:04.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.947+0000 7fee695ff700 1 -- 172.21.15.88:0/2037750712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee64158250 msgr2=0x7fee6406d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.947+0000 7fee695ff700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee64158250 0x7fee6406d580 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fee54009840 tx=0x7fee54009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:04.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 -- 172.21.15.88:0/2037750712 shutdown_connections 2023-08-10T10:33:04.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee6406aaf0 0x7fee640cd380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 --2- 172.21.15.88:0/2037750712 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee64158250 0x7fee6406d580 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 -- 172.21.15.88:0/2037750712 >> 172.21.15.88:0/2037750712 conn(0x7fee640cb570 msgr2=0x7fee640cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:04.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 -- 172.21.15.88:0/2037750712 shutdown_connections 2023-08-10T10:33:04.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.948+0000 7fee695ff700 1 -- 172.21.15.88:0/2037750712 wait complete. 2023-08-10T10:33:04.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.951+0000 7fee695ff700 1 Processor -- start 2023-08-10T10:33:04.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.951+0000 7fee695ff700 1 -- start start 2023-08-10T10:33:04.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6406aaf0 0x7fee64165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee64158250 0x7fee640b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee64163de0 con 0x7fee6406dac0 2023-08-10T10:33:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee64163540 con 0x7fee6406aaf0 2023-08-10T10:33:04.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee695ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee64163820 con 0x7fee64158250 2023-08-10T10:33:04.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee627fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57816/0 (socket says 172.21.15.88:57816) 2023-08-10T10:33:04.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.953+0000 7fee627fc700 1 -- 172.21.15.88:0/3683887629 learned_addr learned my addr 172.21.15.88:0/3683887629 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:04.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee62ffd700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6406aaf0 0x7fee64165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee637fe700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee64158250 0x7fee640b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee627fc700 1 -- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee64158250 msgr2=0x7fee640b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee627fc700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee64158250 0x7fee640b3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee627fc700 1 -- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6406aaf0 msgr2=0x7fee64165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:04.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee627fc700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6406aaf0 0x7fee64165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:04.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.954+0000 7fee627fc700 1 -- 172.21.15.88:0/3683887629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee540094a0 con 0x7fee6406dac0 2023-08-10T10:33:04.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.955+0000 7fee627fc700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee5800ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:04.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.955+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58005d70 con 0x7fee6406dac0 2023-08-10T10:33:04.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.956+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee580070d0 con 0x7fee6406dac0 2023-08-10T10:33:04.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.956+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee58007460 con 0x7fee6406dac0 2023-08-10T10:33:04.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.956+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee64163b00 con 0x7fee6406dac0 2023-08-10T10:33:04.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.956+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee641655c0 con 0x7fee6406dac0 2023-08-10T10:33:04.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.957+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee6406e900 con 0x7fee6406dac0 2023-08-10T10:33:04.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.960+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fee580075c0 con 0x7fee6406dac0 2023-08-10T10:33:04.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.962+0000 7fee4b7fe700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 0x7fee5006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:04.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.962+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fee58089070 con 0x7fee6406dac0 2023-08-10T10:33:04.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.966+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fee58053e60 con 0x7fee6406dac0 2023-08-10T10:33:04.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.967+0000 7fee62ffd700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 0x7fee5006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:04.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:04.968+0000 7fee62ffd700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 0x7fee5006d270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee54000c00 tx=0x7fee5401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:05.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.362+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fee64165840 con 0x7fee6406dac0 2023-08-10T10:33:05.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.364+0000 7fee4b7fe700 1 -- 172.21.15.88:0/3683887629 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fee64165840 con 0x7fee6406dac0 2023-08-10T10:33:05.366 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:33:05.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.367+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 msgr2=0x7fee5006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:05.368 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.367+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 0x7fee5006d270 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fee54000c00 tx=0x7fee5401c040 comp rx=0 tx=0).stop 2023-08-10T10:33:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.367+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 msgr2=0x7fee640b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.367+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fee58007fd0 tx=0x7fee5800ca90 comp rx=0 tx=0).stop 2023-08-10T10:33:05.369 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 shutdown_connections 2023-08-10T10:33:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fee5006adb0 0x7fee5006d270 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee64158250 0x7fee640b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee6406aaf0 0x7fee64165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 --2- 172.21.15.88:0/3683887629 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee6406dac0 0x7fee640b3310 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.370 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 >> 172.21.15.88:0/3683887629 conn(0x7fee640cb570 msgr2=0x7fee640b2190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:05.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 shutdown_connections 2023-08-10T10:33:05.371 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.368+0000 7fee695ff700 1 -- 172.21.15.88:0/3683887629 wait complete. 2023-08-10T10:33:05.401 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:33:05.749 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.749+0000 7f21ec1ff700 1 Processor -- start 2023-08-10T10:33:05.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.749+0000 7f21ec1ff700 1 -- start start 2023-08-10T10:33:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.751+0000 7f21ec1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21e406df90 0x7f21e406e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.751+0000 7f21ec1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e406ad10 con 0x7f21e413f6b0 2023-08-10T10:33:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.751+0000 7f21ec1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e413fa90 con 0x7f21e406a170 2023-08-10T10:33:05.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.751+0000 7f21ec1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e40cd2e0 con 0x7f21e406df90 2023-08-10T10:33:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.752+0000 7f21ea79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21e406df90 0x7f21e406e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.752+0000 7f21ea79c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21e406df90 0x7f21e406e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57828/0 (socket says 172.21.15.88:57828) 2023-08-10T10:33:05.753 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.752+0000 7f21ea79c700 1 -- 172.21.15.88:0/2259810114 learned_addr learned my addr 172.21.15.88:0/2259810114 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.753+0000 7f21ea79c700 1 -- 172.21.15.88:0/2259810114 >> v1:172.21.15.187:6789/0 conn(0x7f21e406a170 legacy=0x7f21e406a600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-08-10T10:33:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.753+0000 7f21ea79c700 1 -- 172.21.15.88:0/2259810114 >> v1:172.21.15.88:6789/0 conn(0x7f21e413f6b0 legacy=0x7f21e40ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.753+0000 7f21ea79c700 1 -- 172.21.15.88:0/2259810114 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40cd580 con 0x7f21e406df90 2023-08-10T10:33:05.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.753+0000 7f21ea79c700 1 --2- 172.21.15.88:0/2259810114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e406e3e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21d400f9b0 tx=0x7f21d400fcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98741327f75d697c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:05.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.754+0000 7f21e8f99700 1 -- 172.21.15.88:0/2259810114 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d400f460 con 0x7f21e406df90 2023-08-10T10:33:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.754+0000 7f21e8f99700 1 -- 172.21.15.88:0/2259810114 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d4004030 con 0x7f21e406df90 2023-08-10T10:33:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.754+0000 7f21e8f99700 1 -- 172.21.15.88:0/2259810114 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d40043a0 con 0x7f21e406df90 2023-08-10T10:33:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.755+0000 7f21ec1ff700 1 -- 172.21.15.88:0/2259810114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 msgr2=0x7f21e406e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.755+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/2259810114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e406e3e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f21d400f9b0 tx=0x7f21d400fcc0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.756+0000 7f21ec1ff700 1 -- 172.21.15.88:0/2259810114 shutdown_connections 2023-08-10T10:33:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.756+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/2259810114 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e406e3e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.756+0000 7f21ec1ff700 1 -- 172.21.15.88:0/2259810114 >> 172.21.15.88:0/2259810114 conn(0x7f21e40cb570 msgr2=0x7f21e40cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.756+0000 7f21ec1ff700 1 -- 172.21.15.88:0/2259810114 shutdown_connections 2023-08-10T10:33:05.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.757+0000 7f21ec1ff700 1 -- 172.21.15.88:0/2259810114 wait complete. 2023-08-10T10:33:05.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.760+0000 7f21ec1ff700 1 Processor -- start 2023-08-10T10:33:05.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.760+0000 7f21ec1ff700 1 -- start start 2023-08-10T10:33:05.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 0x7f21e40c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:05.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e40b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:05.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21e413f6b0 0x7f21e406e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:05.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40c8210 con 0x7f21e406df90 2023-08-10T10:33:05.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b1c80 con 0x7f21e413f6b0 2023-08-10T10:33:05.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.762+0000 7f21ec1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40b1f60 con 0x7f21e406a170 2023-08-10T10:33:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.764+0000 7f21ea79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21e413f6b0 0x7f21e406e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.764+0000 7f21e9f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 0x7f21e40c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.764+0000 7f21e9f9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 0x7f21e40c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:54284/0 (socket says 172.21.15.88:54284) 2023-08-10T10:33:05.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.764+0000 7f21e9f9b700 1 -- 172.21.15.88:0/3919318501 learned_addr learned my addr 172.21.15.88:0/3919318501 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:05.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.764+0000 7f21e979a700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e40b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:05.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.765+0000 7f21e979a700 1 -- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 msgr2=0x7f21e40c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.765+0000 7f21e979a700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 0x7f21e40c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.765+0000 7f21e979a700 1 -- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21e413f6b0 msgr2=0x7f21e406e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.765+0000 7f21e979a700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21e413f6b0 0x7f21e406e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.765+0000 7f21e979a700 1 -- 172.21.15.88:0/3919318501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d400f610 con 0x7f21e406df90 2023-08-10T10:33:05.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.766+0000 7f21e979a700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e40b39d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f21e0006fd0 tx=0x7f21e000b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.766+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011830 con 0x7f21e406df90 2023-08-10T10:33:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.766+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e00119b0 con 0x7f21e406df90 2023-08-10T10:33:05.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.766+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e0011d60 con 0x7f21e406df90 2023-08-10T10:33:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.766+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40b2240 con 0x7f21e406df90 2023-08-10T10:33:05.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.768+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e40b2800 con 0x7f21e406df90 2023-08-10T10:33:05.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.770+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e41407a0 con 0x7f21e406df90 2023-08-10T10:33:05.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.771+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f21e001a400 con 0x7f21e406df90 2023-08-10T10:33:05.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.773+0000 7f21da7fc700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 0x7f21c806d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:05.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.773+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f21e005b470 con 0x7f21e406df90 2023-08-10T10:33:05.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.774+0000 7f21e9f9b700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 0x7f21c806d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:05.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.775+0000 7f21e9f9b700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 0x7f21c806d1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f90 tx=0x7f21dc0095b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:05.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:05.781+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f21e00537f0 con 0x7f21e406df90 2023-08-10T10:33:06.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.193+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21e40743a0 con 0x7f21e406df90 2023-08-10T10:33:06.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.194+0000 7f21da7fc700 1 -- 172.21.15.88:0/3919318501 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21e00150a0 con 0x7f21e406df90 2023-08-10T10:33:06.195 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:06.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 msgr2=0x7f21c806d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 0x7f21c806d1f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f21dc009f90 tx=0x7f21dc0095b0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 msgr2=0x7f21e40b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e40b39d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f21e0006fd0 tx=0x7f21e000b7e0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 shutdown_connections 2023-08-10T10:33:06.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21e413f6b0 0x7f21e406e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f21c806ad30 0x7f21c806d1f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21e406a170 0x7f21e40c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.201 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 --2- 172.21.15.88:0/3919318501 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21e406df90 0x7f21e40b39d0 secure :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f21e0006fd0 tx=0x7f21e000b7e0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.198+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 >> 172.21.15.88:0/3919318501 conn(0x7f21e40cb570 msgr2=0x7f21e413e580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:06.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.199+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 shutdown_connections 2023-08-10T10:33:06.202 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.200+0000 7f21ec1ff700 1 -- 172.21.15.88:0/3919318501 wait complete. 2023-08-10T10:33:06.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:33:06.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.577+0000 7fd523bff700 1 Processor -- start 2023-08-10T10:33:06.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.578+0000 7fd523bff700 1 -- start start 2023-08-10T10:33:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.579+0000 7fd523bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd51c153a50 0x7fd51c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd523bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd51c06d2e0 0x7fd51c06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd523bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c06dc80 con 0x7fd51c15d160 2023-08-10T10:33:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd523bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c15ded0 con 0x7fd51c153a50 2023-08-10T10:33:06.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd523bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c153e30 con 0x7fd51c06d2e0 2023-08-10T10:33:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd52199b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd51c153a50 0x7fd51c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd52199b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd51c153a50 0x7fd51c06a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57840/0 (socket says 172.21.15.88:57840) 2023-08-10T10:33:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.580+0000 7fd52199b700 1 -- 172.21.15.88:0/972376593 learned_addr learned my addr 172.21.15.88:0/972376593 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:06.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.581+0000 7fd52119a700 1 --2- 172.21.15.88:0/972376593 >> v2:172.21.15.187:3300/0 conn(0x7fd51c06d2e0 0x7fd51c06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.581+0000 7fd52199b700 1 -- 172.21.15.88:0/972376593 >> v2:172.21.15.187:3300/0 conn(0x7fd51c06d2e0 msgr2=0x7fd51c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.581+0000 7fd52199b700 1 --2- 172.21.15.88:0/972376593 >> v2:172.21.15.187:3300/0 conn(0x7fd51c06d2e0 0x7fd51c06d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.581+0000 7fd52199b700 1 -- 172.21.15.88:0/972376593 >> v1:172.21.15.187:6789/0 conn(0x7fd51c15d160 legacy=0x7fd51c15d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.581+0000 7fd52199b700 1 -- 172.21.15.88:0/972376593 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c15dca0 con 0x7fd51c153a50 2023-08-10T10:33:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.582+0000 7fd52199b700 1 --2- 172.21.15.88:0/972376593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c153a50 0x7fd51c06a170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b1fa0 tx=0x7fd50c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=571460fc99869e68 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.582+0000 7fd520999700 1 -- 172.21.15.88:0/972376593 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00b870 con 0x7fd51c153a50 2023-08-10T10:33:06.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.582+0000 7fd520999700 1 -- 172.21.15.88:0/972376593 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00b9d0 con 0x7fd51c153a50 2023-08-10T10:33:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.582+0000 7fd520999700 1 -- 172.21.15.88:0/972376593 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00bd60 con 0x7fd51c153a50 2023-08-10T10:33:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 -- 172.21.15.88:0/972376593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c153a50 msgr2=0x7fd51c06a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 --2- 172.21.15.88:0/972376593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c153a50 0x7fd51c06a170 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fd51c0b1fa0 tx=0x7fd50c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 -- 172.21.15.88:0/972376593 shutdown_connections 2023-08-10T10:33:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 --2- 172.21.15.88:0/972376593 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c153a50 0x7fd51c06a170 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 --2- 172.21.15.88:0/972376593 >> v2:172.21.15.187:3300/0 conn(0x7fd51c06d2e0 0x7fd51c06d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 -- 172.21.15.88:0/972376593 >> 172.21.15.88:0/972376593 conn(0x7fd51c0cf370 msgr2=0x7fd51c0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:06.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 -- 172.21.15.88:0/972376593 shutdown_connections 2023-08-10T10:33:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.584+0000 7fd523bff700 1 -- 172.21.15.88:0/972376593 wait complete. 2023-08-10T10:33:06.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.587+0000 7fd523bff700 1 Processor -- start 2023-08-10T10:33:06.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.587+0000 7fd523bff700 1 -- start start 2023-08-10T10:33:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c06d2e0 0x7fd51c0c4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51c153a50 0x7fd51c14a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c5360 con 0x7fd51c06d2e0 2023-08-10T10:33:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c5640 con 0x7fd51c15d160 2023-08-10T10:33:06.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd523bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0c5920 con 0x7fd51c153a50 2023-08-10T10:33:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd52219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd52219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45518/0 (socket says 172.21.15.88:45518) 2023-08-10T10:33:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.589+0000 7fd52219c700 1 -- 172.21.15.88:0/2775881331 learned_addr learned my addr 172.21.15.88:0/2775881331 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:06.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52199b700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c06d2e0 0x7fd51c0c4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52119a700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51c153a50 0x7fd51c14a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52219c700 1 -- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51c153a50 msgr2=0x7fd51c14a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52219c700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51c153a50 0x7fd51c14a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52219c700 1 -- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c06d2e0 msgr2=0x7fd51c0c4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52219c700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c06d2e0 0x7fd51c0c4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.590+0000 7fd52219c700 1 -- 172.21.15.88:0/2775881331 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009550 con 0x7fd51c15d160 2023-08-10T10:33:06.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.591+0000 7fd52219c700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd51400cb50 tx=0x7fd51400ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.592+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514003c00 con 0x7fd51c15d160 2023-08-10T10:33:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.592+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd514003d60 con 0x7fd51c15d160 2023-08-10T10:33:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.592+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400aa20 con 0x7fd51c15d160 2023-08-10T10:33:06.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.592+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd51c159de0 con 0x7fd51c15d160 2023-08-10T10:33:06.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.593+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c0c4f50 con 0x7fd51c15d160 2023-08-10T10:33:06.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.595+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c06c310 con 0x7fd51c15d160 2023-08-10T10:33:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.596+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd51400ab80 con 0x7fd51c15d160 2023-08-10T10:33:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.598+0000 7fd5127fc700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 0x7fd50006d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:06.599 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.598+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd514089780 con 0x7fd51c15d160 2023-08-10T10:33:06.600 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.599+0000 7fd52199b700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 0x7fd50006d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:06.601 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.601+0000 7fd52199b700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 0x7fd50006d1f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000c00 tx=0x7fd50c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:06.608 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:06.607+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd51c06c310 con 0x7fd51c15d160 2023-08-10T10:33:07.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.025+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd51c06c310 con 0x7fd51c15d160 2023-08-10T10:33:07.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.027+0000 7fd5127fc700 1 -- 172.21.15.88:0/2775881331 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd51c06c310 con 0x7fd51c15d160 2023-08-10T10:33:07.028 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:33:07.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.031+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 msgr2=0x7fd50006d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.031+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 0x7fd50006d1f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd50c000c00 tx=0x7fd50c008030 comp rx=0 tx=0).stop 2023-08-10T10:33:07.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.031+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 msgr2=0x7fd51c1491f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.031+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd51400cb50 tx=0x7fd51400ce60 comp rx=0 tx=0).stop 2023-08-10T10:33:07.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 shutdown_connections 2023-08-10T10:33:07.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd51c15d160 0x7fd51c1491f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd51c06d2e0 0x7fd51c0c4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd50006ad30 0x7fd50006d1f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 --2- 172.21.15.88:0/2775881331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd51c153a50 0x7fd51c14a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 >> 172.21.15.88:0/2775881331 conn(0x7fd51c0cf370 msgr2=0x7fd51c0b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:07.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 shutdown_connections 2023-08-10T10:33:07.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.032+0000 7fd523bff700 1 -- 172.21.15.88:0/2775881331 wait complete. 2023-08-10T10:33:07.063 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:33:07.410 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.410+0000 7f9a8f1ff700 1 Processor -- start 2023-08-10T10:33:07.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.410+0000 7f9a8f1ff700 1 -- start start 2023-08-10T10:33:07.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.412+0000 7f9a8f1ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9a8815d1e0 0x7f9a880d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:07.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.412+0000 7f9a8f1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a880d1840 con 0x7f9a880b5060 2023-08-10T10:33:07.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.413+0000 7f9a8f1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a880d1b20 con 0x7f9a880d1060 2023-08-10T10:33:07.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.413+0000 7f9a8f1ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a8815d5c0 con 0x7f9a8815d1e0 2023-08-10T10:33:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.413+0000 7f9a87fff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9a880d1060 0x7f9a880b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:37544/0 (socket says 172.21.15.88:37544) 2023-08-10T10:33:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.413+0000 7f9a87fff700 1 -- 172.21.15.88:0/1707096661 learned_addr learned my addr 172.21.15.88:0/1707096661 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:07.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.413+0000 7f9a8cf9b700 1 --2- 172.21.15.88:0/1707096661 >> v2:172.21.15.88:3300/0 conn(0x7f9a8815d1e0 0x7f9a880d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.415+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/1707096661 >> v1:172.21.15.187:6789/0 conn(0x7f9a880d1060 legacy=0x7f9a880b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.415+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/1707096661 >> v1:172.21.15.88:6789/0 conn(0x7f9a880b5060 legacy=0x7f9a880b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.415+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/1707096661 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a880d1e00 con 0x7f9a8815d1e0 2023-08-10T10:33:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.415+0000 7f9a8cf9b700 1 --2- 172.21.15.88:0/1707096661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a8815d1e0 0x7f9a880d27a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a78009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27148b92cf5cfb3b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:07.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.415+0000 7f9a877fe700 1 -- 172.21.15.88:0/1707096661 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78004230 con 0x7f9a8815d1e0 2023-08-10T10:33:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.416+0000 7f9a877fe700 1 -- 172.21.15.88:0/1707096661 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a78004390 con 0x7f9a8815d1e0 2023-08-10T10:33:07.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.416+0000 7f9a877fe700 1 -- 172.21.15.88:0/1707096661 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780036a0 con 0x7f9a8815d1e0 2023-08-10T10:33:07.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.416+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/1707096661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a8815d1e0 msgr2=0x7f9a880d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.416+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/1707096661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a8815d1e0 0x7f9a880d27a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a780097c0 tx=0x7f9a78009ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.417+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/1707096661 shutdown_connections 2023-08-10T10:33:07.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.417+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/1707096661 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a8815d1e0 0x7f9a880d27a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.417+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/1707096661 >> 172.21.15.88:0/1707096661 conn(0x7f9a880cf950 msgr2=0x7f9a880cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.417+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/1707096661 shutdown_connections 2023-08-10T10:33:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.418+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/1707096661 wait complete. 2023-08-10T10:33:07.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.420+0000 7f9a8f1ff700 1 Processor -- start 2023-08-10T10:33:07.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.421+0000 7f9a8f1ff700 1 -- start start 2023-08-10T10:33:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.422+0000 7f9a8f1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.422+0000 7f9a8f1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 0x7f9a8815a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.422+0000 7f9a8f1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8815d1e0 0x7f9a8815a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:07.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8f1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a88156c90 con 0x7f9a880d1060 2023-08-10T10:33:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8f1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a881f7e50 con 0x7f9a880b5060 2023-08-10T10:33:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8f1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a880ca0d0 con 0x7f9a8815d1e0 2023-08-10T10:33:07.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8cf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8cf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:45532/0 (socket says 172.21.15.88:45532) 2023-08-10T10:33:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/2761995652 learned_addr learned my addr 172.21.15.88:0/2761995652 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a87fff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 0x7f9a8815a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:07.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.423+0000 7f9a8d79c700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8815d1e0 0x7f9a8815a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8815d1e0 msgr2=0x7f9a8815a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a8cf9b700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8815d1e0 0x7f9a8815a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 msgr2=0x7f9a8815a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a8cf9b700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 0x7f9a8815a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a8cf9b700 1 -- 172.21.15.88:0/2761995652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780094a0 con 0x7f9a880b5060 2023-08-10T10:33:07.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.424+0000 7f9a87fff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 0x7f9a8815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:07.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.425+0000 7f9a8cf9b700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a780090b0 tx=0x7f9a78004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:07.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.426+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a78011630 con 0x7f9a880b5060 2023-08-10T10:33:07.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.426+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7801f070 con 0x7f9a880b5060 2023-08-10T10:33:07.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.426+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a780119d0 con 0x7f9a880b5060 2023-08-10T10:33:07.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.426+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a880ca3b0 con 0x7f9a880b5060 2023-08-10T10:33:07.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.426+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a880ca970 con 0x7f9a880b5060 2023-08-10T10:33:07.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.428+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a880743a0 con 0x7f9a880b5060 2023-08-10T10:33:07.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.432+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9a78011b30 con 0x7f9a880b5060 2023-08-10T10:33:07.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.433+0000 7f9a857fa700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 0x7f9a7406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:07.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.433+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9a78021070 con 0x7f9a880b5060 2023-08-10T10:33:07.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.435+0000 7f9a87fff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 0x7f9a7406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.437+0000 7f9a87fff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 0x7f9a7406d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a88159c40 tx=0x7f9a80001ab0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:07.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.438+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9a78056300 con 0x7f9a880b5060 2023-08-10T10:33:07.802 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.801+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9a880cef10 con 0x7f9a880b5060 2023-08-10T10:33:07.803 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:07.803 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.802+0000 7f9a857fa700 1 -- 172.21.15.88:0/2761995652 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9a78059920 con 0x7f9a880b5060 2023-08-10T10:33:07.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 msgr2=0x7f9a7406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 0x7f9a7406d1a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9a88159c40 tx=0x7f9a80001ab0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 msgr2=0x7f9a88156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a780090b0 tx=0x7f9a78004750 comp rx=0 tx=0).stop 2023-08-10T10:33:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 shutdown_connections 2023-08-10T10:33:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9a7406ace0 0x7f9a7406d1a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8815d1e0 0x7f9a8815a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a880b5060 0x7f9a88156750 secure :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a780090b0 tx=0x7f9a78004750 comp rx=0 tx=0).stop 2023-08-10T10:33:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 --2- 172.21.15.88:0/2761995652 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9a880d1060 0x7f9a8815a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 >> 172.21.15.88:0/2761995652 conn(0x7f9a880cf950 msgr2=0x7f9a8815f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:07.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.807+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 shutdown_connections 2023-08-10T10:33:07.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:07.808+0000 7f9a8f1ff700 1 -- 172.21.15.88:0/2761995652 wait complete. 2023-08-10T10:33:07.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:33:08.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.055+0000 7fdc215ff700 1 Processor -- start 2023-08-10T10:33:08.057 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.055+0000 7fdc215ff700 1 -- start start 2023-08-10T10:33:08.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc215ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc1c15cf20 0x7fdc1c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc215ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdc1c0b5210 0x7fdc1c0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc215ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc1c15e590 con 0x7fdc1c0b8870 2023-08-10T10:33:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc215ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0cde30 con 0x7fdc1c15cf20 2023-08-10T10:33:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc215ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc1c0b8e30 con 0x7fdc1c0b5210 2023-08-10T10:33:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc1c15cf20 0x7fdc1c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fdc1c15cf20 0x7fdc1c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57862/0 (socket says 172.21.15.88:57862) 2023-08-10T10:33:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 -- 172.21.15.88:0/4213398307 learned_addr learned my addr 172.21.15.88:0/4213398307 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1b7fe700 1 --2- 172.21.15.88:0/4213398307 >> v2:172.21.15.187:3300/0 conn(0x7fdc1c0b5210 0x7fdc1c0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 -- 172.21.15.88:0/4213398307 >> v2:172.21.15.187:3300/0 conn(0x7fdc1c0b5210 msgr2=0x7fdc1c0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 --2- 172.21.15.88:0/4213398307 >> v2:172.21.15.187:3300/0 conn(0x7fdc1c0b5210 0x7fdc1c0d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 -- 172.21.15.88:0/4213398307 >> v1:172.21.15.187:6789/0 conn(0x7fdc1c0b8870 legacy=0x7fdc1c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 -- 172.21.15.88:0/4213398307 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0ce010 con 0x7fdc1c15cf20 2023-08-10T10:33:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.057+0000 7fdc1affd700 1 --2- 172.21.15.88:0/4213398307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c15cf20 0x7fdc1c15e050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0cd840 tx=0x7fdc0c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459ea6e14f42ae0c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc19ffb700 1 -- 172.21.15.88:0/4213398307 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c004230 con 0x7fdc1c15cf20 2023-08-10T10:33:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc19ffb700 1 -- 172.21.15.88:0/4213398307 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c004390 con 0x7fdc1c15cf20 2023-08-10T10:33:08.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc19ffb700 1 -- 172.21.15.88:0/4213398307 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0036a0 con 0x7fdc1c15cf20 2023-08-10T10:33:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 -- 172.21.15.88:0/4213398307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c15cf20 msgr2=0x7fdc1c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:08.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 --2- 172.21.15.88:0/4213398307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c15cf20 0x7fdc1c15e050 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c0cd840 tx=0x7fdc0c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 -- 172.21.15.88:0/4213398307 shutdown_connections 2023-08-10T10:33:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 --2- 172.21.15.88:0/4213398307 >> v2:172.21.15.187:3300/0 conn(0x7fdc1c0b5210 0x7fdc1c0d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 --2- 172.21.15.88:0/4213398307 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c15cf20 0x7fdc1c15e050 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 -- 172.21.15.88:0/4213398307 >> 172.21.15.88:0/4213398307 conn(0x7fdc1c0d3080 msgr2=0x7fdc1c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 -- 172.21.15.88:0/4213398307 shutdown_connections 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.058+0000 7fdc215ff700 1 -- 172.21.15.88:0/4213398307 wait complete. 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.060+0000 7fdc215ff700 1 Processor -- start 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.060+0000 7fdc215ff700 1 -- start start 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c0b5210 0x7fdc1c0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 0x7fdc1c14de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c157e70 con 0x7fdc1c0b8870 2023-08-10T10:33:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0ccbb0 con 0x7fdc1c0b5210 2023-08-10T10:33:08.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc215ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0cce90 con 0x7fdc1c15cf20 2023-08-10T10:33:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc1a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc1a7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57878/0 (socket says 172.21.15.88:57878) 2023-08-10T10:33:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.061+0000 7fdc1a7fc700 1 -- 172.21.15.88:0/589100367 learned_addr learned my addr 172.21.15.88:0/589100367 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1affd700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c0b5210 0x7fdc1c0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1b7fe700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 0x7fdc1c14de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 -- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 msgr2=0x7fdc1c14de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 0x7fdc1c14de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 -- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c0b5210 msgr2=0x7fdc1c0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c0b5210 0x7fdc1c0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 -- 172.21.15.88:0/589100367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0c009550 con 0x7fdc1c0b8870 2023-08-10T10:33:08.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1b7fe700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 0x7fdc1c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc1a7fc700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c4d0 tx=0x7fdc1000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011790 con 0x7fdc1c0b8870 2023-08-10T10:33:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc100118f0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c0cd170 con 0x7fdc1c0b8870 2023-08-10T10:33:08.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.062+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc10011ca0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.063+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c0ca600 con 0x7fdc1c0b8870 2023-08-10T10:33:08.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.064+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c0cd690 con 0x7fdc1c0b8870 2023-08-10T10:33:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.064+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdc1001c460 con 0x7fdc1c0b8870 2023-08-10T10:33:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.065+0000 7fdc037fe700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 0x7fdc0806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.065+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdc100895e0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.066+0000 7fdc1affd700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 0x7fdc0806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:08.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.066+0000 7fdc1affd700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 0x7fdc0806d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009130 tx=0x7fdc0c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:08.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.070+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fdc100542c0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.280+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdc1c04ecc0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.280+0000 7fdc037fe700 1 -- 172.21.15.88:0/589100367 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdc100578e0 con 0x7fdc1c0b8870 2023-08-10T10:33:08.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 msgr2=0x7fdc0806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 0x7fdc0806d1a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009130 tx=0x7fdc0c008030 comp rx=0 tx=0).stop 2023-08-10T10:33:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 msgr2=0x7fdc1c0cc100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:08.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fdc1000c4d0 tx=0x7fdc1000c7e0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 shutdown_connections 2023-08-10T10:33:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdc0806ace0 0x7fdc0806d1a0 secure :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009130 tx=0x7fdc0c008030 comp rx=0 tx=0).stop 2023-08-10T10:33:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c15cf20 0x7fdc1c14de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c0b5210 0x7fdc1c0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 --2- 172.21.15.88:0/589100367 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdc1c0b8870 0x7fdc1c0cc100 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.282+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 >> 172.21.15.88:0/589100367 conn(0x7fdc1c0d3080 msgr2=0x7fdc1c15a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.283+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 shutdown_connections 2023-08-10T10:33:08.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:08.283+0000 7fdc215ff700 1 -- 172.21.15.88:0/589100367 wait complete. 2023-08-10T10:33:08.287 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:33:08.301 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-08-10T10:33:08.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:08.302 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-08-10T10:33:08.827 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:33:08.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:08.828 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-10T10:33:08.881 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:33:08.882 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:08.927 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-08-10T10:33:08.927 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:09.012 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:33:09.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.246+0000 7f7281bff700 1 Processor -- start 2023-08-10T10:33:09.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.246+0000 7f7281bff700 1 -- start start 2023-08-10T10:33:09.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.247+0000 7f7281bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 0x7f727c0b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.247+0000 7f7281bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 0x7f727c0cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.247+0000 7f7281bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727c06c2d0 con 0x7f727c15ebc0 2023-08-10T10:33:09.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.247+0000 7f7281bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f727c06c5b0 con 0x7f727c15e740 2023-08-10T10:33:09.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.247+0000 7f7281bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c06c890 con 0x7f727c0afd50 2023-08-10T10:33:09.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 0x7f727c0b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727affd700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 0x7f727c0cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727bfff700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f727c15ebc0 0x7f727c06d090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:37562/0 (socket says 172.21.15.88:37562) 2023-08-10T10:33:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727bfff700 1 -- 172.21.15.88:0/507982924 learned_addr learned my addr 172.21.15.88:0/507982924 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727a7fc700 1 -- 172.21.15.88:0/507982924 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066452299 0 0) 0x7f727c06c2d0 con 0x7f727c15ebc0 2023-08-10T10:33:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727b7fe700 1 -- 172.21.15.88:0/507982924 >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 msgr2=0x7f727c0cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727b7fe700 1 --2- 172.21.15.88:0/507982924 >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 0x7f727c0cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727b7fe700 1 -- 172.21.15.88:0/507982924 >> v1:172.21.15.187:6789/0 conn(0x7f727c15ebc0 legacy=0x7f727c06d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727b7fe700 1 -- 172.21.15.88:0/507982924 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727c06cb70 con 0x7f727c0afd50 2023-08-10T10:33:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.248+0000 7f727affd700 1 --2- 172.21.15.88:0/507982924 >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 0x7f727c0cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:33:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f727b7fe700 1 --2- 172.21.15.88:0/507982924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 0x7f727c0b0130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f726c009840 tx=0x7f726c009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee07fe4f6575f7c7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f727a7fc700 1 -- 172.21.15.88:0/507982924 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c011830 con 0x7f727c0afd50 2023-08-10T10:33:09.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f727a7fc700 1 -- 172.21.15.88:0/507982924 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c011990 con 0x7f727c0afd50 2023-08-10T10:33:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f727a7fc700 1 -- 172.21.15.88:0/507982924 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c011d20 con 0x7f727c0afd50 2023-08-10T10:33:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 -- 172.21.15.88:0/507982924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 msgr2=0x7f727c0b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 --2- 172.21.15.88:0/507982924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 0x7f727c0b0130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f726c009840 tx=0x7f726c009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 -- 172.21.15.88:0/507982924 shutdown_connections 2023-08-10T10:33:09.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 --2- 172.21.15.88:0/507982924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c0afd50 0x7f727c0b0130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 --2- 172.21.15.88:0/507982924 >> v2:172.21.15.187:3300/0 conn(0x7f727c15e740 0x7f727c0cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 -- 172.21.15.88:0/507982924 >> 172.21.15.88:0/507982924 conn(0x7f727c06f200 msgr2=0x7f727c06f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 -- 172.21.15.88:0/507982924 shutdown_connections 2023-08-10T10:33:09.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.249+0000 7f7281bff700 1 -- 172.21.15.88:0/507982924 wait complete. 2023-08-10T10:33:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.251+0000 7f7281bff700 1 Processor -- start 2023-08-10T10:33:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.251+0000 7f7281bff700 1 -- start start 2023-08-10T10:33:09.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15e740 0x7f727c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c15ebc0 0x7f727c0c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0c8ad0 con 0x7f727c0afd50 2023-08-10T10:33:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0c7ee0 con 0x7f727c15ebc0 2023-08-10T10:33:09.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f7281bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727c0c8130 con 0x7f727c15e740 2023-08-10T10:33:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f727affd700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15e740 0x7f727c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f727b7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57886/0 (socket says 172.21.15.88:57886) 2023-08-10T10:33:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.252+0000 7f727b7fe700 1 -- 172.21.15.88:0/291469136 learned_addr learned my addr 172.21.15.88:0/291469136 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:09.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727bfff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c15ebc0 0x7f727c0c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 -- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15e740 msgr2=0x7f727c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15e740 0x7f727c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 -- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c15ebc0 msgr2=0x7f727c0c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c15ebc0 0x7f727c0c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 -- 172.21.15.88:0/291469136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72700094a0 con 0x7f727c0afd50 2023-08-10T10:33:09.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f727b7fe700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f726c009b90 tx=0x7f726c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0036a0 con 0x7f727c0afd50 2023-08-10T10:33:09.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c01e070 con 0x7f727c0afd50 2023-08-10T10:33:09.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c0094a0 con 0x7f727c0afd50 2023-08-10T10:33:09.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.253+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c003a60 con 0x7f727c0afd50 2023-08-10T10:33:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.254+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f727c0c86f0 con 0x7f727c0afd50 2023-08-10T10:33:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.255+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727c04ecc0 con 0x7f727c0afd50 2023-08-10T10:33:09.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.255+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f726c003bc0 con 0x7f727c0afd50 2023-08-10T10:33:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.256+0000 7f7263fff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 0x7f726806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.257+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f726c08a630 con 0x7f727c0afd50 2023-08-10T10:33:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.257+0000 7f727affd700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 0x7f726806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.257+0000 7f727affd700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 0x7f726806d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f727c1f5e50 tx=0x7f7270009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.261+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f726c0553a0 con 0x7f727c0afd50 2023-08-10T10:33:09.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.454+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f727c06bbe0 con 0x7f727c0afd50 2023-08-10T10:33:09.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.455+0000 7f7263fff700 1 -- 172.21.15.88:0/291469136 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f726c0589c0 con 0x7f727c0afd50 2023-08-10T10:33:09.456 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:09.457 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:33:09.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 msgr2=0x7f726806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 0x7f726806d1a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f727c1f5e50 tx=0x7f7270009210 comp rx=0 tx=0).stop 2023-08-10T10:33:09.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 msgr2=0x7f727c0b6170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f726c009b90 tx=0x7f726c004750 comp rx=0 tx=0).stop 2023-08-10T10:33:09.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 shutdown_connections 2023-08-10T10:33:09.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f727c15ebc0 0x7f727c0c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f727c0afd50 0x7f727c0b6170 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f726806ace0 0x7f726806d1a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 --2- 172.21.15.88:0/291469136 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f727c15e740 0x7f727c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 >> 172.21.15.88:0/291469136 conn(0x7f727c06f200 msgr2=0x7f727c1611e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:09.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 shutdown_connections 2023-08-10T10:33:09.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.458+0000 7f7281bff700 1 -- 172.21.15.88:0/291469136 wait complete. 2023-08-10T10:33:09.478 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:33:09.479 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:33:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.713+0000 7f7ff53ff700 1 Processor -- start 2023-08-10T10:33:09.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.713+0000 7f7ff53ff700 1 -- start start 2023-08-10T10:33:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7ff53ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7ff015d1e0 0x7f7ff00d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7ff53ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ff00d1060 0x7f7ff00b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7ff53ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff00b52a0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7ff53ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff015d5c0 con 0x7f7ff00d1060 2023-08-10T10:33:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7ff53ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff00d1840 con 0x7f7ff015d1e0 2023-08-10T10:33:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fef7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7ff00b4e90 0x7f7ff00b1940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58376/0 (socket says 172.21.15.88:58376) 2023-08-10T10:33:09.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fe7fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7ff00d1060 0x7f7ff00b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fef7fe700 1 -- 172.21.15.88:0/2588372663 learned_addr learned my addr 172.21.15.88:0/2588372663 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:09.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7feeffd700 1 --2- 172.21.15.88:0/2588372663 >> v2:172.21.15.187:3300/0 conn(0x7f7ff015d1e0 0x7f7ff00d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fe7fff700 1 -- 172.21.15.88:0/2588372663 >> v2:172.21.15.187:3300/0 conn(0x7f7ff015d1e0 msgr2=0x7f7ff00d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:09.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/2588372663 >> v2:172.21.15.187:3300/0 conn(0x7f7ff015d1e0 0x7f7ff00d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fe7fff700 1 -- 172.21.15.88:0/2588372663 >> v1:172.21.15.88:6789/0 conn(0x7f7ff00b4e90 legacy=0x7f7ff00b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fe7fff700 1 -- 172.21.15.88:0/2588372663 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff00d1b20 con 0x7f7ff00d1060 2023-08-10T10:33:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.715+0000 7f7fee7fc700 1 -- 172.21.15.88:0/2588372663 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176231801 0 0) 0x7f7ff00b52a0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/2588372663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00d1060 0x7f7ff00b4950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00b5ac0 tx=0x7f7fd8009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572dd7352861f5fd server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7fee7fc700 1 -- 172.21.15.88:0/2588372663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011830 con 0x7f7ff00d1060 2023-08-10T10:33:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7fee7fc700 1 -- 172.21.15.88:0/2588372663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fd8011990 con 0x7f7ff00d1060 2023-08-10T10:33:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7fee7fc700 1 -- 172.21.15.88:0/2588372663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fd8011d20 con 0x7f7ff00d1060 2023-08-10T10:33:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7ff53ff700 1 -- 172.21.15.88:0/2588372663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00d1060 msgr2=0x7f7ff00b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.716+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/2588372663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00d1060 0x7f7ff00b4950 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00b5ac0 tx=0x7f7fd8009b20 comp rx=0 tx=0).stop 2023-08-10T10:33:09.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 -- 172.21.15.88:0/2588372663 shutdown_connections 2023-08-10T10:33:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/2588372663 >> v2:172.21.15.187:3300/0 conn(0x7f7ff015d1e0 0x7f7ff00d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/2588372663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00d1060 0x7f7ff00b4950 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 -- 172.21.15.88:0/2588372663 >> 172.21.15.88:0/2588372663 conn(0x7f7ff00cf950 msgr2=0x7f7ff00cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 -- 172.21.15.88:0/2588372663 shutdown_connections 2023-08-10T10:33:09.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.717+0000 7f7ff53ff700 1 -- 172.21.15.88:0/2588372663 wait complete. 2023-08-10T10:33:09.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.719+0000 7f7ff53ff700 1 Processor -- start 2023-08-10T10:33:09.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.719+0000 7f7ff53ff700 1 -- start start 2023-08-10T10:33:09.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 0x7f7ff00cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ff015d1e0 0x7f7ff00cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff01560b0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff0155dd0 con 0x7f7ff015d1e0 2023-08-10T10:33:09.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.720+0000 7f7ff53ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff00c6b30 con 0x7f7ff00d1060 2023-08-10T10:33:09.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57898/0 (socket says 172.21.15.88:57898) 2023-08-10T10:33:09.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 -- 172.21.15.88:0/1546435603 learned_addr learned my addr 172.21.15.88:0/1546435603 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:09.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 0x7f7ff00cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7fef7fe700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ff015d1e0 0x7f7ff00cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 -- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 msgr2=0x7f7ff00cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 0x7f7ff00cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 -- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ff015d1e0 msgr2=0x7f7ff00cbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ff015d1e0 0x7f7ff00cbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 -- 172.21.15.88:0/1546435603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd80094a0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 0x7f7ff00cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:09.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.721+0000 7f7feeffd700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e9b0 tx=0x7f7fe000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.722+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0009710 con 0x7f7ff00b4e90 2023-08-10T10:33:09.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.722+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe000c850 con 0x7f7ff00b4e90 2023-08-10T10:33:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.722+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe000cbc0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.722+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff00c6e10 con 0x7f7ff00b4e90 2023-08-10T10:33:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.722+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff0149650 con 0x7f7ff00b4e90 2023-08-10T10:33:09.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.723+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff0149840 con 0x7f7ff00b4e90 2023-08-10T10:33:09.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.724+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7fe000cd20 con 0x7f7ff00b4e90 2023-08-10T10:33:09.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.725+0000 7f7fe77fe700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 0x7f7fd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:09.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.725+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7fe00898d0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.725+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 0x7f7fd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.725+0000 7f7fe7fff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 0x7f7fd006d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:09.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.729+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7fe00580d0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.926+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7ff00743a0 con 0x7f7ff00b4e90 2023-08-10T10:33:09.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.926+0000 7f7fe77fe700 1 -- 172.21.15.88:0/1546435603 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fe0057c60 con 0x7f7ff00b4e90 2023-08-10T10:33:09.927 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:33:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 msgr2=0x7f7fd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 0x7f7fd006d1a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7fd80090b0 tx=0x7f7fd8008030 comp rx=0 tx=0).stop 2023-08-10T10:33:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 msgr2=0x7f7ff0149110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:09.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e9b0 tx=0x7f7fe000ed70 comp rx=0 tx=0).stop 2023-08-10T10:33:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 shutdown_connections 2023-08-10T10:33:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ff015d1e0 0x7f7ff00cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7ff00b4e90 0x7f7ff0149110 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7fd006ace0 0x7f7fd006d1a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 --2- 172.21.15.88:0/1546435603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ff00d1060 0x7f7ff00cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 >> 172.21.15.88:0/1546435603 conn(0x7f7ff00cf950 msgr2=0x7f7ff015d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.928+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 shutdown_connections 2023-08-10T10:33:09.931 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:09.929+0000 7f7ff53ff700 1 -- 172.21.15.88:0/1546435603 wait complete. 2023-08-10T10:33:09.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:33:10.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.145+0000 7fc7637ff700 1 Processor -- start 2023-08-10T10:33:10.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.145+0000 7fc7637ff700 1 -- start start 2023-08-10T10:33:10.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc7637ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc75c156f70 0x7fc75c15a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc7637ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c15a820 con 0x7fc75c0cd560 2023-08-10T10:33:10.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc7637ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc75c0cdab0 con 0x7fc75c06b110 2023-08-10T10:33:10.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc7637ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc75c06d480 con 0x7fc75c156f70 2023-08-10T10:33:10.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc760d9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc75c0cd560 0x7fc75c06aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58388/0 (socket says 172.21.15.88:58388) 2023-08-10T10:33:10.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc760d9a700 1 -- 172.21.15.88:0/293749329 learned_addr learned my addr 172.21.15.88:0/293749329 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:10.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022140579 0 0) 0x7fc75c15a820 con 0x7fc75c0cd560 2023-08-10T10:33:10.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7480035b0 con 0x7fc75c0cd560 2023-08-10T10:33:10.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.147+0000 7fc76159b700 1 --2- 172.21.15.88:0/293749329 >> v2:172.21.15.187:3300/0 conn(0x7fc75c156f70 0x7fc75c15a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3180298117 0 0) 0x7fc7480035b0 con 0x7fc75c0cd560 2023-08-10T10:33:10.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 >> v2:172.21.15.187:3300/0 conn(0x7fc75c156f70 msgr2=0x7fc75c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:10.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 --2- 172.21.15.88:0/293749329 >> v2:172.21.15.187:3300/0 conn(0x7fc75c156f70 0x7fc75c15a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 >> v1:172.21.15.187:6789/0 conn(0x7fc75c06b110 legacy=0x7fc75c0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0cdd90 con 0x7fc75c0cd560 2023-08-10T10:33:10.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7fc74c001670 con 0x7fc75c0cd560 2023-08-10T10:33:10.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc76159b700 1 --2- 172.21.15.88:0/293749329 >> v2:172.21.15.187:3300/0 conn(0x7fc75c156f70 0x7fc75c15a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:10.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 >> v1:172.21.15.88:6789/0 conn(0x7fc75c0cd560 legacy=0x7fc75c06aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc748003a00 0x7fc748003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 0x7fc748004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748005210 0x7fc74800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800c130 con 0x7fc748004850 2023-08-10T10:33:10.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800c2a0 con 0x7fc748003a00 2023-08-10T10:33:10.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc74800c460 con 0x7fc748005210 2023-08-10T10:33:10.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 0x7fc748004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc76159b700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc748003a00 0x7fc748003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc761d9c700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748005210 0x7fc74800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 -- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748005210 msgr2=0x7fc74800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:10.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748005210 0x7fc74800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 -- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc748003a00 msgr2=0x7fc748003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc748003a00 0x7fc748003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc760d9a700 1 -- 172.21.15.88:0/293749329 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7480035b0 con 0x7fc748004850 2023-08-10T10:33:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.148+0000 7fc761d9c700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748005210 0x7fc74800ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc761d9c700 1 -- 172.21.15.88:0/293749329 reap_dead start 2023-08-10T10:33:10.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc760d9a700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 0x7fc748004cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c240 tx=0x7fc748005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6a2ad9949df2786 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c007c10 con 0x7fc748004850 2023-08-10T10:33:10.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc74c00ce00 con 0x7fc748004850 2023-08-10T10:33:10.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc753fff700 1 -- 172.21.15.88:0/293749329 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc74c005ba0 con 0x7fc748004850 2023-08-10T10:33:10.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc7637ff700 1 -- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 msgr2=0x7fc748004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.149+0000 7fc7637ff700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 0x7fc748004cd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc74c00c240 tx=0x7fc748005880 comp rx=0 tx=0).stop 2023-08-10T10:33:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.150+0000 7fc7637ff700 1 -- 172.21.15.88:0/293749329 shutdown_connections 2023-08-10T10:33:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.150+0000 7fc7637ff700 1 --2- 172.21.15.88:0/293749329 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc748004850 0x7fc748004cd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.150+0000 7fc7637ff700 1 -- 172.21.15.88:0/293749329 >> 172.21.15.88:0/293749329 conn(0x7fc75c0cb570 msgr2=0x7fc75c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:10.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.150+0000 7fc7637ff700 1 -- 172.21.15.88:0/293749329 shutdown_connections 2023-08-10T10:33:10.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.150+0000 7fc7637ff700 1 -- 172.21.15.88:0/293749329 wait complete. 2023-08-10T10:33:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.151+0000 7fc7637ff700 1 Processor -- start 2023-08-10T10:33:10.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.152+0000 7fc7637ff700 1 -- start start 2023-08-10T10:33:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.152+0000 7fc7637ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748004850 0x7fc75c151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.152+0000 7fc7637ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc75c0af6d0 0x7fc75c0ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc7637ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc7637ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0af240 con 0x7fc75c0ad580 2023-08-10T10:33:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc7637ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c1518c0 con 0x7fc75c0af6d0 2023-08-10T10:33:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc7637ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc75c0ae630 con 0x7fc748004850 2023-08-10T10:33:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc76159b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748004850 0x7fc75c151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57922/0 (socket says 172.21.15.88:57922) 2023-08-10T10:33:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 -- 172.21.15.88:0/1252352160 learned_addr learned my addr 172.21.15.88:0/1252352160 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc760d9a700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc75c0af6d0 0x7fc75c0ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 -- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748004850 msgr2=0x7fc75c151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748004850 0x7fc75c151380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 -- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc75c0af6d0 msgr2=0x7fc75c0ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc75c0af6d0 0x7fc75c0ad040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 -- 172.21.15.88:0/1252352160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc75c0ae910 con 0x7fc75c0ad580 2023-08-10T10:33:10.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.153+0000 7fc761d9c700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ccff0 tx=0x7fc75400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.154+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75400eee0 con 0x7fc75c0ad580 2023-08-10T10:33:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.154+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc754003c10 con 0x7fc75c0ad580 2023-08-10T10:33:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.154+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0aebf0 con 0x7fc75c0ad580 2023-08-10T10:33:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.154+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7540050d0 con 0x7fc75c0ad580 2023-08-10T10:33:10.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.154+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc75c06de80 con 0x7fc75c0ad580 2023-08-10T10:33:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.155+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc75c0743a0 con 0x7fc75c0ad580 2023-08-10T10:33:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.156+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc754005230 con 0x7fc75c0ad580 2023-08-10T10:33:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.157+0000 7fc751ffb700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.157+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc754089660 con 0x7fc75c0ad580 2023-08-10T10:33:10.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.157+0000 7fc76159b700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.158+0000 7fc76159b700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 0x7fc74006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc758009b00 tx=0x7fc758008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.168 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.161+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fc7540543e0 con 0x7fc75c0ad580 2023-08-10T10:33:10.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.354+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc75c0af380 con 0x7fc75c0ad580 2023-08-10T10:33:10.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.354+0000 7fc751ffb700 1 -- 172.21.15.88:0/1252352160 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc754057a00 con 0x7fc75c0ad580 2023-08-10T10:33:10.355 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:33:10.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 msgr2=0x7fc74006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 0x7fc74006d1a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc758009b00 tx=0x7fc758008040 comp rx=0 tx=0).stop 2023-08-10T10:33:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 msgr2=0x7fc75c15ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0ccff0 tx=0x7fc75400ed50 comp rx=0 tx=0).stop 2023-08-10T10:33:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 shutdown_connections 2023-08-10T10:33:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc75c0ad580 0x7fc75c15ce60 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc74006ace0 0x7fc74006d1a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc748004850 0x7fc75c151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 --2- 172.21.15.88:0/1252352160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc75c0af6d0 0x7fc75c0ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 >> 172.21.15.88:0/1252352160 conn(0x7fc75c0cb570 msgr2=0x7fc75c152560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 shutdown_connections 2023-08-10T10:33:10.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.357+0000 7fc7637ff700 1 -- 172.21.15.88:0/1252352160 wait complete. 2023-08-10T10:33:10.376 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:33:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.577+0000 7f200f3ff700 1 Processor -- start 2023-08-10T10:33:10.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.578+0000 7f200f3ff700 1 -- start start 2023-08-10T10:33:10.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200f3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 0x7f20080c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200f3ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f200806dca0 0x7f20080c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200f3ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20080c43a0 con 0x7f20080cc6c0 2023-08-10T10:33:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200f3ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20080c4960 con 0x7f200806dca0 2023-08-10T10:33:10.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200f3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200806e8c0 con 0x7f2008143810 2023-08-10T10:33:10.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200d99c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f200806dca0 0x7f20080c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200d99c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f200806dca0 0x7f20080c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57938/0 (socket says 172.21.15.88:57938) 2023-08-10T10:33:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200d99c700 1 -- 172.21.15.88:0/2158400191 learned_addr learned my addr 172.21.15.88:0/2158400191 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200d99c700 1 -- 172.21.15.88:0/2158400191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 msgr2=0x7f20080c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.579+0000 7f200d19b700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 0x7f20080c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f200d99c700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 0x7f20080c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f200d99c700 1 -- 172.21.15.88:0/2158400191 >> v1:172.21.15.187:6789/0 conn(0x7f20080cc6c0 legacy=0x7f20080cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f200d99c700 1 -- 172.21.15.88:0/2158400191 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200806eba0 con 0x7f200806dca0 2023-08-10T10:33:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f200d19b700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 0x7f20080c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:10.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f200d99c700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200806dca0 0x7f20080c9140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f200000d150 tx=0x7f200000d460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23a88d428f028499 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f1ffffff700 1 -- 172.21.15.88:0/2158400191 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2000010070 con 0x7f200806dca0 2023-08-10T10:33:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f1ffffff700 1 -- 172.21.15.88:0/2158400191 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200000dd80 con 0x7f200806dca0 2023-08-10T10:33:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.580+0000 7f1ffffff700 1 -- 172.21.15.88:0/2158400191 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200000b310 con 0x7f200806dca0 2023-08-10T10:33:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 -- 172.21.15.88:0/2158400191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200806dca0 msgr2=0x7f20080c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200806dca0 0x7f20080c9140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f200000d150 tx=0x7f200000d460 comp rx=0 tx=0).stop 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 -- 172.21.15.88:0/2158400191 shutdown_connections 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f200806dca0 0x7f20080c9140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2158400191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2008143810 0x7f20080c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 -- 172.21.15.88:0/2158400191 >> 172.21.15.88:0/2158400191 conn(0x7f20080cb570 msgr2=0x7f20080cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 -- 172.21.15.88:0/2158400191 shutdown_connections 2023-08-10T10:33:10.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.581+0000 7f200f3ff700 1 -- 172.21.15.88:0/2158400191 wait complete. 2023-08-10T10:33:10.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.582+0000 7f200f3ff700 1 Processor -- start 2023-08-10T10:33:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.583+0000 7f200f3ff700 1 -- start start 2023-08-10T10:33:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 0x7f20080c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2008143810 0x7f2008159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c8880 con 0x7f20080cc6c0 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20080b2250 con 0x7f2008143810 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200f3ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20080c85c0 con 0x7f200806dca0 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57950/0 (socket says 172.21.15.88:57950) 2023-08-10T10:33:10.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 -- 172.21.15.88:0/2508049916 learned_addr learned my addr 172.21.15.88:0/2508049916 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:10.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200d19b700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 0x7f20080c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200d99c700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2008143810 0x7f2008159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 -- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 msgr2=0x7f20080c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 0x7f20080c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 -- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2008143810 msgr2=0x7f2008159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2008143810 0x7f2008159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 -- 172.21.15.88:0/2508049916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200000bd40 con 0x7f20080cc6c0 2023-08-10T10:33:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200d19b700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 0x7f20080c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.584+0000 7f200c99a700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800b450 tx=0x7f1ff800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.585+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8011830 con 0x7f20080cc6c0 2023-08-10T10:33:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.585+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff8011990 con 0x7f20080cc6c0 2023-08-10T10:33:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.585+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20080b1920 con 0x7f20080cc6c0 2023-08-10T10:33:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.585+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff8011d40 con 0x7f20080cc6c0 2023-08-10T10:33:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.585+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20080b1ee0 con 0x7f20080cc6c0 2023-08-10T10:33:10.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.586+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20080b23c0 con 0x7f20080cc6c0 2023-08-10T10:33:10.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.587+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1ff801a400 con 0x7f20080cc6c0 2023-08-10T10:33:10.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.588+0000 7f1ffdffb700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 0x7f1fec06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:10.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.588+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f1ff80894a0 con 0x7f20080cc6c0 2023-08-10T10:33:10.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.588+0000 7f200d19b700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 0x7f1fec06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:10.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.589+0000 7f200d19b700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 0x7f1fec06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2004006fd0 tx=0x7f2004008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:10.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.592+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1ff8054210 con 0x7f20080cc6c0 2023-08-10T10:33:10.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.789+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20080743a0 con 0x7f20080cc6c0 2023-08-10T10:33:10.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.789+0000 7f1ffdffb700 1 -- 172.21.15.88:0/2508049916 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ff8057830 con 0x7f20080cc6c0 2023-08-10T10:33:10.791 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:10.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 msgr2=0x7f1fec06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 0x7f1fec06d1a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2004006fd0 tx=0x7f2004008040 comp rx=0 tx=0).stop 2023-08-10T10:33:10.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 msgr2=0x7f20080c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:10.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1ff800b450 tx=0x7f1ff800b810 comp rx=0 tx=0).stop 2023-08-10T10:33:10.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 shutdown_connections 2023-08-10T10:33:10.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2008143810 0x7f2008159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f1fec06ace0 0x7f1fec06d1a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f200806dca0 0x7f20080c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 --2- 172.21.15.88:0/2508049916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f20080cc6c0 0x7f20080c8080 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:10.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.791+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 >> 172.21.15.88:0/2508049916 conn(0x7f20080cb570 msgr2=0x7f20080cb950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:10.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.792+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 shutdown_connections 2023-08-10T10:33:10.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:10.792+0000 7f200f3ff700 1 -- 172.21.15.88:0/2508049916 wait complete. 2023-08-10T10:33:10.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:33:11.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.010+0000 7f87ed1ff700 1 Processor -- start 2023-08-10T10:33:11.011 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.011+0000 7f87ed1ff700 1 -- start start 2023-08-10T10:33:11.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87ed1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87e80d27a0 0x7f87e80b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87ed1ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80b52e0 con 0x7f87e815d1e0 2023-08-10T10:33:11.013 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87ed1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87e80d1840 con 0x7f87e80b4e90 2023-08-10T10:33:11.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87ed1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87e80d2c50 con 0x7f87e80d27a0 2023-08-10T10:33:11.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87e6d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f87e815d1e0 0x7f87e80d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58392/0 (socket says 172.21.15.88:58392) 2023-08-10T10:33:11.014 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87e6d9d700 1 -- 172.21.15.88:0/3172954442 learned_addr learned my addr 172.21.15.88:0/3172954442 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:11.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 700758370 0 0) 0x7f87d8001110 con 0x7f87e815d1e0 2023-08-10T10:33:11.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.012+0000 7f87e659c700 1 --2- 172.21.15.88:0/3172954442 >> v2:172.21.15.187:3300/0 conn(0x7f87e80d27a0 0x7f87e80b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87d00035b0 con 0x7f87e815d1e0 2023-08-10T10:33:11.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1492346066 0 0) 0x7f87d00035b0 con 0x7f87e815d1e0 2023-08-10T10:33:11.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 >> v2:172.21.15.187:3300/0 conn(0x7f87e80d27a0 msgr2=0x7f87e80b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:11.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 --2- 172.21.15.88:0/3172954442 >> v2:172.21.15.187:3300/0 conn(0x7f87e80d27a0 0x7f87e80b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 >> v1:172.21.15.187:6789/0 conn(0x7f87e80b4e90 legacy=0x7f87e80b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80d1b20 con 0x7f87e815d1e0 2023-08-10T10:33:11.018 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f87d8001800 con 0x7f87e815d1e0 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e659c700 1 --2- 172.21.15.88:0/3172954442 >> v2:172.21.15.187:3300/0 conn(0x7f87e80d27a0 0x7f87e80b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 >> v1:172.21.15.88:6789/0 conn(0x7f87e815d1e0 legacy=0x7f87e80d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0003a00 0x7f87d0003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87d0004850 0x7f87d0004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 0x7f87d000ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80d2c50 con 0x7f87d0005210 2023-08-10T10:33:11.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d000c140 con 0x7f87d0003a00 2023-08-10T10:33:11.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d000c300 con 0x7f87d0004850 2023-08-10T10:33:11.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e759e700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 0x7f87d000ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e6d9d700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0003a00 0x7f87d0003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.013+0000 7f87e659c700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87d0004850 0x7f87d0004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 -- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87d0004850 msgr2=0x7f87d0004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:11.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87d0004850 0x7f87d0004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 -- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0003a00 msgr2=0x7f87d0003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:11.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0003a00 0x7f87d0003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 -- 172.21.15.88:0/3172954442 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d00035b0 con 0x7f87d0005210 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e659c700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87d0004850 0x7f87d0004cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 -- 172.21.15.88:0/3172954442 reap_dead start 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e759e700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 0x7f87d000ba10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c240 tx=0x7f87d0005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c271bc7ce857896d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0001df0 con 0x7f87d0005210 2023-08-10T10:33:11.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e000cdc0 con 0x7f87d0005210 2023-08-10T10:33:11.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.014+0000 7f87e5d9b700 1 -- 172.21.15.88:0/3172954442 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0003c40 con 0x7f87d0005210 2023-08-10T10:33:11.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 -- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 msgr2=0x7f87d000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 0x7f87d000ba10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c240 tx=0x7f87d0005880 comp rx=0 tx=0).stop 2023-08-10T10:33:11.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 -- 172.21.15.88:0/3172954442 shutdown_connections 2023-08-10T10:33:11.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/3172954442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87d0005210 0x7f87d000ba10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 -- 172.21.15.88:0/3172954442 >> 172.21.15.88:0/3172954442 conn(0x7f87e80cf950 msgr2=0x7f87e80cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:11.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 -- 172.21.15.88:0/3172954442 shutdown_connections 2023-08-10T10:33:11.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.015+0000 7f87ed1ff700 1 -- 172.21.15.88:0/3172954442 wait complete. 2023-08-10T10:33:11.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.017+0000 7f87ed1ff700 1 Processor -- start 2023-08-10T10:33:11.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.017+0000 7f87ed1ff700 1 -- start start 2023-08-10T10:33:11.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 0x7f87e81e7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87e80c9550 0x7f87e814ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80c69e0 con 0x7f87e814b390 2023-08-10T10:33:11.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e80c7800 con 0x7f87d0005210 2023-08-10T10:33:11.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87ed1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e815b2b0 con 0x7f87e80c9550 2023-08-10T10:33:11.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57970/0 (socket says 172.21.15.88:57970) 2023-08-10T10:33:11.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 -- 172.21.15.88:0/4083480210 learned_addr learned my addr 172.21.15.88:0/4083480210 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:11.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 -- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87e80c9550 msgr2=0x7f87e814ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87e80c9550 0x7f87e814ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 -- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 msgr2=0x7f87e81e7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e6d9d700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 0x7f87e81e7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 0x7f87e81e7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e759e700 1 -- 172.21.15.88:0/4083480210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e80c6bf0 con 0x7f87e814b390 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.018+0000 7f87e6d9d700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 0x7f87e81e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87e759e700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cf6c0 tx=0x7f87e00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0001250 con 0x7f87e814b390 2023-08-10T10:33:11.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e00052e0 con 0x7f87e814b390 2023-08-10T10:33:11.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e80c6ed0 con 0x7f87e814b390 2023-08-10T10:33:11.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0005670 con 0x7f87e814b390 2023-08-10T10:33:11.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.019+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e80c7490 con 0x7f87e814b390 2023-08-10T10:33:11.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.020+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e80c7990 con 0x7f87e814b390 2023-08-10T10:33:11.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.021+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f87e0026460 con 0x7f87e814b390 2023-08-10T10:33:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.022+0000 7f87cf7fe700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 0x7f87d406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.022+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f87e008a760 con 0x7f87e814b390 2023-08-10T10:33:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.022+0000 7f87e6d9d700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 0x7f87d406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.023+0000 7f87e6d9d700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 0x7f87d406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001050 tx=0x7f87d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.026+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f87e00554d0 con 0x7f87e814b390 2023-08-10T10:33:11.225 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.225+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f87e80743a0 con 0x7f87e814b390 2023-08-10T10:33:11.226 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.225+0000 7f87cf7fe700 1 -- 172.21.15.88:0/4083480210 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87e0058af0 con 0x7f87e814b390 2023-08-10T10:33:11.226 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:33:11.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 msgr2=0x7f87d406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.228 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 0x7f87d406d1a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f87d8001050 tx=0x7f87d8009040 comp rx=0 tx=0).stop 2023-08-10T10:33:11.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 msgr2=0x7f87e80c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f87e80cf6c0 tx=0x7f87e00014a0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 shutdown_connections 2023-08-10T10:33:11.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f87e814b390 0x7f87e80c7c90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87d0005210 0x7f87e81e7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f87d406ace0 0x7f87d406d1a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 --2- 172.21.15.88:0/4083480210 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87e80c9550 0x7f87e814ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 >> 172.21.15.88:0/4083480210 conn(0x7f87e80cf950 msgr2=0x7f87e815e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:11.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 shutdown_connections 2023-08-10T10:33:11.230 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.228+0000 7f87ed1ff700 1 -- 172.21.15.88:0/4083480210 wait complete. 2023-08-10T10:33:11.246 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:33:11.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.444+0000 7f54607ff700 1 Processor -- start 2023-08-10T10:33:11.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.444+0000 7f54607ff700 1 -- start start 2023-08-10T10:33:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.445+0000 7f54607ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580d27a0 0x7f54580b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.445+0000 7f54607ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54580b4e90 0x7f54580b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.445+0000 7f54607ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54580d1840 con 0x7f545815d1e0 2023-08-10T10:33:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.445+0000 7f54607ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54580b5320 con 0x7f54580b4e90 2023-08-10T10:33:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.445+0000 7f54607ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54580d2c20 con 0x7f54580d27a0 2023-08-10T10:33:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f54580b4e90 0x7f54580b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545e59b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f545815d1e0 0x7f54580d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:58404/0 (socket says 172.21.15.88:58404) 2023-08-10T10:33:11.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545e59b700 1 -- 172.21.15.88:0/1596542583 learned_addr learned my addr 172.21.15.88:0/1596542583 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:11.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545dd9a700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580d27a0 0x7f54580b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 -- 172.21.15.88:0/1596542583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580d27a0 msgr2=0x7f54580b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580d27a0 0x7f54580b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 -- 172.21.15.88:0/1596542583 >> v1:172.21.15.88:6789/0 conn(0x7f545815d1e0 legacy=0x7f54580d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 -- 172.21.15.88:0/1596542583 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54580d1b20 con 0x7f54580b4e90 2023-08-10T10:33:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545d599700 1 -- 172.21.15.88:0/1596542583 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2686936818 0 0) 0x7f54580d1840 con 0x7f545815d1e0 2023-08-10T10:33:11.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.446+0000 7f545ed9c700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580b4e90 0x7f54580b1940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5450009d90 tx=0x7f545000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669e26a1977d80b0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f545d599700 1 -- 172.21.15.88:0/1596542583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545000e070 con 0x7f54580b4e90 2023-08-10T10:33:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f545d599700 1 -- 172.21.15.88:0/1596542583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545000bb20 con 0x7f54580b4e90 2023-08-10T10:33:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f545d599700 1 -- 172.21.15.88:0/1596542583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5450012430 con 0x7f54580b4e90 2023-08-10T10:33:11.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 -- 172.21.15.88:0/1596542583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580b4e90 msgr2=0x7f54580b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580b4e90 0x7f54580b1940 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5450009d90 tx=0x7f545000b330 comp rx=0 tx=0).stop 2023-08-10T10:33:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 -- 172.21.15.88:0/1596542583 shutdown_connections 2023-08-10T10:33:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580b4e90 0x7f54580b1940 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 --2- 172.21.15.88:0/1596542583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580d27a0 0x7f54580b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 -- 172.21.15.88:0/1596542583 >> 172.21.15.88:0/1596542583 conn(0x7f54580cf950 msgr2=0x7f54580cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 -- 172.21.15.88:0/1596542583 shutdown_connections 2023-08-10T10:33:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.447+0000 7f54607ff700 1 -- 172.21.15.88:0/1596542583 wait complete. 2023-08-10T10:33:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.449+0000 7f54607ff700 1 Processor -- start 2023-08-10T10:33:11.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.449+0000 7f54607ff700 1 -- start start 2023-08-10T10:33:11.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580b4e90 0x7f54580ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f545815d1e0 0x7f5458157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580cc340 con 0x7f54580d27a0 2023-08-10T10:33:11.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54580caef0 con 0x7f545815d1e0 2023-08-10T10:33:11.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f54607ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5458159c20 con 0x7f54580b4e90 2023-08-10T10:33:11.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.450+0000 7f545dd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:57994/0 (socket says 172.21.15.88:57994) 2023-08-10T10:33:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 -- 172.21.15.88:0/2823071137 learned_addr learned my addr 172.21.15.88:0/2823071137 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:11.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545e59b700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580b4e90 0x7f54580ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545ed9c700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f545815d1e0 0x7f5458157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 -- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580b4e90 msgr2=0x7f54580ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580b4e90 0x7f54580ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 -- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f545815d1e0 msgr2=0x7f5458157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f545815d1e0 0x7f5458157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 -- 172.21.15.88:0/2823071137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5450009a70 con 0x7f54580d27a0 2023-08-10T10:33:11.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f545dd9a700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f544800e9e0 tx=0x7f544800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5448009710 con 0x7f54580d27a0 2023-08-10T10:33:11.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544800c850 con 0x7f54580d27a0 2023-08-10T10:33:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544800cbc0 con 0x7f54580d27a0 2023-08-10T10:33:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.451+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54580cb730 con 0x7f54580d27a0 2023-08-10T10:33:11.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.452+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54580cbcf0 con 0x7f54580d27a0 2023-08-10T10:33:11.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.452+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54580cc4f0 con 0x7f54580d27a0 2023-08-10T10:33:11.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.454+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f544800cd20 con 0x7f54580d27a0 2023-08-10T10:33:11.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.455+0000 7f544effd700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 0x7f543c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.455+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f54480898c0 con 0x7f54580d27a0 2023-08-10T10:33:11.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.455+0000 7f545e59b700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 0x7f543c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.456+0000 7f545e59b700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 0x7f543c06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5454000f60 tx=0x7f5454007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.460+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f54580cc4f0 con 0x7f54580d27a0 2023-08-10T10:33:11.658 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.658+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f54580cc4f0 con 0x7f54580d27a0 2023-08-10T10:33:11.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.658+0000 7f544effd700 1 -- 172.21.15.88:0/2823071137 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f54580cc4f0 con 0x7f54580d27a0 2023-08-10T10:33:11.660 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:11.661 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 msgr2=0x7f543c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 0x7f543c06d1a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5454000f60 tx=0x7f5454007c90 comp rx=0 tx=0).stop 2023-08-10T10:33:11.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 msgr2=0x7f54580cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f544800e9e0 tx=0x7f544800eda0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.662 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 shutdown_connections 2023-08-10T10:33:11.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f545815d1e0 0x7f5458157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f543c06ace0 0x7f543c06d1a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54580b4e90 0x7f54580ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 --2- 172.21.15.88:0/2823071137 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f54580d27a0 0x7f54580cc7d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.663 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 >> 172.21.15.88:0/2823071137 conn(0x7f54580cf950 msgr2=0x7f54580b7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:11.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 shutdown_connections 2023-08-10T10:33:11.664 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.661+0000 7f54607ff700 1 -- 172.21.15.88:0/2823071137 wait complete. 2023-08-10T10:33:11.680 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:33:11.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.877+0000 7febfb9ff700 1 Processor -- start 2023-08-10T10:33:11.878 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.877+0000 7febfb9ff700 1 -- start start 2023-08-10T10:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.878+0000 7febfb9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febf415cf20 0x7febf415e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.878+0000 7febfb9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 0x7febf40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.878+0000 7febfb9ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febf40b5480 con 0x7febf40b5040 2023-08-10T10:33:11.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.878+0000 7febfb9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febf40cde30 con 0x7febf415cf20 2023-08-10T10:33:11.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.878+0000 7febfb9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf415e590 con 0x7febf40b8870 2023-08-10T10:33:11.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf979b700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7febf415cf20 0x7febf415e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf8f9a700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 0x7febf40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf9f9c700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7febf40b5040 0x7febf406a170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:37600/0 (socket says 172.21.15.88:37600) 2023-08-10T10:33:11.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf9f9c700 1 -- 172.21.15.88:0/1358148547 learned_addr learned my addr 172.21.15.88:0/1358148547 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:11.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febebfff700 1 -- 172.21.15.88:0/1358148547 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884635181 0 0) 0x7febf40b5480 con 0x7febf40b5040 2023-08-10T10:33:11.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febebfff700 1 -- 172.21.15.88:0/1358148547 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe00035b0 con 0x7febf40b5040 2023-08-10T10:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf8f9a700 1 -- 172.21.15.88:0/1358148547 >> v2:172.21.15.187:3300/0 conn(0x7febf415cf20 msgr2=0x7febf415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1358148547 >> v2:172.21.15.187:3300/0 conn(0x7febf415cf20 0x7febf415e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf8f9a700 1 -- 172.21.15.88:0/1358148547 >> v1:172.21.15.187:6789/0 conn(0x7febf40b5040 legacy=0x7febf406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.879+0000 7febf8f9a700 1 -- 172.21.15.88:0/1358148547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40b8e30 con 0x7febf40b8870 2023-08-10T10:33:11.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1358148547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 0x7febf40b4b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febe4009840 tx=0x7febe4009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cb48e60b1107fa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febebfff700 1 -- 172.21.15.88:0/1358148547 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4011830 con 0x7febf40b8870 2023-08-10T10:33:11.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febebfff700 1 -- 172.21.15.88:0/1358148547 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe4011990 con 0x7febf40b8870 2023-08-10T10:33:11.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febebfff700 1 -- 172.21.15.88:0/1358148547 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4011d20 con 0x7febf40b8870 2023-08-10T10:33:11.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febfb9ff700 1 -- 172.21.15.88:0/1358148547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 msgr2=0x7febf40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.880+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1358148547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 0x7febf40b4b00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7febe4009840 tx=0x7febe4009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:11.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 -- 172.21.15.88:0/1358148547 shutdown_connections 2023-08-10T10:33:11.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1358148547 >> v2:172.21.15.187:3300/0 conn(0x7febf415cf20 0x7febf415e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1358148547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf40b8870 0x7febf40b4b00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 -- 172.21.15.88:0/1358148547 >> 172.21.15.88:0/1358148547 conn(0x7febf40d3080 msgr2=0x7febf40d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:11.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 -- 172.21.15.88:0/1358148547 shutdown_connections 2023-08-10T10:33:11.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.881+0000 7febfb9ff700 1 -- 172.21.15.88:0/1358148547 wait complete. 2023-08-10T10:33:11.888 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.882+0000 7febfb9ff700 1 Processor -- start 2023-08-10T10:33:11.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 -- start start 2023-08-10T10:33:11.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 0x7febf40b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.889 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 0x7febf40b4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf41595a0 con 0x7febf40b5040 2023-08-10T10:33:11.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febf40c8d90 con 0x7febf40b8870 2023-08-10T10:33:11.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.883+0000 7febfb9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febf4159790 con 0x7febf415cf20 2023-08-10T10:33:11.890 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:58006/0 (socket says 172.21.15.88:58006) 2023-08-10T10:33:11.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 -- 172.21.15.88:0/1956399053 learned_addr learned my addr 172.21.15.88:0/1956399053 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:11.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf9f9c700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 0x7febf40b4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 0x7febf40b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.891 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 -- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 msgr2=0x7febf40b4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 0x7febf40b4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 -- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 msgr2=0x7febf40b3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 0x7febf40b3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:11.892 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 -- 172.21.15.88:0/1956399053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40094a0 con 0x7febf40b5040 2023-08-10T10:33:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 0x7febf40b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf9f9c700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 0x7febf40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.884+0000 7febf979b700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7febf000e9b0 tx=0x7febf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.885+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0009710 con 0x7febf40b5040 2023-08-10T10:33:11.893 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.885+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf4159a70 con 0x7febf40b5040 2023-08-10T10:33:11.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.885+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000c850 con 0x7febf40b5040 2023-08-10T10:33:11.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.885+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf000cbc0 con 0x7febf40b5040 2023-08-10T10:33:11.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.885+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febf415a030 con 0x7febf40b5040 2023-08-10T10:33:11.894 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.886+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febf404ecc0 con 0x7febf40b5040 2023-08-10T10:33:11.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.887+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7febf000cd20 con 0x7febf40b5040 2023-08-10T10:33:11.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.887+0000 7febe9ffb700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 0x7febd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:11.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.887+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7febf0089960 con 0x7febf40b5040 2023-08-10T10:33:11.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.888+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 0x7febd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:11.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.888+0000 7febf8f9a700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 0x7febd806d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febf40d26f0 tx=0x7febe4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:11.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:11.891+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7febf00580d0 con 0x7febf40b5040 2023-08-10T10:33:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.101+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7febf40d3740 con 0x7febf40b5040 2023-08-10T10:33:12.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.102+0000 7febe9ffb700 1 -- 172.21.15.88:0/1956399053 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7febf0057c60 con 0x7febf40b5040 2023-08-10T10:33:12.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 msgr2=0x7febd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:12.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 0x7febd806d1a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7febf40d26f0 tx=0x7febe4008030 comp rx=0 tx=0).stop 2023-08-10T10:33:12.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 msgr2=0x7febf4159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:12.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7febf000e9b0 tx=0x7febf000ed70 comp rx=0 tx=0).stop 2023-08-10T10:33:12.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 shutdown_connections 2023-08-10T10:33:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7febd806ace0 0x7febd806d1a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febf415cf20 0x7febf40b4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febf40b5040 0x7febf4159060 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 --2- 172.21.15.88:0/1956399053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febf40b8870 0x7febf40b3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:12.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 >> 172.21.15.88:0/1956399053 conn(0x7febf40d3080 msgr2=0x7febf415b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:12.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 shutdown_connections 2023-08-10T10:33:12.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:12.104+0000 7febfb9ff700 1 -- 172.21.15.88:0/1956399053 wait complete. 2023-08-10T10:33:12.107 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:33:12.123 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-08-10T10:33:12.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:12.124 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.2 2023-08-10T10:33:12.605 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:33:12.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:12.605 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-10T10:33:12.692 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:33:12.693 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:12.739 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:33:12.740 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:12.825 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:33:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.019+0000 7f5759dff700 1 Processor -- start 2023-08-10T10:33:13.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.019+0000 7f5759dff700 1 -- start start 2023-08-10T10:33:13.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f5759dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57540b5210 0x7f5754167c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f5759dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540b8e30 con 0x7f575415cf20 2023-08-10T10:33:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f5759dff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540ce010 con 0x7f57540b8870 2023-08-10T10:33:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f5759dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57540cde30 con 0x7f57540b5210 2023-08-10T10:33:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f57537fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f575415cf20 0x7f575415e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:42998/0 (socket says 172.21.15.88:42998) 2023-08-10T10:33:13.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f57537fe700 1 -- 172.21.15.88:0/1379074392 learned_addr learned my addr 172.21.15.88:0/1379074392 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:13.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f5753fff700 1 --2- 172.21.15.88:0/1379074392 >> v2:172.21.15.187:3300/0 conn(0x7f57540b5210 0x7f5754167c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f57527fc700 1 -- 172.21.15.88:0/1379074392 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814411568 0 0) 0x7f57540b8e30 con 0x7f575415cf20 2023-08-10T10:33:13.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.021+0000 7f57527fc700 1 -- 172.21.15.88:0/1379074392 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f573c0035b0 con 0x7f575415cf20 2023-08-10T10:33:13.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f5753fff700 1 -- 172.21.15.88:0/1379074392 >> v1:172.21.15.187:6789/0 conn(0x7f57540b8870 legacy=0x7f57540b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f5753fff700 1 -- 172.21.15.88:0/1379074392 >> v1:172.21.15.88:6789/0 conn(0x7f575415cf20 legacy=0x7f575415e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f5753fff700 1 -- 172.21.15.88:0/1379074392 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540ce2f0 con 0x7f57540b5210 2023-08-10T10:33:13.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f5753fff700 1 --2- 172.21.15.88:0/1379074392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b5210 0x7f5754167c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f574c009d90 tx=0x7f574c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=885fe9b98055d38d server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f57527fc700 1 -- 172.21.15.88:0/1379074392 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c00e070 con 0x7f57540b5210 2023-08-10T10:33:13.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f57527fc700 1 -- 172.21.15.88:0/1379074392 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c00bb20 con 0x7f57540b5210 2023-08-10T10:33:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.022+0000 7f57527fc700 1 -- 172.21.15.88:0/1379074392 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c012430 con 0x7f57540b5210 2023-08-10T10:33:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 -- 172.21.15.88:0/1379074392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b5210 msgr2=0x7f5754167c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 --2- 172.21.15.88:0/1379074392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b5210 0x7f5754167c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f574c009d90 tx=0x7f574c00b330 comp rx=0 tx=0).stop 2023-08-10T10:33:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 -- 172.21.15.88:0/1379074392 shutdown_connections 2023-08-10T10:33:13.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 --2- 172.21.15.88:0/1379074392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b5210 0x7f5754167c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 -- 172.21.15.88:0/1379074392 >> 172.21.15.88:0/1379074392 conn(0x7f57540d3080 msgr2=0x7f57540d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 -- 172.21.15.88:0/1379074392 shutdown_connections 2023-08-10T10:33:13.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.023+0000 7f5759dff700 1 -- 172.21.15.88:0/1379074392 wait complete. 2023-08-10T10:33:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.024+0000 7f5759dff700 1 Processor -- start 2023-08-10T10:33:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.025+0000 7f5759dff700 1 -- start start 2023-08-10T10:33:13.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57540b5210 0x7f57541f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b8870 0x7f5754156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57541f28d0 con 0x7f575415cf20 2023-08-10T10:33:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57541f2ae0 con 0x7f57540b8870 2023-08-10T10:33:13.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5759dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57541f2dc0 con 0x7f57540b5210 2023-08-10T10:33:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40042/0 (socket says 172.21.15.88:40042) 2023-08-10T10:33:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 -- 172.21.15.88:0/2214621691 learned_addr learned my addr 172.21.15.88:0/2214621691 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5752ffd700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b8870 0x7f5754156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f57537fe700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57540b5210 0x7f57541f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 -- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57540b5210 msgr2=0x7f57541f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57540b5210 0x7f57541f5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 -- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b8870 msgr2=0x7f5754156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b8870 0x7f5754156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.026+0000 7f5753fff700 1 -- 172.21.15.88:0/2214621691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009a70 con 0x7f575415cf20 2023-08-10T10:33:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f5753fff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f574c013000 tx=0x7f574c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c012430 con 0x7f575415cf20 2023-08-10T10:33:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c020070 con 0x7f575415cf20 2023-08-10T10:33:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c004280 con 0x7f575415cf20 2023-08-10T10:33:13.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57541f30a0 con 0x7f575415cf20 2023-08-10T10:33:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.027+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57541f3660 con 0x7f575415cf20 2023-08-10T10:33:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.028+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575404ecc0 con 0x7f575415cf20 2023-08-10T10:33:13.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.029+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f574c0043e0 con 0x7f575415cf20 2023-08-10T10:33:13.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.029+0000 7f573bfff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 0x7f574006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.030+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f574c022070 con 0x7f575415cf20 2023-08-10T10:33:13.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.030+0000 7f57537fe700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 0x7f574006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.030+0000 7f57537fe700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 0x7f574006d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5744007fd0 tx=0x7f5744007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.034+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f574c0560a0 con 0x7f575415cf20 2023-08-10T10:33:13.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.232+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57540d2b70 con 0x7f575415cf20 2023-08-10T10:33:13.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.233+0000 7f573bfff700 1 -- 172.21.15.88:0/2214621691 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f574c0596c0 con 0x7f575415cf20 2023-08-10T10:33:13.234 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:13.235 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:33:13.236 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 msgr2=0x7f574006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 0x7f574006d1a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5744007fd0 tx=0x7f5744007dc0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 msgr2=0x7f5754158ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f574c013000 tx=0x7f574c004ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.237 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 shutdown_connections 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f575415cf20 0x7f5754158ff0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f574006ace0 0x7f574006d1a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57540b5210 0x7f57541f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 --2- 172.21.15.88:0/2214621691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57540b8870 0x7f5754156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 >> 172.21.15.88:0/2214621691 conn(0x7f57540d3080 msgr2=0x7f57540b2ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:13.238 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 shutdown_connections 2023-08-10T10:33:13.239 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.236+0000 7f5759dff700 1 -- 172.21.15.88:0/2214621691 wait complete. 2023-08-10T10:33:13.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:33:13.257 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:33:13.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.457+0000 7f0abf1ff700 1 Processor -- start 2023-08-10T10:33:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.457+0000 7f0abf1ff700 1 -- start start 2023-08-10T10:33:13.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.458+0000 7f0abf1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.458+0000 7f0abf1ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 0x7f0ab80ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.458+0000 7f0abf1ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab80c43a0 con 0x7f0ab8143810 2023-08-10T10:33:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.458+0000 7f0abf1ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab80c4960 con 0x7f0ab806dca0 2023-08-10T10:33:13.459 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.458+0000 7f0abf1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80ce900 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0abd79c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 0x7f0ab80ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:42516/0 (socket says 172.21.15.88:42516) 2023-08-10T10:33:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3282598525 learned_addr learned my addr 172.21.15.88:0/3282598525 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:13.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0abcf9b700 1 --1- 172.21.15.88:0/3282598525 >> v1:172.21.15.187:6789/0 conn(0x7f0ab8143810 0x7f0ab80c4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:53922/0 (socket says 172.21.15.88:53922) 2023-08-10T10:33:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3282598525 >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 msgr2=0x7f0ab80ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3282598525 >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 0x7f0ab80ce3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3282598525 >> v1:172.21.15.187:6789/0 conn(0x7f0ab8143810 legacy=0x7f0ab80c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0ab7fff700 1 -- 172.21.15.88:0/3282598525 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab806e8c0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.459+0000 7f0abd79c700 1 --2- 172.21.15.88:0/3282598525 >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 0x7f0ab80ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:33:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/3282598525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40098f0 tx=0x7f0aa4009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ad262e9696f77c1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3282598525 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400f8a0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3282598525 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa400fa00 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0ab77fe700 1 -- 172.21.15.88:0/3282598525 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa400fd90 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.473 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0abf1ff700 1 -- 172.21.15.88:0/3282598525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 msgr2=0x7f0ab80cde80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/3282598525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aa40098f0 tx=0x7f0aa4009c00 comp rx=0 tx=0).stop 2023-08-10T10:33:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0abf1ff700 1 -- 172.21.15.88:0/3282598525 shutdown_connections 2023-08-10T10:33:13.474 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/3282598525 >> v2:172.21.15.187:3300/0 conn(0x7f0ab806dca0 0x7f0ab80ce3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.460+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/3282598525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab80cc6c0 0x7f0ab80cde80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.461+0000 7f0abf1ff700 1 -- 172.21.15.88:0/3282598525 >> 172.21.15.88:0/3282598525 conn(0x7f0ab80cb570 msgr2=0x7f0ab80cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.461+0000 7f0abf1ff700 1 -- 172.21.15.88:0/3282598525 shutdown_connections 2023-08-10T10:33:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.461+0000 7f0abf1ff700 1 -- 172.21.15.88:0/3282598525 wait complete. 2023-08-10T10:33:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.462+0000 7f0abf1ff700 1 Processor -- start 2023-08-10T10:33:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.462+0000 7f0abf1ff700 1 -- start start 2023-08-10T10:33:13.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab806dca0 0x7f0ab80b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab8143810 0x7f0ab8138f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b21d0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b24b0 con 0x7f0ab806dca0 2023-08-10T10:33:13.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.463+0000 7f0abf1ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab80b2790 con 0x7f0ab8143810 2023-08-10T10:33:13.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40050/0 (socket says 172.21.15.88:40050) 2023-08-10T10:33:13.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 -- 172.21.15.88:0/2356099971 learned_addr learned my addr 172.21.15.88:0/2356099971 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:13.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0abcf9b700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab806dca0 0x7f0ab80b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0abd79c700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab8143810 0x7f0ab8138f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 -- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab8143810 msgr2=0x7f0ab8138f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab8143810 0x7f0ab8138f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 -- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab806dca0 msgr2=0x7f0ab80b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab806dca0 0x7f0ab80b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 -- 172.21.15.88:0/2356099971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab0009a70 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab7fff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.464+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa401e070 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.465+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa4009550 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.465+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40036a0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.465+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4003a70 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.465+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab80b2d50 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.466+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab80743a0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.467+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0aa4003bd0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.468+0000 7f0ab57fa700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.468+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0aa408c300 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.468+0000 7f0abcf9b700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.469+0000 7f0abcf9b700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000f60 tx=0x7f0aac007ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.472+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0aa4057090 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.675+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0ab80cd1c0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.676+0000 7f0ab57fa700 1 -- 172.21.15.88:0/2356099971 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0aa405a6b0 con 0x7f0ab80cc6c0 2023-08-10T10:33:13.677 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:33:13.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 msgr2=0x7f0a9c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000f60 tx=0x7f0aac007ed0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 msgr2=0x7f0ab80b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0aa4000c00 tx=0x7f0aa4004750 comp rx=0 tx=0).stop 2023-08-10T10:33:13.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 shutdown_connections 2023-08-10T10:33:13.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0a9c06ace0 0x7f0a9c06d1a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab8143810 0x7f0ab8138f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab806dca0 0x7f0ab80b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 --2- 172.21.15.88:0/2356099971 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ab80cc6c0 0x7f0ab80b17f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 >> 172.21.15.88:0/2356099971 conn(0x7f0ab80cb570 msgr2=0x7f0ab813f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:13.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 shutdown_connections 2023-08-10T10:33:13.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.678+0000 7f0abf1ff700 1 -- 172.21.15.88:0/2356099971 wait complete. 2023-08-10T10:33:13.697 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:33:13.895 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.895+0000 7fe5043ff700 1 Processor -- start 2023-08-10T10:33:13.896 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.895+0000 7fe5043ff700 1 -- start start 2023-08-10T10:33:13.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe5043ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4fc06ef40 0x7fe4fc06f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe5043ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc06c920 con 0x7fe4fc0cb520 2023-08-10T10:33:13.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe5043ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4fc06cc00 con 0x7fe4fc15ce90 2023-08-10T10:33:13.897 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe5043ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4fc06f900 con 0x7fe4fc06ef40 2023-08-10T10:33:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe50299c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe4fc0cb520 0x7fe4fc0cb9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43004/0 (socket says 172.21.15.88:43004) 2023-08-10T10:33:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.896+0000 7fe50299c700 1 -- 172.21.15.88:0/2341302901 learned_addr learned my addr 172.21.15.88:0/2341302901 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:13.898 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe50199a700 1 --2- 172.21.15.88:0/2341302901 >> v2:172.21.15.187:3300/0 conn(0x7fe4fc06ef40 0x7fe4fc06f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.899 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe501199700 1 -- 172.21.15.88:0/2341302901 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831093483 0 0) 0x7fe4fc06c920 con 0x7fe4fc0cb520 2023-08-10T10:33:13.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe501199700 1 -- 172.21.15.88:0/2341302901 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4e80035b0 con 0x7fe4fc0cb520 2023-08-10T10:33:13.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe50199a700 1 -- 172.21.15.88:0/2341302901 >> v1:172.21.15.187:6789/0 conn(0x7fe4fc15ce90 legacy=0x7fe4fc0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.900 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe50199a700 1 -- 172.21.15.88:0/2341302901 >> v1:172.21.15.88:6789/0 conn(0x7fe4fc0cb520 legacy=0x7fe4fc0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe50199a700 1 -- 172.21.15.88:0/2341302901 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4fc06cee0 con 0x7fe4fc06ef40 2023-08-10T10:33:13.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.897+0000 7fe50199a700 1 --2- 172.21.15.88:0/2341302901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc06f3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009840 tx=0x7fe4ec009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af24b0b9e70d049c server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe501199700 1 -- 172.21.15.88:0/2341302901 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec011830 con 0x7fe4fc06ef40 2023-08-10T10:33:13.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe501199700 1 -- 172.21.15.88:0/2341302901 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4ec011990 con 0x7fe4fc06ef40 2023-08-10T10:33:13.901 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe501199700 1 -- 172.21.15.88:0/2341302901 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4ec011d00 con 0x7fe4fc06ef40 2023-08-10T10:33:13.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 -- 172.21.15.88:0/2341302901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 msgr2=0x7fe4fc06f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 --2- 172.21.15.88:0/2341302901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc06f3c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe4ec009840 tx=0x7fe4ec009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:13.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 -- 172.21.15.88:0/2341302901 shutdown_connections 2023-08-10T10:33:13.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 --2- 172.21.15.88:0/2341302901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc06f3c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.902 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 -- 172.21.15.88:0/2341302901 >> 172.21.15.88:0/2341302901 conn(0x7fe4fc0b2800 msgr2=0x7fe4fc0b2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:13.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 -- 172.21.15.88:0/2341302901 shutdown_connections 2023-08-10T10:33:13.903 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.898+0000 7fe5043ff700 1 -- 172.21.15.88:0/2341302901 wait complete. 2023-08-10T10:33:13.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.900+0000 7fe5043ff700 1 Processor -- start 2023-08-10T10:33:13.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.900+0000 7fe5043ff700 1 -- start start 2023-08-10T10:33:13.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc15f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.905 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4fc0cb520 0x7fe4fc0b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15f490 con 0x7fe4fc15ce90 2023-08-10T10:33:13.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15fdf0 con 0x7fe4fc06ef40 2023-08-10T10:33:13.906 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe5043ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4fc15e590 con 0x7fe4fc0cb520 2023-08-10T10:33:13.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe50299c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe50299c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40064/0 (socket says 172.21.15.88:40064) 2023-08-10T10:33:13.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.901+0000 7fe50299c700 1 -- 172.21.15.88:0/714336933 learned_addr learned my addr 172.21.15.88:0/714336933 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:13.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50219b700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc15f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.907 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50199a700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4fc0cb520 0x7fe4fc0b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 -- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4fc0cb520 msgr2=0x7fe4fc0b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4fc0cb520 0x7fe4fc0b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 -- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 msgr2=0x7fe4fc15f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc15f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:13.908 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 -- 172.21.15.88:0/714336933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4ec0094a0 con 0x7fe4fc15ce90 2023-08-10T10:33:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50219b700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe50299c700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400cb40 tx=0x7fe4f400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f400ab50 con 0x7fe4fc15ce90 2023-08-10T10:33:13.909 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f400acb0 con 0x7fe4fc15ce90 2023-08-10T10:33:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4012620 con 0x7fe4fc15ce90 2023-08-10T10:33:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4fc15e810 con 0x7fe4fc15ce90 2023-08-10T10:33:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.902+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4fc15edd0 con 0x7fe4fc15ce90 2023-08-10T10:33:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.904+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4fc15f5d0 con 0x7fe4fc15ce90 2023-08-10T10:33:13.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.904+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe4f401b3b0 con 0x7fe4fc15ce90 2023-08-10T10:33:13.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.905+0000 7fe4f2ffd700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 0x7fe4e006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:13.911 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.905+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe4f4089600 con 0x7fe4fc15ce90 2023-08-10T10:33:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.905+0000 7fe50219b700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 0x7fe4e006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.906+0000 7fe50219b700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 0x7fe4e006d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8001730 tx=0x7fe4f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:13.912 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:13.909+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe4fc15f5d0 con 0x7fe4fc15ce90 2023-08-10T10:33:14.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.100+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe4fc15f5d0 con 0x7fe4fc15ce90 2023-08-10T10:33:14.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.101+0000 7fe4f2ffd700 1 -- 172.21.15.88:0/714336933 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe4fc15f5d0 con 0x7fe4fc15ce90 2023-08-10T10:33:14.102 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:33:14.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 msgr2=0x7fe4e006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 0x7fe4e006d1a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8001730 tx=0x7fe4f8009040 comp rx=0 tx=0).stop 2023-08-10T10:33:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 msgr2=0x7fe4fc0b43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400cb40 tx=0x7fe4f400cf00 comp rx=0 tx=0).stop 2023-08-10T10:33:14.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 shutdown_connections 2023-08-10T10:33:14.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe4fc15ce90 0x7fe4fc0b43b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4fc06ef40 0x7fe4fc15f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe4e006ace0 0x7fe4e006d1a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 --2- 172.21.15.88:0/714336933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4fc0cb520 0x7fe4fc0b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 >> 172.21.15.88:0/714336933 conn(0x7fe4fc0b2800 msgr2=0x7fe4fc0cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 shutdown_connections 2023-08-10T10:33:14.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.103+0000 7fe5043ff700 1 -- 172.21.15.88:0/714336933 wait complete. 2023-08-10T10:33:14.122 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:33:14.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.474+0000 7f6a915ff700 1 Processor -- start 2023-08-10T10:33:14.475 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.474+0000 7f6a915ff700 1 -- start start 2023-08-10T10:33:14.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.475+0000 7f6a915ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6a8c158330 0x7f6a8c0cf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.475+0000 7f6a915ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.476 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.475+0000 7f6a915ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a8c06abd0 con 0x7f6a8c0cd520 2023-08-10T10:33:14.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.475+0000 7f6a915ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8c06b060 con 0x7f6a8c158330 2023-08-10T10:33:14.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.475+0000 7f6a915ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c158710 con 0x7f6a8c0b5060 2023-08-10T10:33:14.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.481+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.481+0000 7f6a8b7fe700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:42546/0 (socket says 172.21.15.88:42546) 2023-08-10T10:33:14.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.481+0000 7f6a8b7fe700 1 -- 172.21.15.88:0/1810428442 learned_addr learned my addr 172.21.15.88:0/1810428442 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.486+0000 7f6a8b7fe700 1 -- 172.21.15.88:0/1810428442 >> v2:172.21.15.187:3300/0 conn(0x7f6a8c158330 msgr2=0x7f6a8c0cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.486+0000 7f6a8b7fe700 1 --2- 172.21.15.88:0/1810428442 >> v2:172.21.15.187:3300/0 conn(0x7f6a8c158330 0x7f6a8c0cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.486+0000 7f6a8b7fe700 1 -- 172.21.15.88:0/1810428442 >> v1:172.21.15.187:6789/0 conn(0x7f6a8c0cd520 legacy=0x7f6a8c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:14.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.486+0000 7f6a8b7fe700 1 -- 172.21.15.88:0/1810428442 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8c0cd9d0 con 0x7f6a8c0b5060 2023-08-10T10:33:14.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.495+0000 7f6a8b7fe700 1 --2- 172.21.15.88:0/1810428442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009e50 tx=0x7f6a8400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c73d8c6816a9bb7 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.499+0000 7f6a8a7fc700 1 -- 172.21.15.88:0/1810428442 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8400e070 con 0x7f6a8c0b5060 2023-08-10T10:33:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.499+0000 7f6a8a7fc700 1 -- 172.21.15.88:0/1810428442 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a84003a20 con 0x7f6a8c0b5060 2023-08-10T10:33:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.499+0000 7f6a8a7fc700 1 -- 172.21.15.88:0/1810428442 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84003dd0 con 0x7f6a8c0b5060 2023-08-10T10:33:14.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.500+0000 7f6a915ff700 1 -- 172.21.15.88:0/1810428442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 msgr2=0x7f6a8c0b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.500+0000 7f6a915ff700 1 --2- 172.21.15.88:0/1810428442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6a84009e50 tx=0x7f6a8400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:14.503 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 -- 172.21.15.88:0/1810428442 shutdown_connections 2023-08-10T10:33:14.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 --2- 172.21.15.88:0/1810428442 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c0b5060 0x7f6a8c0b7d40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 --2- 172.21.15.88:0/1810428442 >> v2:172.21.15.187:3300/0 conn(0x7f6a8c158330 0x7f6a8c0cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 -- 172.21.15.88:0/1810428442 >> 172.21.15.88:0/1810428442 conn(0x7f6a8c0cf950 msgr2=0x7f6a8c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:14.504 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 -- 172.21.15.88:0/1810428442 shutdown_connections 2023-08-10T10:33:14.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.502+0000 7f6a915ff700 1 -- 172.21.15.88:0/1810428442 wait complete. 2023-08-10T10:33:14.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.504+0000 7f6a915ff700 1 Processor -- start 2023-08-10T10:33:14.505 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.505+0000 7f6a915ff700 1 -- start start 2023-08-10T10:33:14.507 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0cd520 0x7f6a8c0c8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c158330 0x7f6a8c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c90f0 con 0x7f6a8c0b5060 2023-08-10T10:33:14.508 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c153410 con 0x7f6a8c0cd520 2023-08-10T10:33:14.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.507+0000 7f6a915ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8c0c87e0 con 0x7f6a8c158330 2023-08-10T10:33:14.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.509 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40072/0 (socket says 172.21.15.88:40072) 2023-08-10T10:33:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 -- 172.21.15.88:0/2400921750 learned_addr learned my addr 172.21.15.88:0/2400921750 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8b7fe700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c158330 0x7f6a8c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a827fc700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0cd520 0x7f6a8c0c8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 -- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c158330 msgr2=0x7f6a8c152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.510 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c158330 0x7f6a8c152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 -- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0cd520 msgr2=0x7f6a8c0c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0cd520 0x7f6a8c0c8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.511 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.508+0000 7f6a8affd700 1 -- 172.21.15.88:0/2400921750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a84009b30 con 0x7f6a8c0b5060 2023-08-10T10:33:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.509+0000 7f6a8affd700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b4d0 tx=0x7f6a7c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.510+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011830 con 0x7f6a8c0b5060 2023-08-10T10:33:14.512 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.510+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c011990 con 0x7f6a8c0b5060 2023-08-10T10:33:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.510+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8c0ca0d0 con 0x7f6a8c0b5060 2023-08-10T10:33:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.510+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8c0ca690 con 0x7f6a8c0b5060 2023-08-10T10:33:14.513 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.510+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c011d40 con 0x7f6a8c0b5060 2023-08-10T10:33:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.514+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6a7c01a400 con 0x7f6a8c0b5060 2023-08-10T10:33:14.515 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.514+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8c163170 con 0x7f6a8c0b5060 2023-08-10T10:33:14.516 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.516+0000 7f6a83fff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 0x7f6a6c06d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.516+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6a7c089870 con 0x7f6a8c0b5060 2023-08-10T10:33:14.517 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.517+0000 7f6a827fc700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 0x7f6a6c06d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.518 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.518+0000 7f6a827fc700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 0x7f6a6c06d1f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c157840 tx=0x7f6a74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.523+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6a7c054560 con 0x7f6a8c0b5060 2023-08-10T10:33:14.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.757+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a8c0743a0 con 0x7f6a8c0b5060 2023-08-10T10:33:14.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.757+0000 7f6a83fff700 1 -- 172.21.15.88:0/2400921750 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a7c057b80 con 0x7f6a8c0b5060 2023-08-10T10:33:14.758 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:14.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 msgr2=0x7f6a6c06d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 0x7f6a6c06d1f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c157840 tx=0x7f6a74009040 comp rx=0 tx=0).stop 2023-08-10T10:33:14.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 msgr2=0x7f6a8c0c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c00b4d0 tx=0x7f6a7c00b890 comp rx=0 tx=0).stop 2023-08-10T10:33:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 shutdown_connections 2023-08-10T10:33:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6a6c06ad30 0x7f6a6c06d1f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8c158330 0x7f6a8c152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a8c0b5060 0x7f6a8c0c8170 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 --2- 172.21.15.88:0/2400921750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8c0cd520 0x7f6a8c0c8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.759+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 >> 172.21.15.88:0/2400921750 conn(0x7f6a8c0cf950 msgr2=0x7f6a8c162a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:14.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.760+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 shutdown_connections 2023-08-10T10:33:14.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.760+0000 7f6a915ff700 1 -- 172.21.15.88:0/2400921750 wait complete. 2023-08-10T10:33:14.778 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:33:14.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.977+0000 7f66f39ff700 1 Processor -- start 2023-08-10T10:33:14.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.977+0000 7f66f39ff700 1 -- start start 2023-08-10T10:33:14.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.978+0000 7f66f39ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f66ec15d1e0 0x7f66ec0d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.978+0000 7f66f39ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0d1840 con 0x7f66ec0d1060 2023-08-10T10:33:14.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.978+0000 7f66f39ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66ec0d1b20 con 0x7f66ec0b5060 2023-08-10T10:33:14.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.978+0000 7f66f39ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ec15d5c0 con 0x7f66ec15d1e0 2023-08-10T10:33:14.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f0f9a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f66ec0d1060 0x7f66ec0b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43016/0 (socket says 172.21.15.88:43016) 2023-08-10T10:33:14.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f0f9a700 1 -- 172.21.15.88:0/67631056 learned_addr learned my addr 172.21.15.88:0/67631056 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:14.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f179b700 1 --2- 172.21.15.88:0/67631056 >> v2:172.21.15.187:3300/0 conn(0x7f66ec15d1e0 0x7f66ec0d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66e3fff700 1 -- 172.21.15.88:0/67631056 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765061815 0 0) 0x7f66ec0d1840 con 0x7f66ec0d1060 2023-08-10T10:33:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66e3fff700 1 -- 172.21.15.88:0/67631056 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f66d80035b0 con 0x7f66ec0d1060 2023-08-10T10:33:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f179b700 1 -- 172.21.15.88:0/67631056 >> v1:172.21.15.187:6789/0 conn(0x7f66ec0b5060 legacy=0x7f66ec0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f179b700 1 -- 172.21.15.88:0/67631056 >> v1:172.21.15.88:6789/0 conn(0x7f66ec0d1060 legacy=0x7f66ec0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.979+0000 7f66f179b700 1 -- 172.21.15.88:0/67631056 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ec0d1e00 con 0x7f66ec15d1e0 2023-08-10T10:33:14.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f179b700 1 --2- 172.21.15.88:0/67631056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec15d1e0 0x7f66ec0d27a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009840 tx=0x7f66e8009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75d7cf3a7f6e9788 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66e3fff700 1 -- 172.21.15.88:0/67631056 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011830 con 0x7f66ec15d1e0 2023-08-10T10:33:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66e3fff700 1 -- 172.21.15.88:0/67631056 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e8011990 con 0x7f66ec15d1e0 2023-08-10T10:33:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66e3fff700 1 -- 172.21.15.88:0/67631056 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e8011d20 con 0x7f66ec15d1e0 2023-08-10T10:33:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 -- 172.21.15.88:0/67631056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec15d1e0 msgr2=0x7f66ec0d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.983 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 --2- 172.21.15.88:0/67631056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec15d1e0 0x7f66ec0d27a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66e8009840 tx=0x7f66e8009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 -- 172.21.15.88:0/67631056 shutdown_connections 2023-08-10T10:33:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 --2- 172.21.15.88:0/67631056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec15d1e0 0x7f66ec0d27a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 -- 172.21.15.88:0/67631056 >> 172.21.15.88:0/67631056 conn(0x7f66ec0cf950 msgr2=0x7f66ec0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.980+0000 7f66f39ff700 1 -- 172.21.15.88:0/67631056 shutdown_connections 2023-08-10T10:33:14.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.981+0000 7f66f39ff700 1 -- 172.21.15.88:0/67631056 wait complete. 2023-08-10T10:33:14.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.983+0000 7f66f39ff700 1 Processor -- start 2023-08-10T10:33:14.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.983+0000 7f66f39ff700 1 -- start start 2023-08-10T10:33:14.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66ec0b5060 0x7f66ec15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec0d1060 0x7f66ec1e8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec15aa20 con 0x7f66ec15d1e0 2023-08-10T10:33:14.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0caff0 con 0x7f66ec0d1060 2023-08-10T10:33:14.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.984+0000 7f66f39ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ec0cb240 con 0x7f66ec0b5060 2023-08-10T10:33:14.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40074/0 (socket says 172.21.15.88:40074) 2023-08-10T10:33:14.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 -- 172.21.15.88:0/2370102578 learned_addr learned my addr 172.21.15.88:0/2370102578 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:14.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 -- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66ec0b5060 msgr2=0x7f66ec15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66ec0b5060 0x7f66ec15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 -- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec0d1060 msgr2=0x7f66ec1e8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:14.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec0d1060 0x7f66ec1e8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:14.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 -- 172.21.15.88:0/2370102578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e80094a0 con 0x7f66ec15d1e0 2023-08-10T10:33:14.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f1f9c700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66e400cb50 tx=0x7f66e400cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e4003c00 con 0x7f66ec15d1e0 2023-08-10T10:33:14.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66e4003d60 con 0x7f66ec15d1e0 2023-08-10T10:33:14.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ec0cb520 con 0x7f66ec15d1e0 2023-08-10T10:33:14.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.985+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66e400ab70 con 0x7f66ec15d1e0 2023-08-10T10:33:14.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.986+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ec0cbae0 con 0x7f66ec15d1e0 2023-08-10T10:33:14.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.987+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ec0d0a40 con 0x7f66ec15d1e0 2023-08-10T10:33:14.991 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.987+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f66e400acd0 con 0x7f66ec15d1e0 2023-08-10T10:33:14.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.989+0000 7f66e1ffb700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 0x7f66d006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:14.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.989+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f66e4089880 con 0x7f66ec15d1e0 2023-08-10T10:33:14.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.989+0000 7f66f179b700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 0x7f66d006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:14.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.990+0000 7f66f179b700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 0x7f66d006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0a9ad0 tx=0x7f66e8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:14.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:14.993+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f66e4054560 con 0x7f66ec15d1e0 2023-08-10T10:33:15.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.192+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f66ec0743a0 con 0x7f66ec15d1e0 2023-08-10T10:33:15.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.193+0000 7f66e1ffb700 1 -- 172.21.15.88:0/2370102578 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f66e4057b80 con 0x7f66ec15d1e0 2023-08-10T10:33:15.193 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:33:15.195 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 msgr2=0x7f66d006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 0x7f66d006d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0a9ad0 tx=0x7f66e8010000 comp rx=0 tx=0).stop 2023-08-10T10:33:15.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 msgr2=0x7f66ec15ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66e400cb50 tx=0x7f66e400cf10 comp rx=0 tx=0).stop 2023-08-10T10:33:15.196 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 shutdown_connections 2023-08-10T10:33:15.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66ec15d1e0 0x7f66ec15ed10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f66d006ace0 0x7f66d006d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66ec0b5060 0x7f66ec15a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 --2- 172.21.15.88:0/2370102578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66ec0d1060 0x7f66ec1e8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 >> 172.21.15.88:0/2370102578 conn(0x7f66ec0cf950 msgr2=0x7f66ec06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:15.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 shutdown_connections 2023-08-10T10:33:15.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.195+0000 7f66f39ff700 1 -- 172.21.15.88:0/2370102578 wait complete. 2023-08-10T10:33:15.214 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:33:15.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.413+0000 7fea0cdff700 1 Processor -- start 2023-08-10T10:33:15.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.413+0000 7fea0cdff700 1 -- start start 2023-08-10T10:33:15.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.414+0000 7fea0cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 0x7fea080b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.414+0000 7fea0cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080d1840 con 0x7fea080d27a0 2023-08-10T10:33:15.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.414+0000 7fea0cdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea080d1b20 con 0x7fea0815d1e0 2023-08-10T10:33:15.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.414+0000 7fea0cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080d2c50 con 0x7fea080b5060 2023-08-10T10:33:15.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fe9fffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fea080d27a0 0x7fea080b4950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43022/0 (socket says 172.21.15.88:43022) 2023-08-10T10:33:15.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fe9fffff700 1 -- 172.21.15.88:0/3878112888 learned_addr learned my addr 172.21.15.88:0/3878112888 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:15.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea06d9d700 1 --2- 172.21.15.88:0/3878112888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 0x7fea080b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1142377095 0 0) 0x7fea080d1840 con 0x7fea080d27a0 2023-08-10T10:33:15.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f40035b0 con 0x7fea080d27a0 2023-08-10T10:33:15.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183919527 0 0) 0x7fea080d1b20 con 0x7fea0815d1e0 2023-08-10T10:33:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea080d1840 con 0x7fea0815d1e0 2023-08-10T10:33:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea06d9d700 1 -- 172.21.15.88:0/3878112888 >> v1:172.21.15.187:6789/0 conn(0x7fea0815d1e0 legacy=0x7fea080d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea06d9d700 1 -- 172.21.15.88:0/3878112888 >> v1:172.21.15.88:6789/0 conn(0x7fea080d27a0 legacy=0x7fea080b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.415+0000 7fea06d9d700 1 -- 172.21.15.88:0/3878112888 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea080d1e00 con 0x7fea080b5060 2023-08-10T10:33:15.419 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.416+0000 7fea06d9d700 1 --2- 172.21.15.88:0/3878112888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 0x7fea080b1940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea00009dc0 tx=0x7fea0000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8918ca28d09f8160 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.416+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea0000e070 con 0x7fea080b5060 2023-08-10T10:33:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.416+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea0000bb20 con 0x7fea080b5060 2023-08-10T10:33:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.416+0000 7fea05d9b700 1 -- 172.21.15.88:0/3878112888 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea00012430 con 0x7fea080b5060 2023-08-10T10:33:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 -- 172.21.15.88:0/3878112888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 msgr2=0x7fea080b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 --2- 172.21.15.88:0/3878112888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 0x7fea080b1940 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fea00009dc0 tx=0x7fea0000b330 comp rx=0 tx=0).stop 2023-08-10T10:33:15.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 -- 172.21.15.88:0/3878112888 shutdown_connections 2023-08-10T10:33:15.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 --2- 172.21.15.88:0/3878112888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080b5060 0x7fea080b1940 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 -- 172.21.15.88:0/3878112888 >> 172.21.15.88:0/3878112888 conn(0x7fea080cf950 msgr2=0x7fea080cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:15.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 -- 172.21.15.88:0/3878112888 shutdown_connections 2023-08-10T10:33:15.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.417+0000 7fea0cdff700 1 -- 172.21.15.88:0/3878112888 wait complete. 2023-08-10T10:33:15.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.419+0000 7fea0cdff700 1 Processor -- start 2023-08-10T10:33:15.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.419+0000 7fea0cdff700 1 -- start start 2023-08-10T10:33:15.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080d27a0 0x7fea080c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea0815d1e0 0x7fea080c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080c7f40 con 0x7fea080b5060 2023-08-10T10:33:15.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea080c99d0 con 0x7fea0815d1e0 2023-08-10T10:33:15.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea080c8dc0 con 0x7fea080d27a0 2023-08-10T10:33:15.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40090/0 (socket says 172.21.15.88:40090) 2023-08-10T10:33:15.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 -- 172.21.15.88:0/2054526719 learned_addr learned my addr 172.21.15.88:0/2054526719 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:15.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fe9fffff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080d27a0 0x7fea080c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea06d9d700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea0815d1e0 0x7fea080c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 -- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080d27a0 msgr2=0x7fea080c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080d27a0 0x7fea080c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 -- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea0815d1e0 msgr2=0x7fea080c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea0815d1e0 0x7fea080c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.421+0000 7fea0659c700 1 -- 172.21.15.88:0/2054526719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea00009a70 con 0x7fea080b5060 2023-08-10T10:33:15.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fea0659c700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c520 tx=0x7fe9f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80052d0 con 0x7fea080b5060 2023-08-10T10:33:15.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8005430 con 0x7fea080b5060 2023-08-10T10:33:15.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea080c90a0 con 0x7fea080b5060 2023-08-10T10:33:15.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f80038c0 con 0x7fea080b5060 2023-08-10T10:33:15.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.422+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea080c9660 con 0x7fea080b5060 2023-08-10T10:33:15.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.423+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea080743a0 con 0x7fea080b5060 2023-08-10T10:33:15.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.424+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fe9f8003a20 con 0x7fea080b5060 2023-08-10T10:33:15.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.425+0000 7fe9feffd700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 0x7fe9e806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.425+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fe9f8088e70 con 0x7fea080b5060 2023-08-10T10:33:15.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.425+0000 7fe9fffff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 0x7fe9e806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.426+0000 7fe9fffff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 0x7fe9e806d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea081f6190 tx=0x7fe9f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.429+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fe9f8053b50 con 0x7fea080b5060 2023-08-10T10:33:15.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.629+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fea080b8680 con 0x7fea080b5060 2023-08-10T10:33:15.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.630+0000 7fe9feffd700 1 -- 172.21.15.88:0/2054526719 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe9f8017020 con 0x7fea080b5060 2023-08-10T10:33:15.631 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:15.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.632+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 msgr2=0x7fe9e806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.632+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 0x7fe9e806d1a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea081f6190 tx=0x7fe9f0009040 comp rx=0 tx=0).stop 2023-08-10T10:33:15.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.632+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 msgr2=0x7fea080aa2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.632+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe9f800c520 tx=0x7fe9f800c8e0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 shutdown_connections 2023-08-10T10:33:15.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea0815d1e0 0x7fea080c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea080b5060 0x7fea080aa2b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fe9e806ace0 0x7fe9e806d1a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 --2- 172.21.15.88:0/2054526719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea080d27a0 0x7fea080c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 >> 172.21.15.88:0/2054526719 conn(0x7fea080cf950 msgr2=0x7fea080b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:15.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 shutdown_connections 2023-08-10T10:33:15.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.633+0000 7fea0cdff700 1 -- 172.21.15.88:0/2054526719 wait complete. 2023-08-10T10:33:15.651 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:33:15.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.850+0000 7f0f233ff700 1 Processor -- start 2023-08-10T10:33:15.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.850+0000 7f0f233ff700 1 -- start start 2023-08-10T10:33:15.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f233ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f1c15cf20 0x7f0f1c15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f233ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b5210 0x7f0f1c0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f233ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1c15e590 con 0x7f0f1c0b8870 2023-08-10T10:33:15.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f233ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f1c0cde30 con 0x7f0f1c15cf20 2023-08-10T10:33:15.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f233ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b8e30 con 0x7f0f1c0b5210 2023-08-10T10:33:15.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f2119b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f1c15cf20 0x7f0f1c15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f2099a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f0f1c0b8870 0x7f0f1c0b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43034/0 (socket says 172.21.15.88:43034) 2023-08-10T10:33:15.853 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f2119b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0f1c15cf20 0x7f0f1c15e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40100/0 (socket says 172.21.15.88:40100) 2023-08-10T10:33:15.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.851+0000 7f0f2099a700 1 -- 172.21.15.88:0/722439185 learned_addr learned my addr 172.21.15.88:0/722439185 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:15.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2199c700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b5210 0x7f0f1c0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2119b700 1 -- 172.21.15.88:0/722439185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b5210 msgr2=0x7f0f1c0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:15.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2119b700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b5210 0x7f0f1c0d1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.854 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2119b700 1 -- 172.21.15.88:0/722439185 >> v1:172.21.15.88:6789/0 conn(0x7f0f1c0b8870 legacy=0x7f0f1c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2119b700 1 -- 172.21.15.88:0/722439185 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c0ce010 con 0x7f0f1c15cf20 2023-08-10T10:33:15.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f2119b700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c15e050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009840 tx=0x7f0f18009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8305a2d3c22c7e6 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f13fff700 1 -- 172.21.15.88:0/722439185 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011830 con 0x7f0f1c15cf20 2023-08-10T10:33:15.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f13fff700 1 -- 172.21.15.88:0/722439185 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f18011990 con 0x7f0f1c15cf20 2023-08-10T10:33:15.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.852+0000 7f0f13fff700 1 -- 172.21.15.88:0/722439185 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18011d20 con 0x7f0f1c15cf20 2023-08-10T10:33:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 -- 172.21.15.88:0/722439185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c15cf20 msgr2=0x7f0f1c15e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c15e050 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009840 tx=0x7f0f18009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 -- 172.21.15.88:0/722439185 shutdown_connections 2023-08-10T10:33:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b5210 0x7f0f1c0d1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 --2- 172.21.15.88:0/722439185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c15e050 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 -- 172.21.15.88:0/722439185 >> 172.21.15.88:0/722439185 conn(0x7f0f1c0d3080 msgr2=0x7f0f1c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 -- 172.21.15.88:0/722439185 shutdown_connections 2023-08-10T10:33:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.853+0000 7f0f233ff700 1 -- 172.21.15.88:0/722439185 wait complete. 2023-08-10T10:33:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.855+0000 7f0f233ff700 1 Processor -- start 2023-08-10T10:33:15.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.855+0000 7f0f233ff700 1 -- start start 2023-08-10T10:33:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b8870 0x7f0f1c0c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c1589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b82c0 con 0x7f0f1c0b5210 2023-08-10T10:33:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b76b0 con 0x7f0f1c15cf20 2023-08-10T10:33:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f233ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1c0b7990 con 0x7f0f1c0b8870 2023-08-10T10:33:15.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40116/0 (socket says 172.21.15.88:40116) 2023-08-10T10:33:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 -- 172.21.15.88:0/746882607 learned_addr learned my addr 172.21.15.88:0/746882607 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 -- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b8870 msgr2=0x7f0f1c0c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b8870 0x7f0f1c0c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 -- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f1c15cf20 msgr2=0x7f0f1c1589a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:15.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c1589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:15.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.856+0000 7f0f2119b700 1 -- 172.21.15.88:0/746882607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180094a0 con 0x7f0f1c0b5210 2023-08-10T10:33:15.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f2119b700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009b90 tx=0x7f0f18004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f180036a0 con 0x7f0f1c0b5210 2023-08-10T10:33:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1801f070 con 0x7f0f1c0b5210 2023-08-10T10:33:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f1c0b7c70 con 0x7f0f1c0b5210 2023-08-10T10:33:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f18003a40 con 0x7f0f1c0b5210 2023-08-10T10:33:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.857+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1c0c9920 con 0x7f0f1c0b5210 2023-08-10T10:33:15.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.858+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1c04ecc0 con 0x7f0f1c0b5210 2023-08-10T10:33:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.859+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f0f18003ba0 con 0x7f0f1c0b5210 2023-08-10T10:33:15.865 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.860+0000 7f0f11ffb700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 0x7f0f0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.860+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f0f18021070 con 0x7f0f1c0b5210 2023-08-10T10:33:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.861+0000 7f0f2099a700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 0x7f0f0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.861+0000 7f0f2099a700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 0x7f0f0006d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c15b4b0 tx=0x7f0f0c007ad0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:15.866 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:15.865+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f0f18055ef0 con 0x7f0f1c0b5210 2023-08-10T10:33:16.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.079+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f1c0b8650 con 0x7f0f1c0b5210 2023-08-10T10:33:16.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.080+0000 7f0f11ffb700 1 -- 172.21.15.88:0/746882607 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0f18059510 con 0x7f0f1c0b5210 2023-08-10T10:33:16.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 msgr2=0x7f0f0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 0x7f0f0006d1a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c15b4b0 tx=0x7f0f0c007ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 msgr2=0x7f0f1c0b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0f18009b90 tx=0x7f0f18004750 comp rx=0 tx=0).stop 2023-08-10T10:33:16.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 shutdown_connections 2023-08-10T10:33:16.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f1c15cf20 0x7f0f1c1589a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0f1c0b5210 0x7f0f1c0b70d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f0f0006ace0 0x7f0f0006d1a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 --2- 172.21.15.88:0/746882607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f1c0b8870 0x7f0f1c0c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 >> 172.21.15.88:0/746882607 conn(0x7f0f1c0d3080 msgr2=0x7f0f1c15bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:16.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.082+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 shutdown_connections 2023-08-10T10:33:16.085 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.083+0000 7f0f233ff700 1 -- 172.21.15.88:0/746882607 wait complete. 2023-08-10T10:33:16.085 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:33:16.101 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-08-10T10:33:16.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:16.101 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-08-10T10:33:16.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:33:16.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:16.222 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-10T10:33:16.672 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:33:16.673 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:16.731 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-08-10T10:33:16.732 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-10T10:33:16.778 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:33:16.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.973+0000 7f60d17ff700 1 Processor -- start 2023-08-10T10:33:16.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.973+0000 7f60d17ff700 1 -- start start 2023-08-10T10:33:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.974+0000 7f60d17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.974+0000 7f60d17ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60cc0b5210 0x7f60cc0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.974+0000 7f60d17ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60cc15e590 con 0x7f60cc0b8870 2023-08-10T10:33:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.974+0000 7f60d17ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60cc0cde30 con 0x7f60cc0b5210 2023-08-10T10:33:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.974+0000 7f60d17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b8e30 con 0x7f60cc15cf20 2023-08-10T10:33:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60cc0b5210 0x7f60cc0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f60cc0b5210 0x7f60cc0d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40122/0 (socket says 172.21.15.88:40122) 2023-08-10T10:33:16.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 -- 172.21.15.88:0/316681211 learned_addr learned my addr 172.21.15.88:0/316681211 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:16.977 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60caffd700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 -- 172.21.15.88:0/316681211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 msgr2=0x7f60cc15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:16.978 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 -- 172.21.15.88:0/316681211 >> v1:172.21.15.187:6789/0 conn(0x7f60cc0b8870 legacy=0x7f60cc0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 -- 172.21.15.88:0/316681211 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60cc0ce010 con 0x7f60cc0b5210 2023-08-10T10:33:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60caffd700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:16.979 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60cb7fe700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b5210 0x7f60cc0d1350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009e50 tx=0x7f60c400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824512470053eeb1 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.975+0000 7f60c9ffb700 1 -- 172.21.15.88:0/316681211 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400e070 con 0x7f60cc0b5210 2023-08-10T10:33:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60c9ffb700 1 -- 172.21.15.88:0/316681211 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c400b9c0 con 0x7f60cc0b5210 2023-08-10T10:33:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60c9ffb700 1 -- 172.21.15.88:0/316681211 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c400bd70 con 0x7f60cc0b5210 2023-08-10T10:33:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 -- 172.21.15.88:0/316681211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b5210 msgr2=0x7f60cc0d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.980 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b5210 0x7f60cc0d1350 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009e50 tx=0x7f60c400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 -- 172.21.15.88:0/316681211 shutdown_connections 2023-08-10T10:33:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b5210 0x7f60cc0d1350 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 --2- 172.21.15.88:0/316681211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 -- 172.21.15.88:0/316681211 >> 172.21.15.88:0/316681211 conn(0x7f60cc0d3080 msgr2=0x7f60cc0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:16.981 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 -- 172.21.15.88:0/316681211 shutdown_connections 2023-08-10T10:33:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.976+0000 7f60d17ff700 1 -- 172.21.15.88:0/316681211 wait complete. 2023-08-10T10:33:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.978+0000 7f60d17ff700 1 Processor -- start 2023-08-10T10:33:16.982 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.978+0000 7f60d17ff700 1 -- start start 2023-08-10T10:33:16.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60cc0b5210 0x7f60cc0c9380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.984 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc0d22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b71c0 con 0x7f60cc0b8870 2023-08-10T10:33:16.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b7460 con 0x7f60cc0b5210 2023-08-10T10:33:16.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60d17ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60cc0b7740 con 0x7f60cc15cf20 2023-08-10T10:33:16.985 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60ca7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60ca7fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40130/0 (socket says 172.21.15.88:40130) 2023-08-10T10:33:16.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60ca7fc700 1 -- 172.21.15.88:0/1439502110 learned_addr learned my addr 172.21.15.88:0/1439502110 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:16.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60cb7fe700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc0d22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.979+0000 7f60caffd700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60cc0b5210 0x7f60cc0c9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.986 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 -- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 msgr2=0x7f60cc0d22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc0d22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 -- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60cc0b5210 msgr2=0x7f60cc0c9380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:16.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60cc0b5210 0x7f60cc0c9380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:16.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 -- 172.21.15.88:0/1439502110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4009b30 con 0x7f60cc0b8870 2023-08-10T10:33:16.987 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60ca7fc700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c4e0 tx=0x7f60c000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00052d0 con 0x7f60cc0b8870 2023-08-10T10:33:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c0005430 con 0x7f60cc0b8870 2023-08-10T10:33:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00038c0 con 0x7f60cc0b8870 2023-08-10T10:33:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60cc0b7a20 con 0x7f60cc0b8870 2023-08-10T10:33:16.988 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.980+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60cc0b7fe0 con 0x7f60cc0b8870 2023-08-10T10:33:16.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.982+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60cc04ecc0 con 0x7f60cc0b8870 2023-08-10T10:33:16.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.982+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f60c0003a20 con 0x7f60cc0b8870 2023-08-10T10:33:16.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.983+0000 7f60b37fe700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 0x7f60b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:16.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.983+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f60c0088bf0 con 0x7f60cc0b8870 2023-08-10T10:33:16.989 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.983+0000 7f60caffd700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 0x7f60b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:16.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.984+0000 7f60caffd700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 0x7f60b806d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0099d0 tx=0x7f60bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:16.990 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:16.988+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f60c00538d0 con 0x7f60cc0b8870 2023-08-10T10:33:17.187 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.187+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60cc06b180 con 0x7f60cc0b8870 2023-08-10T10:33:17.189 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.188+0000 7f60b37fe700 1 -- 172.21.15.88:0/1439502110 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7f60c0056ef0 con 0x7f60cc0b8870 2023-08-10T10:33:17.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:17.190 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:33:17.191 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 msgr2=0x7f60b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 0x7f60b806d1a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f60bc0099d0 tx=0x7f60bc008040 comp rx=0 tx=0).stop 2023-08-10T10:33:17.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 msgr2=0x7f60cc0b6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f60c000c4e0 tx=0x7f60c000c7f0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.192 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 shutdown_connections 2023-08-10T10:33:17.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f60b806ace0 0x7f60b806d1a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60cc15cf20 0x7f60cc0d22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60cc0b5210 0x7f60cc0c9380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 --2- 172.21.15.88:0/1439502110 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f60cc0b8870 0x7f60cc0b6c80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 >> 172.21.15.88:0/1439502110 conn(0x7f60cc0d3080 msgr2=0x7f60cc0d01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:17.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 shutdown_connections 2023-08-10T10:33:17.194 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.191+0000 7f60d17ff700 1 -- 172.21.15.88:0/1439502110 wait complete. 2023-08-10T10:33:17.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-10T10:30:19.589864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-08-10T10:30:26.312395+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-10T10:30:32.285848+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-08-10T10:30:32.776165+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-10T10:30:36.389300+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-10T10:33:17.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-10T10:33:17.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.411+0000 7fa208f9d700 1 Processor -- start 2023-08-10T10:33:17.412 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.411+0000 7fa208f9d700 1 -- start start 2023-08-10T10:33:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.412+0000 7fa208f9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2040b82c0 0x7fa2040b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.412+0000 7fa208f9d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2040d2b40 con 0x7fa20415ce30 2023-08-10T10:33:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.412+0000 7fa208f9d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa20415d210 con 0x7fa2040b4d90 2023-08-10T10:33:17.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.412+0000 7fa208f9d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2040b5e90 con 0x7fa2040b82c0 2023-08-10T10:33:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa2037fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fa20415ce30 0x7fa2040d2430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43046/0 (socket says 172.21.15.88:43046) 2023-08-10T10:33:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa202ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2040b82c0 0x7fa2040b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa2037fe700 1 -- 172.21.15.88:0/603789457 learned_addr learned my addr 172.21.15.88:0/603789457 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:17.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa202ffd700 1 -- 172.21.15.88:0/603789457 >> v1:172.21.15.187:6789/0 conn(0x7fa2040b4d90 legacy=0x7fa204166970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa202ffd700 1 -- 172.21.15.88:0/603789457 >> v1:172.21.15.88:6789/0 conn(0x7fa20415ce30 legacy=0x7fa2040d2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa202ffd700 1 -- 172.21.15.88:0/603789457 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa20406a5e0 con 0x7fa2040b82c0 2023-08-10T10:33:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa2027fc700 1 -- 172.21.15.88:0/603789457 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3966228589 0 0) 0x7fa2040d2b40 con 0x7fa20415ce30 2023-08-10T10:33:17.416 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.413+0000 7fa202ffd700 1 --2- 172.21.15.88:0/603789457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040b4850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009840 tx=0x7fa1f8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deae9038b2465062 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa2027fc700 1 -- 172.21.15.88:0/603789457 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004230 con 0x7fa2040b82c0 2023-08-10T10:33:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa2027fc700 1 -- 172.21.15.88:0/603789457 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f8004390 con 0x7fa2040b82c0 2023-08-10T10:33:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa2027fc700 1 -- 172.21.15.88:0/603789457 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f80036a0 con 0x7fa2040b82c0 2023-08-10T10:33:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 -- 172.21.15.88:0/603789457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 msgr2=0x7fa2040b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.417 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 --2- 172.21.15.88:0/603789457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040b4850 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa1f8009840 tx=0x7fa1f8009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 -- 172.21.15.88:0/603789457 shutdown_connections 2023-08-10T10:33:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 --2- 172.21.15.88:0/603789457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040b4850 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 -- 172.21.15.88:0/603789457 >> 172.21.15.88:0/603789457 conn(0x7fa2040cf850 msgr2=0x7fa2040cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 -- 172.21.15.88:0/603789457 shutdown_connections 2023-08-10T10:33:17.418 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.414+0000 7fa208f9d700 1 -- 172.21.15.88:0/603789457 wait complete. 2023-08-10T10:33:17.420 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.417+0000 7fa208f9d700 1 Processor -- start 2023-08-10T10:33:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.417+0000 7fa208f9d700 1 -- start start 2023-08-10T10:33:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 0x7fa2040b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 0x7fa2040b6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040ca2d0 con 0x7fa2040b82c0 2023-08-10T10:33:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040ca4b0 con 0x7fa2040b4d90 2023-08-10T10:33:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa208f9d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2040ca770 con 0x7fa20415ce30 2023-08-10T10:33:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa202ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40146/0 (socket says 172.21.15.88:40146) 2023-08-10T10:33:17.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.418+0000 7fa202ffd700 1 -- 172.21.15.88:0/2993594925 learned_addr learned my addr 172.21.15.88:0/2993594925 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa2037fe700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 0x7fa2040b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 -- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 msgr2=0x7fa2040b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa203fff700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 0x7fa2040b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 0x7fa2040b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 -- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 msgr2=0x7fa2040b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 0x7fa2040b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 -- 172.21.15.88:0/2993594925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f80094a0 con 0x7fa2040b82c0 2023-08-10T10:33:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa2037fe700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 0x7fa2040b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa203fff700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 0x7fa2040b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:17.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa202ffd700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80090b0 tx=0x7fa1f8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8011830 con 0x7fa2040b82c0 2023-08-10T10:33:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f801e070 con 0x7fa2040b82c0 2023-08-10T10:33:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8011bb0 con 0x7fa2040b82c0 2023-08-10T10:33:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.419+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2040caa50 con 0x7fa2040b82c0 2023-08-10T10:33:17.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.420+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2040cb010 con 0x7fa2040b82c0 2023-08-10T10:33:17.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.421+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2040677f0 con 0x7fa2040b82c0 2023-08-10T10:33:17.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.421+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fa1f8011d10 con 0x7fa2040b82c0 2023-08-10T10:33:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.422+0000 7fa1ebfff700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 0x7fa1f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.422+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fa1f808ab40 con 0x7fa2040b82c0 2023-08-10T10:33:17.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.423+0000 7fa2037fe700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 0x7fa1f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.423+0000 7fa2037fe700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 0x7fa1f006d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f60 tx=0x7fa1f4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.428+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fa1f80558f0 con 0x7fa2040b82c0 2023-08-10T10:33:17.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.624+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa204153eb0 con 0x7fa2040b82c0 2023-08-10T10:33:17.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.625+0000 7fa1ebfff700 1 -- 172.21.15.88:0/2993594925 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa1f8020020 con 0x7fa2040b82c0 2023-08-10T10:33:17.626 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2023-08-10T10:33:17.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 msgr2=0x7fa1f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 0x7fa1f006d1a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4000f60 tx=0x7fa1f4009040 comp rx=0 tx=0).stop 2023-08-10T10:33:17.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 msgr2=0x7fa2040cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80090b0 tx=0x7fa1f8004750 comp rx=0 tx=0).stop 2023-08-10T10:33:17.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 shutdown_connections 2023-08-10T10:33:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fa1f006ace0 0x7fa1f006d1a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa20415ce30 0x7fa2040b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2040b4d90 0x7fa2040b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 --2- 172.21.15.88:0/2993594925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa2040b82c0 0x7fa2040cb880 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 >> 172.21.15.88:0/2993594925 conn(0x7fa2040cf850 msgr2=0x7fa20415b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 shutdown_connections 2023-08-10T10:33:17.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.627+0000 7fa208f9d700 1 -- 172.21.15.88:0/2993594925 wait complete. 2023-08-10T10:33:17.646 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-08-10T10:33:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.844+0000 7f1289bff700 1 Processor -- start 2023-08-10T10:33:17.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.844+0000 7f1289bff700 1 -- start start 2023-08-10T10:33:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.845+0000 7f1289bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f128415d1e0 0x7f12840d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f1289bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12840b5060 0x7f12840b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f1289bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12840d1840 con 0x7f12840d1060 2023-08-10T10:33:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f1289bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f128415d5c0 con 0x7f128415d1e0 2023-08-10T10:33:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f1289bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12840d1b20 con 0x7f12840b5060 2023-08-10T10:33:17.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f128415d1e0 0x7f12840d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f128415d1e0 0x7f12840d27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40160/0 (socket says 172.21.15.88:40160) 2023-08-10T10:33:17.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 -- 172.21.15.88:0/1615032337 learned_addr learned my addr 172.21.15.88:0/1615032337 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f1283fff700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12840b5060 0x7f12840b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 -- 172.21.15.88:0/1615032337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12840b5060 msgr2=0x7f12840b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:17.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12840b5060 0x7f12840b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 -- 172.21.15.88:0/1615032337 >> v1:172.21.15.187:6789/0 conn(0x7f12840d1060 legacy=0x7f12840b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:17.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.846+0000 7f12837fe700 1 -- 172.21.15.88:0/1615032337 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12840d1e00 con 0x7f128415d1e0 2023-08-10T10:33:17.852 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f12837fe700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f128415d1e0 0x7f12840d27a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f12740098f0 tx=0x7f1274009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cccb58bf41473d8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.855 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f12827fc700 1 -- 172.21.15.88:0/1615032337 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400b8a0 con 0x7f128415d1e0 2023-08-10T10:33:17.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f12827fc700 1 -- 172.21.15.88:0/1615032337 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127400ba00 con 0x7f128415d1e0 2023-08-10T10:33:17.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f12827fc700 1 -- 172.21.15.88:0/1615032337 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127400bd90 con 0x7f128415d1e0 2023-08-10T10:33:17.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f1289bff700 1 -- 172.21.15.88:0/1615032337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f128415d1e0 msgr2=0x7f12840d27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.856 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.847+0000 7f1289bff700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f128415d1e0 0x7f12840d27a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f12740098f0 tx=0x7f1274009c00 comp rx=0 tx=0).stop 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 -- 172.21.15.88:0/1615032337 shutdown_connections 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12840b5060 0x7f12840b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 --2- 172.21.15.88:0/1615032337 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f128415d1e0 0x7f12840d27a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 -- 172.21.15.88:0/1615032337 >> 172.21.15.88:0/1615032337 conn(0x7f12840cf950 msgr2=0x7f12840cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 -- 172.21.15.88:0/1615032337 shutdown_connections 2023-08-10T10:33:17.857 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.848+0000 7f1289bff700 1 -- 172.21.15.88:0/1615032337 wait complete. 2023-08-10T10:33:17.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.849+0000 7f1289bff700 1 Processor -- start 2023-08-10T10:33:17.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.849+0000 7f1289bff700 1 -- start start 2023-08-10T10:33:17.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12840d1060 0x7f12841e61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.858 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f128415d1e0 0x7f12841e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840c7490 con 0x7f12840b5060 2023-08-10T10:33:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12840c6e60 con 0x7f12840d1060 2023-08-10T10:33:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f1289bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12841e6c60 con 0x7f128415d1e0 2023-08-10T10:33:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.850+0000 7f12837fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.859 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40168/0 (socket says 172.21.15.88:40168) 2023-08-10T10:33:17.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 -- 172.21.15.88:0/3909817297 learned_addr learned my addr 172.21.15.88:0/3909817297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:17.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f1283fff700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f128415d1e0 0x7f12841e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f1282ffd700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12840d1060 0x7f12841e61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.860 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 -- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f128415d1e0 msgr2=0x7f12841e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f128415d1e0 0x7f12841e7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 -- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12840d1060 msgr2=0x7f12841e61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12840d1060 0x7f12841e61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 -- 172.21.15.88:0/3909817297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009550 con 0x7f12840b5060 2023-08-10T10:33:17.861 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f12837fe700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1274000c00 tx=0x7f1274004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1274004480 con 0x7f12840b5060 2023-08-10T10:33:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127401f070 con 0x7f12840b5060 2023-08-10T10:33:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740038c0 con 0x7f12840b5060 2023-08-10T10:33:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.851+0000 7f1289bff700 1 -- 172.21.15.88:0/3909817297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12840c7120 con 0x7f12840b5060 2023-08-10T10:33:17.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.852+0000 7f1289bff700 1 -- 172.21.15.88:0/3909817297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12841e6700 con 0x7f12840b5060 2023-08-10T10:33:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.853+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12840743a0 con 0x7f12840b5060 2023-08-10T10:33:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.853+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1274021030 con 0x7f12840b5060 2023-08-10T10:33:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.854+0000 7f126bfff700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 0x7f127006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.854+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f127408ac20 con 0x7f12840b5060 2023-08-10T10:33:17.863 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.855+0000 7f1282ffd700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 0x7f127006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.855+0000 7f1282ffd700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 0x7f127006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f128415b2b0 tx=0x7f1278009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:17.864 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:17.858+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1274055a20 con 0x7f12840b5060 2023-08-10T10:33:18.055 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.055+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f12840cf1f0 con 0x7f12840b5060 2023-08-10T10:33:18.056 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.055+0000 7f126bfff700 1 -- 172.21.15.88:0/3909817297 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v29) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1274059040 con 0x7f12840b5060 2023-08-10T10:33:18.057 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 8 2023-08-10T10:33:18.058 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 msgr2=0x7f127006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 0x7f127006d1a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f128415b2b0 tx=0x7f1278009040 comp rx=0 tx=0).stop 2023-08-10T10:33:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 msgr2=0x7f128415ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f1274000c00 tx=0x7f1274004750 comp rx=0 tx=0).stop 2023-08-10T10:33:18.059 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 shutdown_connections 2023-08-10T10:33:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f127006ace0 0x7f127006d1a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f128415d1e0 0x7f12841e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12840b5060 0x7f128415ad70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 --2- 172.21.15.88:0/3909817297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12840d1060 0x7f12841e61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.060 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 >> 172.21.15.88:0/3909817297 conn(0x7f12840cf950 msgr2=0x7f12840b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 shutdown_connections 2023-08-10T10:33:18.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.058+0000 7f1269ffb700 1 -- 172.21.15.88:0/3909817297 wait complete. 2023-08-10T10:33:18.077 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-10T10:33:18.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.277+0000 7f4281bff700 1 Processor -- start 2023-08-10T10:33:18.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.277+0000 7f4281bff700 1 -- start start 2023-08-10T10:33:18.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.278+0000 7f4281bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f427c0b5060 0x7f427c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.278+0000 7f4281bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0d1840 con 0x7f427c15d1e0 2023-08-10T10:33:18.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.278+0000 7f4281bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f427c0d1b20 con 0x7f427c0d27a0 2023-08-10T10:33:18.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.278+0000 7f4281bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f427c0d2c50 con 0x7f427c0b5060 2023-08-10T10:33:18.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427b7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f427c15d1e0 0x7f427c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43048/0 (socket says 172.21.15.88:43048) 2023-08-10T10:33:18.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427b7fe700 1 -- 172.21.15.88:0/147505951 learned_addr learned my addr 172.21.15.88:0/147505951 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:18.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427bfff700 1 --2- 172.21.15.88:0/147505951 >> v2:172.21.15.187:3300/0 conn(0x7f427c0b5060 0x7f427c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531021810 0 0) 0x7f427c0d1840 con 0x7f427c15d1e0 2023-08-10T10:33:18.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42640035b0 con 0x7f427c15d1e0 2023-08-10T10:33:18.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755202597 0 0) 0x7f427c0d1b20 con 0x7f427c0d27a0 2023-08-10T10:33:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f427c0d1840 con 0x7f427c0d27a0 2023-08-10T10:33:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427bfff700 1 -- 172.21.15.88:0/147505951 >> v1:172.21.15.187:6789/0 conn(0x7f427c0d27a0 legacy=0x7f427c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427bfff700 1 -- 172.21.15.88:0/147505951 >> v1:172.21.15.88:6789/0 conn(0x7f427c15d1e0 legacy=0x7f427c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4283726416 0 0) 0x7f42640035b0 con 0x7f427c15d1e0 2023-08-10T10:33:18.285 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.279+0000 7f427bfff700 1 -- 172.21.15.88:0/147505951 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0d1e00 con 0x7f427c0b5060 2023-08-10T10:33:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f427bfff700 1 --2- 172.21.15.88:0/147505951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c0b5060 0x7f427c0b1940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4274009d90 tx=0x7f427400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb82836bfcfe1557 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427400e070 con 0x7f427c0b5060 2023-08-10T10:33:18.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4274003a20 con 0x7f427c0b5060 2023-08-10T10:33:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f427a7fc700 1 -- 172.21.15.88:0/147505951 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c001670 con 0x7f427c0b5060 2023-08-10T10:33:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f4281bff700 1 -- 172.21.15.88:0/147505951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c0b5060 msgr2=0x7f427c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f4281bff700 1 --2- 172.21.15.88:0/147505951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c0b5060 0x7f427c0b1940 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4274009d90 tx=0x7f427400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:18.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f4281bff700 1 -- 172.21.15.88:0/147505951 shutdown_connections 2023-08-10T10:33:18.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f4281bff700 1 --2- 172.21.15.88:0/147505951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c0b5060 0x7f427c0b1940 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.280+0000 7f4281bff700 1 -- 172.21.15.88:0/147505951 >> 172.21.15.88:0/147505951 conn(0x7f427c0cf950 msgr2=0x7f427c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:18.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.281+0000 7f4281bff700 1 -- 172.21.15.88:0/147505951 shutdown_connections 2023-08-10T10:33:18.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.281+0000 7f4281bff700 1 -- 172.21.15.88:0/147505951 wait complete. 2023-08-10T10:33:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.282+0000 7f4281bff700 1 Processor -- start 2023-08-10T10:33:18.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.282+0000 7f4281bff700 1 -- start start 2023-08-10T10:33:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f427c0b5060 0x7f427c1f3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 0x7f427c0a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c8330 con 0x7f427c0d27a0 2023-08-10T10:33:18.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c76f0 con 0x7f427c15d1e0 2023-08-10T10:33:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f4281bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f427c0c7990 con 0x7f427c0b5060 2023-08-10T10:33:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.283+0000 7f427affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40182/0 (socket says 172.21.15.88:40182) 2023-08-10T10:33:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 -- 172.21.15.88:0/925020542 learned_addr learned my addr 172.21.15.88:0/925020542 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:18.293 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427bfff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 0x7f427c0a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427b7fe700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f427c0b5060 0x7f427c1f3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 -- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f427c0b5060 msgr2=0x7f427c1f3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f427c0b5060 0x7f427c1f3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 -- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 msgr2=0x7f427c0a98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.294 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 0x7f427c0a98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 -- 172.21.15.88:0/925020542 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009a70 con 0x7f427c0d27a0 2023-08-10T10:33:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427bfff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 0x7f427c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f427affd700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f427000c520 tx=0x7f427000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700052d0 con 0x7f427c0d27a0 2023-08-10T10:33:18.295 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270005430 con 0x7f427c0d27a0 2023-08-10T10:33:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f427c0c7c70 con 0x7f427c0d27a0 2023-08-10T10:33:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.284+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42700038c0 con 0x7f427c0d27a0 2023-08-10T10:33:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.285+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f427c1f3da0 con 0x7f427c0d27a0 2023-08-10T10:33:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.285+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427c0c8470 con 0x7f427c0d27a0 2023-08-10T10:33:18.296 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.287+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4270003a20 con 0x7f427c0d27a0 2023-08-10T10:33:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.288+0000 7f4263fff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 0x7f426806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.288+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4270088de0 con 0x7f427c0d27a0 2023-08-10T10:33:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.288+0000 7f427b7fe700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 0x7f426806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.297 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.289+0000 7f427b7fe700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 0x7f426806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f427c0cdc40 tx=0x7f426c001490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.298 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.292+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f427c0c8470 con 0x7f427c0d27a0 2023-08-10T10:33:18.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.493+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f427c0c8470 con 0x7f427c0d27a0 2023-08-10T10:33:18.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.494+0000 7f4263fff700 1 -- 172.21.15.88:0/925020542 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f427c0c8470 con 0x7f427c0d27a0 2023-08-10T10:33:18.496 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:18.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.496+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 msgr2=0x7f426806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.496+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 0x7f426806d1a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f427c0cdc40 tx=0x7f426c001490 comp rx=0 tx=0).stop 2023-08-10T10:33:18.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.496+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 msgr2=0x7f427c0b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.496+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f427000c520 tx=0x7f427000c8e0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 shutdown_connections 2023-08-10T10:33:18.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f427c15d1e0 0x7f427c0a98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f426806ace0 0x7f426806d1a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f427c0b5060 0x7f427c1f3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 --2- 172.21.15.88:0/925020542 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f427c0d27a0 0x7f427c0b3230 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.501 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 >> 172.21.15.88:0/925020542 conn(0x7f427c0cf950 msgr2=0x7f427c0b4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:18.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 shutdown_connections 2023-08-10T10:33:18.502 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.497+0000 7f4281bff700 1 -- 172.21.15.88:0/925020542 wait complete. 2023-08-10T10:33:18.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-10T10:33:18.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.714+0000 7ff51c9ff700 1 Processor -- start 2023-08-10T10:33:18.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.714+0000 7ff51c9ff700 1 -- start start 2023-08-10T10:33:18.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.715+0000 7ff51c9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5180c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.715+0000 7ff51c9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff51806dca0 0x7ff5180c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.715+0000 7ff51c9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5180c43a0 con 0x7ff5180cc6c0 2023-08-10T10:33:18.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.715+0000 7ff51c9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5180c4960 con 0x7ff51806dca0 2023-08-10T10:33:18.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.715+0000 7ff51c9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51806e8c0 con 0x7ff518143810 2023-08-10T10:33:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff515d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff5180cc6c0 0x7ff5180cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43052/0 (socket says 172.21.15.88:43052) 2023-08-10T10:33:18.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff515d9b700 1 -- 172.21.15.88:0/1056399696 learned_addr learned my addr 172.21.15.88:0/1056399696 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff516d9d700 1 --2- 172.21.15.88:0/1056399696 >> v2:172.21.15.88:3300/0 conn(0x7ff51806dca0 0x7ff5180c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff51659c700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5180c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff51559a700 1 -- 172.21.15.88:0/1056399696 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2299648002 0 0) 0x7ff5180c43a0 con 0x7ff5180cc6c0 2023-08-10T10:33:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff51559a700 1 -- 172.21.15.88:0/1056399696 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5000035b0 con 0x7ff5180cc6c0 2023-08-10T10:33:18.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff516d9d700 1 -- 172.21.15.88:0/1056399696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 msgr2=0x7ff5180c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:18.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff516d9d700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5180c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff516d9d700 1 -- 172.21.15.88:0/1056399696 >> v1:172.21.15.88:6789/0 conn(0x7ff5180cc6c0 legacy=0x7ff5180cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.716+0000 7ff516d9d700 1 -- 172.21.15.88:0/1056399696 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51806eba0 con 0x7ff51806dca0 2023-08-10T10:33:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff516d9d700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5180c9140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff510009d90 tx=0x7ff51000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccfdba0d178fd184 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51559a700 1 -- 172.21.15.88:0/1056399696 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51000e070 con 0x7ff51806dca0 2023-08-10T10:33:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51559a700 1 -- 172.21.15.88:0/1056399696 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff51000bb20 con 0x7ff51806dca0 2023-08-10T10:33:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51559a700 1 -- 172.21.15.88:0/1056399696 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510012430 con 0x7ff51806dca0 2023-08-10T10:33:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1056399696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 msgr2=0x7ff5180c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5180c9140 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff510009d90 tx=0x7ff51000b330 comp rx=0 tx=0).stop 2023-08-10T10:33:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1056399696 shutdown_connections 2023-08-10T10:33:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5180c9140 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.717+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1056399696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5180c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.718+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1056399696 >> 172.21.15.88:0/1056399696 conn(0x7ff5180cb570 msgr2=0x7ff5180cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:18.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.718+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1056399696 shutdown_connections 2023-08-10T10:33:18.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.718+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1056399696 wait complete. 2023-08-10T10:33:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.719+0000 7ff51c9ff700 1 Processor -- start 2023-08-10T10:33:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.719+0000 7ff51c9ff700 1 -- start start 2023-08-10T10:33:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5180cc6c0 0x7ff5181e0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5181f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181e10d0 con 0x7ff51806dca0 2023-08-10T10:33:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181e1b60 con 0x7ff5180cc6c0 2023-08-10T10:33:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.720+0000 7ff51c9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181e1e40 con 0x7ff518143810 2023-08-10T10:33:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.727 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40190/0 (socket says 172.21.15.88:40190) 2023-08-10T10:33:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 -- 172.21.15.88:0/1948218293 learned_addr learned my addr 172.21.15.88:0/1948218293 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff516d9d700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5181f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff515d9b700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5180cc6c0 0x7ff5181e0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 -- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 msgr2=0x7ff5181f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.728 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5181f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 -- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5180cc6c0 msgr2=0x7ff5181e0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5180cc6c0 0x7ff5181e0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 -- 172.21.15.88:0/1948218293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff510009a70 con 0x7ff51806dca0 2023-08-10T10:33:18.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff516d9d700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5181f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:18.729 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff51659c700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e870 tx=0x7ff50800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.721+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508009590 con 0x7ff51806dca0 2023-08-10T10:33:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.722+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800ee70 con 0x7ff51806dca0 2023-08-10T10:33:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.722+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800ca50 con 0x7ff51806dca0 2023-08-10T10:33:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.722+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5181e2120 con 0x7ff51806dca0 2023-08-10T10:33:18.730 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.722+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff51813e3d0 con 0x7ff51806dca0 2023-08-10T10:33:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.723+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5180743a0 con 0x7ff51806dca0 2023-08-10T10:33:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.724+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff50800cbb0 con 0x7ff51806dca0 2023-08-10T10:33:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.724+0000 7ff506ffd700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 0x7ff4f806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.724+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff5080896f0 con 0x7ff51806dca0 2023-08-10T10:33:18.731 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.725+0000 7ff515d9b700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 0x7ff4f806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:18.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.725+0000 7ff515d9b700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 0x7ff4f806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5181431b0 tx=0x7ff50c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:18.732 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.729+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff508057f90 con 0x7ff51806dca0 2023-08-10T10:33:18.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.923+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff5180cd1c0 con 0x7ff51806dca0 2023-08-10T10:33:18.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.923+0000 7ff506ffd700 1 -- 172.21.15.88:0/1948218293 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff50800ce60 con 0x7ff51806dca0 2023-08-10T10:33:18.924 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 64 2023-08-10T10:33:18.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 msgr2=0x7ff4f806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 0x7ff4f806d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5181431b0 tx=0x7ff50c009040 comp rx=0 tx=0).stop 2023-08-10T10:33:18.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 msgr2=0x7ff5181e14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:18.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff50800e870 tx=0x7ff50800ec30 comp rx=0 tx=0).stop 2023-08-10T10:33:18.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 shutdown_connections 2023-08-10T10:33:18.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff4f806ace0 0x7ff4f806d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff518143810 0x7ff5181f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff51806dca0 0x7ff5181e14d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 --2- 172.21.15.88:0/1948218293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5180cc6c0 0x7ff5181e0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:18.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 >> 172.21.15.88:0/1948218293 conn(0x7ff5180cb570 msgr2=0x7ff518140c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:18.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 shutdown_connections 2023-08-10T10:33:18.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:18.926+0000 7ff51c9ff700 1 -- 172.21.15.88:0/1948218293 wait complete. 2023-08-10T10:33:18.945 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-10T10:33:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.144+0000 7ff5957ff700 1 Processor -- start 2023-08-10T10:33:19.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.145+0000 7ff5957ff700 1 -- start start 2023-08-10T10:33:19.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff5957ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff59015d180 0x7ff5900d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff5957ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5900d2980 0x7ff5900b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff5957ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5900b5310 con 0x7ff5900b4ec0 2023-08-10T10:33:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff5957ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5900d19c0 con 0x7ff5900d2980 2023-08-10T10:33:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff5957ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5900d0ad0 con 0x7ff59015d180 2023-08-10T10:33:19.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff58e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5900d2980 0x7ff5900b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff58e7fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff5900d2980 0x7ff5900b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40194/0 (socket says 172.21.15.88:40194) 2023-08-10T10:33:19.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff58e7fc700 1 -- 172.21.15.88:0/4241239963 learned_addr learned my addr 172.21.15.88:0/4241239963 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:19.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.146+0000 7ff58effd700 1 --2- 172.21.15.88:0/4241239963 >> v2:172.21.15.187:3300/0 conn(0x7ff59015d180 0x7ff5900d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58e7fc700 1 -- 172.21.15.88:0/4241239963 >> v2:172.21.15.187:3300/0 conn(0x7ff59015d180 msgr2=0x7ff5900d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:19.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58e7fc700 1 --2- 172.21.15.88:0/4241239963 >> v2:172.21.15.187:3300/0 conn(0x7ff59015d180 0x7ff5900d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58e7fc700 1 -- 172.21.15.88:0/4241239963 >> v1:172.21.15.187:6789/0 conn(0x7ff5900b4ec0 legacy=0x7ff59006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:19.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58e7fc700 1 -- 172.21.15.88:0/4241239963 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5900d0db0 con 0x7ff5900d2980 2023-08-10T10:33:19.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58e7fc700 1 --2- 172.21.15.88:0/4241239963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5900d2980 0x7ff5900b4980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff5900b5af0 tx=0x7ff584009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604b1e4246343018 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58dffb700 1 -- 172.21.15.88:0/4241239963 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff584004230 con 0x7ff5900d2980 2023-08-10T10:33:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58dffb700 1 -- 172.21.15.88:0/4241239963 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff584004390 con 0x7ff5900d2980 2023-08-10T10:33:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.147+0000 7ff58dffb700 1 -- 172.21.15.88:0/4241239963 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5840036a0 con 0x7ff5900d2980 2023-08-10T10:33:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 -- 172.21.15.88:0/4241239963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5900d2980 msgr2=0x7ff5900b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 --2- 172.21.15.88:0/4241239963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5900d2980 0x7ff5900b4980 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff5900b5af0 tx=0x7ff584009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 -- 172.21.15.88:0/4241239963 shutdown_connections 2023-08-10T10:33:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 --2- 172.21.15.88:0/4241239963 >> v2:172.21.15.187:3300/0 conn(0x7ff59015d180 0x7ff5900d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 --2- 172.21.15.88:0/4241239963 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5900d2980 0x7ff5900b4980 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 -- 172.21.15.88:0/4241239963 >> 172.21.15.88:0/4241239963 conn(0x7ff5900cf980 msgr2=0x7ff5900cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 -- 172.21.15.88:0/4241239963 shutdown_connections 2023-08-10T10:33:19.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.148+0000 7ff5957ff700 1 -- 172.21.15.88:0/4241239963 wait complete. 2023-08-10T10:33:19.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.150+0000 7ff5957ff700 1 Processor -- start 2023-08-10T10:33:19.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.150+0000 7ff5957ff700 1 -- start start 2023-08-10T10:33:19.154 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.151+0000 7ff5957ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5900b4ec0 0x7ff590150a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.151+0000 7ff5957ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 0x7ff5900c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.151+0000 7ff5957ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff5957ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900c8580 con 0x7ff59015d180 2023-08-10T10:33:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff5957ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff59015d600 con 0x7ff5900b4ec0 2023-08-10T10:33:19.155 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff5957ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5900cb930 con 0x7ff5900d2980 2023-08-10T10:33:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40210/0 (socket says 172.21.15.88:40210) 2023-08-10T10:33:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 -- 172.21.15.88:0/3611642173 learned_addr learned my addr 172.21.15.88:0/3611642173 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58effd700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5900b4ec0 0x7ff590150a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58e7fc700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 0x7ff5900c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 -- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 msgr2=0x7ff5900c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 0x7ff5900c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 -- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5900b4ec0 msgr2=0x7ff590150a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5900b4ec0 0x7ff590150a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58f7fe700 1 -- 172.21.15.88:0/3611642173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff584009550 con 0x7ff59015d180 2023-08-10T10:33:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.152+0000 7ff58e7fc700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 0x7ff5900c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff58f7fe700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff58800cc10 tx=0x7ff58800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58800ab10 con 0x7ff59015d180 2023-08-10T10:33:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58800ac70 con 0x7ff59015d180 2023-08-10T10:33:19.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff59015d8a0 con 0x7ff59015d180 2023-08-10T10:33:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588012420 con 0x7ff59015d180 2023-08-10T10:33:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.153+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5900cbc10 con 0x7ff59015d180 2023-08-10T10:33:19.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.154+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff59015ddc0 con 0x7ff59015d180 2023-08-10T10:33:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.155+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff588012580 con 0x7ff59015d180 2023-08-10T10:33:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.156+0000 7ff5777fe700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 0x7ff57c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.156+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff588089b30 con 0x7ff59015d180 2023-08-10T10:33:19.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.156+0000 7ff58effd700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 0x7ff57c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.156+0000 7ff58effd700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 0x7ff57c06d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff5900c9360 tx=0x7ff580009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.160+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7ff59015ddc0 con 0x7ff59015d180 2023-08-10T10:33:19.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.356+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff59015ddc0 con 0x7ff59015d180 2023-08-10T10:33:19.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.356+0000 7ff5777fe700 1 -- 172.21.15.88:0/3611642173 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff59015ddc0 con 0x7ff59015d180 2023-08-10T10:33:19.357 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 32 2023-08-10T10:33:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.358+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 msgr2=0x7ff57c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.358+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 0x7ff57c06d1a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff5900c9360 tx=0x7ff580009210 comp rx=0 tx=0).stop 2023-08-10T10:33:19.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.358+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 msgr2=0x7ff5900c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.358+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff58800cc10 tx=0x7ff58800cf20 comp rx=0 tx=0).stop 2023-08-10T10:33:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 shutdown_connections 2023-08-10T10:33:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff59015d180 0x7ff5900c8040 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5900b4ec0 0x7ff590150a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff57c06ace0 0x7ff57c06d1a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 --2- 172.21.15.88:0/3611642173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5900d2980 0x7ff5900c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 >> 172.21.15.88:0/3611642173 conn(0x7ff5900cf980 msgr2=0x7ff5900b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 shutdown_connections 2023-08-10T10:33:19.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.359+0000 7ff5957ff700 1 -- 172.21.15.88:0/3611642173 wait complete. 2023-08-10T10:33:19.378 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-10T10:33:19.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.574+0000 7f9ff45ff700 1 Processor -- start 2023-08-10T10:33:19.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.574+0000 7f9ff45ff700 1 -- start start 2023-08-10T10:33:19.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff45ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fec15cf20 0x7f9fec15e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff45ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fec0b5210 0x7f9fec0d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff45ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fec15e590 con 0x7f9fec0b8870 2023-08-10T10:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff45ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0cde30 con 0x7f9fec0b5210 2023-08-10T10:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff45ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fec0b8e30 con 0x7f9fec15cf20 2023-08-10T10:33:19.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff2b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fec0b5210 0x7f9fec0d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff2b9c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9fec0b5210 0x7f9fec0d1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40226/0 (socket says 172.21.15.88:40226) 2023-08-10T10:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.575+0000 7f9ff2b9c700 1 -- 172.21.15.88:0/190539109 learned_addr learned my addr 172.21.15.88:0/190539109 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff239b700 1 --2- 172.21.15.88:0/190539109 >> v2:172.21.15.187:3300/0 conn(0x7f9fec15cf20 0x7f9fec15e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff2b9c700 1 -- 172.21.15.88:0/190539109 >> v2:172.21.15.187:3300/0 conn(0x7f9fec15cf20 msgr2=0x7f9fec15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:19.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff2b9c700 1 --2- 172.21.15.88:0/190539109 >> v2:172.21.15.187:3300/0 conn(0x7f9fec15cf20 0x7f9fec15e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff2b9c700 1 -- 172.21.15.88:0/190539109 >> v1:172.21.15.187:6789/0 conn(0x7f9fec0b8870 legacy=0x7f9fec0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:19.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff2b9c700 1 -- 172.21.15.88:0/190539109 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fec0ce010 con 0x7f9fec0b5210 2023-08-10T10:33:19.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff2b9c700 1 --2- 172.21.15.88:0/190539109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b5210 0x7f9fec0d1350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06d190 tx=0x7f9fe400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1102c0b653696b5b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff1399700 1 -- 172.21.15.88:0/190539109 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe400e070 con 0x7f9fec0b5210 2023-08-10T10:33:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff1399700 1 -- 172.21.15.88:0/190539109 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe4003a20 con 0x7f9fec0b5210 2023-08-10T10:33:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.576+0000 7f9ff1399700 1 -- 172.21.15.88:0/190539109 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe4003dd0 con 0x7f9fec0b5210 2023-08-10T10:33:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 -- 172.21.15.88:0/190539109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b5210 msgr2=0x7f9fec0d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/190539109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b5210 0x7f9fec0d1350 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f9fec06d190 tx=0x7f9fe400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 -- 172.21.15.88:0/190539109 shutdown_connections 2023-08-10T10:33:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/190539109 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b5210 0x7f9fec0d1350 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/190539109 >> v2:172.21.15.187:3300/0 conn(0x7f9fec15cf20 0x7f9fec15e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 -- 172.21.15.88:0/190539109 >> 172.21.15.88:0/190539109 conn(0x7f9fec0d3080 msgr2=0x7f9fec0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:19.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 -- 172.21.15.88:0/190539109 shutdown_connections 2023-08-10T10:33:19.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.577+0000 7f9ff45ff700 1 -- 172.21.15.88:0/190539109 wait complete. 2023-08-10T10:33:19.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.579+0000 7f9ff45ff700 1 Processor -- start 2023-08-10T10:33:19.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.579+0000 7f9ff45ff700 1 -- start start 2023-08-10T10:33:19.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 0x7f9fec159530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 0x7f9fec1f9880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15ae00 con 0x7f9fec0b8870 2023-08-10T10:33:19.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec15a970 con 0x7f9fec15cf20 2023-08-10T10:33:19.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff45ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fec159d60 con 0x7f9fec0b5210 2023-08-10T10:33:19.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff1b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff1b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40242/0 (socket says 172.21.15.88:40242) 2023-08-10T10:33:19.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff1b9a700 1 -- 172.21.15.88:0/2723492546 learned_addr learned my addr 172.21.15.88:0/2723492546 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:19.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff1b9a700 1 -- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 msgr2=0x7f9fec159530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff2b9c700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 0x7f9fec1f9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff239b700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 0x7f9fec159530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.580+0000 7f9ff1b9a700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 0x7f9fec159530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff1b9a700 1 -- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 msgr2=0x7f9fec1f9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff1b9a700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 0x7f9fec1f9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff1b9a700 1 -- 172.21.15.88:0/2723492546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe4009b30 con 0x7f9fec0b8870 2023-08-10T10:33:19.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff2b9c700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 0x7f9fec1f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:19.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff239b700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 0x7f9fec159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:19.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff1b9a700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c4d0 tx=0x7f9fdc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011790 con 0x7f9fec0b8870 2023-08-10T10:33:19.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fdc0118f0 con 0x7f9fec0b8870 2023-08-10T10:33:19.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fdc011ca0 con 0x7f9fec0b8870 2023-08-10T10:33:19.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fec15a040 con 0x7f9fec0b8870 2023-08-10T10:33:19.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.581+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fec15a600 con 0x7f9fec0b8870 2023-08-10T10:33:19.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.582+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fec0cb240 con 0x7f9fec0b8870 2023-08-10T10:33:19.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.583+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9fdc01c460 con 0x7f9fec0b8870 2023-08-10T10:33:19.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.584+0000 7f9fe2ffd700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 0x7f9fd006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:19.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.584+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9fdc089560 con 0x7f9fec0b8870 2023-08-10T10:33:19.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.584+0000 7f9ff239b700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 0x7f9fd006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:19.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.585+0000 7f9ff239b700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 0x7f9fd006d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009820 tx=0x7f9fe8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:19.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.588+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9fdc054370 con 0x7f9fec0b8870 2023-08-10T10:33:19.814 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.814+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9fec0d0980 con 0x7f9fec0b8870 2023-08-10T10:33:19.815 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.814+0000 7f9fe2ffd700 1 -- 172.21.15.88:0/2723492546 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9fdc057990 con 0x7f9fec0b8870 2023-08-10T10:33:19.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.819+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 msgr2=0x7f9fd006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.819+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 0x7f9fd006d1a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009820 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2023-08-10T10:33:19.826 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.819+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 msgr2=0x7f9fec0b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:19.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.819+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c4d0 tx=0x7f9fdc00c890 comp rx=0 tx=0).stop 2023-08-10T10:33:19.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 shutdown_connections 2023-08-10T10:33:19.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fec15cf20 0x7f9fec1f9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.827 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9fd006ace0 0x7f9fd006d1a0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9fe8009820 tx=0x7f9fe8008040 comp rx=0 tx=0).stop 2023-08-10T10:33:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fec0b5210 0x7f9fec159530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 --2- 172.21.15.88:0/2723492546 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9fec0b8870 0x7f9fec0b3290 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9fdc00c4d0 tx=0x7f9fdc00c890 comp rx=0 tx=0).stop 2023-08-10T10:33:19.828 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.820+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 >> 172.21.15.88:0/2723492546 conn(0x7f9fec0d3080 msgr2=0x7f9fec0d18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.826+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 shutdown_connections 2023-08-10T10:33:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:19.826+0000 7f9ff45ff700 1 -- 172.21.15.88:0/2723492546 wait complete. 2023-08-10T10:33:19.829 INFO:teuthology.orchestra.run.smithi088.stderr:listed 0 entries 2023-08-10T10:33:19.856 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-08-10T10:33:19.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:19.857 DEBUG:teuthology.orchestra.run.smithi187:> sudo umount /home/ubuntu/cephtest/mnt.3 2023-08-10T10:33:19.966 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:33:19.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:19.967 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-10T10:33:20.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.025 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:33:20.072 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-10T10:33:20.072 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-10T10:33:20.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.073 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-10T10:33:20.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.145 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-10T10:33:20.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.217 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-08-10T10:33:20.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.337 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-08-10T10:33:20.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.387 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-08-10T10:33:20.461 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-08-10T10:33:20.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:20.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.465 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:33:20.513 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-10T10:33:20.513 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-10T10:33:20.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-10T10:33:20.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-10T10:33:20.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.675 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-08-10T10:33:20.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.801 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-08-10T10:33:20.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-10T10:33:20.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-08-10T10:33:20.924 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-08-10T10:33:20.927 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:33:20.928 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-10T10:33:20.936 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-10T10:33:20.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:33:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.133+0000 7fcf77bff700 1 Processor -- start 2023-08-10T10:33:21.134 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.133+0000 7fcf77bff700 1 -- start start 2023-08-10T10:33:21.136 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.134+0000 7fcf77bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf701593b0 0x7fcf70071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf77bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf700cb410 con 0x7fcf700ca630 2023-08-10T10:33:21.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf77bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7006af70 con 0x7fcf70159790 2023-08-10T10:33:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf77bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf700cab70 con 0x7fcf701593b0 2023-08-10T10:33:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf7619c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcf700ca630 0x7fcf700ccd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:43056/0 (socket says 172.21.15.88:43056) 2023-08-10T10:33:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf7619c700 1 -- 172.21.15.88:0/3447211361 learned_addr learned my addr 172.21.15.88:0/3447211361 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf7599b700 1 --2- 172.21.15.88:0/3447211361 >> v2:172.21.15.187:3300/0 conn(0x7fcf701593b0 0x7fcf70071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2737922437 0 0) 0x7fcf700cb410 con 0x7fcf700ca630 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf5c0035b0 con 0x7fcf700ca630 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.135+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955111482 0 0) 0x7fcf7006af70 con 0x7fcf70159790 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf700cb410 con 0x7fcf70159790 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf7599b700 1 -- 172.21.15.88:0/3447211361 >> v1:172.21.15.187:6789/0 conn(0x7fcf70159790 legacy=0x7fcf700c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf7599b700 1 -- 172.21.15.88:0/3447211361 >> v1:172.21.15.88:6789/0 conn(0x7fcf700ca630 legacy=0x7fcf700ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf7599b700 1 -- 172.21.15.88:0/3447211361 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf700cae50 con 0x7fcf701593b0 2023-08-10T10:33:21.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf7599b700 1 --2- 172.21.15.88:0/3447211361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70071220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009840 tx=0x7fcf6c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0cdad43fb20f644 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c011830 con 0x7fcf701593b0 2023-08-10T10:33:21.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c011990 con 0x7fcf701593b0 2023-08-10T10:33:21.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.136+0000 7fcf74999700 1 -- 172.21.15.88:0/3447211361 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c011d20 con 0x7fcf701593b0 2023-08-10T10:33:21.143 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 -- 172.21.15.88:0/3447211361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 msgr2=0x7fcf70071220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3447211361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70071220 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009840 tx=0x7fcf6c009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 -- 172.21.15.88:0/3447211361 shutdown_connections 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3447211361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70071220 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 -- 172.21.15.88:0/3447211361 >> 172.21.15.88:0/3447211361 conn(0x7fcf700ced50 msgr2=0x7fcf700cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:21.144 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 -- 172.21.15.88:0/3447211361 shutdown_connections 2023-08-10T10:33:21.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.137+0000 7fcf77bff700 1 -- 172.21.15.88:0/3447211361 wait complete. 2023-08-10T10:33:21.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.138+0000 7fcf77bff700 1 Processor -- start 2023-08-10T10:33:21.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.138+0000 7fcf77bff700 1 -- start start 2023-08-10T10:33:21.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.145 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf70159790 0x7fcf7015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700c5c40 con 0x7fcf700ca630 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700c1510 con 0x7fcf701593b0 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf77bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf700c8290 con 0x7fcf70159790 2023-08-10T10:33:21.146 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf7599b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf7599b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40246/0 (socket says 172.21.15.88:40246) 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf7599b700 1 -- 172.21.15.88:0/3828516989 learned_addr learned my addr 172.21.15.88:0/3828516989 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf7619c700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf70159790 0x7fcf7015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.139+0000 7fcf7519a700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 -- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf70159790 msgr2=0x7fcf7015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.147 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf70159790 0x7fcf7015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 -- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 msgr2=0x7fcf70159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 -- 172.21.15.88:0/3828516989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0094a0 con 0x7fcf700ca630 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7519a700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:21.148 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf7599b700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009b90 tx=0x7fcf6c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c01a7e0 con 0x7fcf700ca630 2023-08-10T10:33:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c01a940 con 0x7fcf700ca630 2023-08-10T10:33:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf700c8570 con 0x7fcf700ca630 2023-08-10T10:33:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c01acb0 con 0x7fcf700ca630 2023-08-10T10:33:21.149 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.140+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf700c6100 con 0x7fcf700ca630 2023-08-10T10:33:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.141+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf700c62f0 con 0x7fcf700ca630 2023-08-10T10:33:21.150 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.142+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcf6c022070 con 0x7fcf700ca630 2023-08-10T10:33:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.143+0000 7fcf667fc700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 0x7fcf5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.143+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcf6c08a4a0 con 0x7fcf700ca630 2023-08-10T10:33:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.143+0000 7fcf7519a700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 0x7fcf5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.144+0000 7fcf7519a700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 0x7fcf5406d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b0680 tx=0x7fcf60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.151 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.147+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fcf6c0552c0 con 0x7fcf700ca630 2023-08-10T10:33:21.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.342+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf700cc870 con 0x7fcf5406ace0 2023-08-10T10:33:21.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.356+0000 7fcf667fc700 1 -- 172.21.15.88:0/3828516989 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+392052 (secure 0 0 0) 0x7fcf60001c50 con 0x7fcf5406ace0 2023-08-10T10:33:21.362 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:21.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.360+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 msgr2=0x7fcf5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 0x7fcf5406d1a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcf700b0680 tx=0x7fcf60009040 comp rx=0 tx=0).stop 2023-08-10T10:33:21.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 msgr2=0x7fcf700bbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009b90 tx=0x7fcf6c004750 comp rx=0 tx=0).stop 2023-08-10T10:33:21.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 shutdown_connections 2023-08-10T10:33:21.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcf5406ace0 0x7fcf5406d1a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf70159790 0x7fcf7015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcf700ca630 0x7fcf700bbfd0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 --2- 172.21.15.88:0/3828516989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf701593b0 0x7fcf70159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 >> 172.21.15.88:0/3828516989 conn(0x7fcf700ced50 msgr2=0x7fcf7015cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:21.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 shutdown_connections 2023-08-10T10:33:21.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.361+0000 7fcf77bff700 1 -- 172.21.15.88:0/3828516989 wait complete. 2023-08-10T10:33:21.367 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:33:21.381 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2023-08-10T10:33:19.602243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":549918975,"num_objects":159,"num_object_clones":0,"num_object_copies":586,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":159,"num_whiteouts":0,"num_read":128,"num_read_kb":114,"num_write":1167,"num_write_kb":1023674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16539,"ondisk_log_size":16539,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":879020,"kb_used_data":617836,"kb_used_omap":13,"kb_used_meta":261106,"kb_avail":754095700,"statfs":{"total":773094113280,"available":772193996800,"internally_reserved":0,"allocated":632664064,"data_stored":631148283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":267372632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,9,2,3,58,37,8,2,5],"upper_bound":512},"perf_stat":{"commit_latency_ms":101,"apply_latency_ms":101,"commit_latency_ns":101000000,"apply_latency_ns":101000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":146992781,"num_objects":38,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":6,"num_read_kb":7,"num_write":365,"num_write_kb":627950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003296"},"pg_stats":[{"pgid":"4.3f","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.594991+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:33:12.594991+0000","last_peered":"2023-08-10T10:33:12.594991+0000","last_clean":"2023-08-10T10:33:12.594991+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:12.594991+0000","last_undegraded":"2023-08-10T10:33:12.594991+0000","last_fullsized":"2023-08-10T10:33:12.594991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'10","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611709+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:12.611709+0000","last_peered":"2023-08-10T10:33:12.611709+0000","last_clean":"2023-08-10T10:33:12.611709+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:12.611709+0000","last_undegraded":"2023-08-10T10:33:12.611709+0000","last_fullsized":"2023-08-10T10:33:12.611709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611097+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:12.611097+0000","last_peered":"2023-08-10T10:33:12.611097+0000","last_clean":"2023-08-10T10:33:12.611097+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:12.611097+0000","last_undegraded":"2023-08-10T10:33:12.611097+0000","last_fullsized":"2023-08-10T10:33:12.611097+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.075290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.605415+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:33:12.605415+0000","last_peered":"2023-08-10T10:33:12.605415+0000","last_clean":"2023-08-10T10:33:12.605415+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:12.605415+0000","last_undegraded":"2023-08-10T10:33:12.605415+0000","last_fullsized":"2023-08-10T10:33:12.605415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:59.927282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607721+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:33:12.607721+0000","last_peered":"2023-08-10T10:33:12.607721+0000","last_clean":"2023-08-10T10:33:12.607721+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:12.607721+0000","last_undegraded":"2023-08-10T10:33:12.607721+0000","last_fullsized":"2023-08-10T10:33:12.607721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611301+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:12.611301+0000","last_peered":"2023-08-10T10:33:12.611301+0000","last_clean":"2023-08-10T10:33:12.611301+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:12.611301+0000","last_undegraded":"2023-08-10T10:33:12.611301+0000","last_fullsized":"2023-08-10T10:33:12.611301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.385568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'12","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.610471+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:33:12.610471+0000","last_peered":"2023-08-10T10:33:12.610471+0000","last_clean":"2023-08-10T10:33:12.610471+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:12.610471+0000","last_undegraded":"2023-08-10T10:33:12.610471+0000","last_fullsized":"2023-08-10T10:33:12.610471+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:22.895395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.600852+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:12.600852+0000","last_peered":"2023-08-10T10:33:12.600852+0000","last_clean":"2023-08-10T10:33:12.600852+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:12.600852+0000","last_undegraded":"2023-08-10T10:33:12.600852+0000","last_fullsized":"2023-08-10T10:33:12.600852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'24","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.606416+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:12.606416+0000","last_peered":"2023-08-10T10:33:12.606416+0000","last_clean":"2023-08-10T10:33:12.606416+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:12.606416+0000","last_undegraded":"2023-08-10T10:33:12.606416+0000","last_fullsized":"2023-08-10T10:33:12.606416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:19.279630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.590879+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:33:12.590879+0000","last_peered":"2023-08-10T10:33:12.590879+0000","last_clean":"2023-08-10T10:33:12.590879+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:12.590879+0000","last_undegraded":"2023-08-10T10:33:12.590879+0000","last_fullsized":"2023-08-10T10:33:12.590879+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612629+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:33:12.612629+0000","last_peered":"2023-08-10T10:33:12.612629+0000","last_clean":"2023-08-10T10:33:12.612629+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:12.612629+0000","last_undegraded":"2023-08-10T10:33:12.612629+0000","last_fullsized":"2023-08-10T10:33:12.612629+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:54.096841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.608104+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:33:12.608104+0000","last_peered":"2023-08-10T10:33:12.608104+0000","last_clean":"2023-08-10T10:33:12.608104+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:12.608104+0000","last_undegraded":"2023-08-10T10:33:12.608104+0000","last_fullsized":"2023-08-10T10:33:12.608104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.605604+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:33:12.605604+0000","last_peered":"2023-08-10T10:33:12.605604+0000","last_clean":"2023-08-10T10:33:12.605604+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:12.605604+0000","last_undegraded":"2023-08-10T10:33:12.605604+0000","last_fullsized":"2023-08-10T10:33:12.605604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.598406+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:33:12.598406+0000","last_peered":"2023-08-10T10:33:12.598406+0000","last_clean":"2023-08-10T10:33:12.598406+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:12.598406+0000","last_undegraded":"2023-08-10T10:33:12.598406+0000","last_fullsized":"2023-08-10T10:33:12.598406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:45.102687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.610627+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:33:12.610627+0000","last_peered":"2023-08-10T10:33:12.610627+0000","last_clean":"2023-08-10T10:33:12.610627+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:33:12.610627+0000","last_undegraded":"2023-08-10T10:33:12.610627+0000","last_fullsized":"2023-08-10T10:33:12.610627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611014+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:12.611014+0000","last_peered":"2023-08-10T10:33:12.611014+0000","last_clean":"2023-08-10T10:33:12.611014+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:12.611014+0000","last_undegraded":"2023-08-10T10:33:12.611014+0000","last_fullsized":"2023-08-10T10:33:12.611014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:54.252670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.609586+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:33:12.609586+0000","last_peered":"2023-08-10T10:33:12.609586+0000","last_clean":"2023-08-10T10:33:12.609586+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:33:12.609586+0000","last_undegraded":"2023-08-10T10:33:12.609586+0000","last_fullsized":"2023-08-10T10:33:12.609586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:10.276146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.603337+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:33:12.603337+0000","last_peered":"2023-08-10T10:33:12.603337+0000","last_clean":"2023-08-10T10:33:12.603337+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:12.603337+0000","last_undegraded":"2023-08-10T10:33:12.603337+0000","last_fullsized":"2023-08-10T10:33:12.603337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:41.704636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.603772+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:33:12.603772+0000","last_peered":"2023-08-10T10:33:12.603772+0000","last_clean":"2023-08-10T10:33:12.603772+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:12.603772+0000","last_undegraded":"2023-08-10T10:33:12.603772+0000","last_fullsized":"2023-08-10T10:33:12.603772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:46.253304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.606208+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:33:12.606208+0000","last_peered":"2023-08-10T10:33:12.606208+0000","last_clean":"2023-08-10T10:33:12.606208+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:12.606208+0000","last_undegraded":"2023-08-10T10:33:12.606208+0000","last_fullsized":"2023-08-10T10:33:12.606208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:28.531313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607577+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:12.607577+0000","last_peered":"2023-08-10T10:33:12.607577+0000","last_clean":"2023-08-10T10:33:12.607577+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:12.607577+0000","last_undegraded":"2023-08-10T10:33:12.607577+0000","last_fullsized":"2023-08-10T10:33:12.607577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613677+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:33:12.613677+0000","last_peered":"2023-08-10T10:33:12.613677+0000","last_clean":"2023-08-10T10:33:12.613677+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:12.613677+0000","last_undegraded":"2023-08-10T10:33:12.613677+0000","last_fullsized":"2023-08-10T10:33:12.613677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611372+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:33:12.611372+0000","last_peered":"2023-08-10T10:33:12.611372+0000","last_clean":"2023-08-10T10:33:12.611372+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:12.611372+0000","last_undegraded":"2023-08-10T10:33:12.611372+0000","last_fullsized":"2023-08-10T10:33:12.611372+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607123+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:12.607123+0000","last_peered":"2023-08-10T10:33:12.607123+0000","last_clean":"2023-08-10T10:33:12.607123+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:12.607123+0000","last_undegraded":"2023-08-10T10:33:12.607123+0000","last_fullsized":"2023-08-10T10:33:12.607123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612753+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:33:12.612753+0000","last_peered":"2023-08-10T10:33:12.612753+0000","last_clean":"2023-08-10T10:33:12.612753+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:12.612753+0000","last_undegraded":"2023-08-10T10:33:12.612753+0000","last_fullsized":"2023-08-10T10:33:12.612753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612531+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:33:12.612531+0000","last_peered":"2023-08-10T10:33:12.612531+0000","last_clean":"2023-08-10T10:33:12.612531+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:12.612531+0000","last_undegraded":"2023-08-10T10:33:12.612531+0000","last_fullsized":"2023-08-10T10:33:12.612531+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.586920+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:33:12.586920+0000","last_peered":"2023-08-10T10:33:12.586920+0000","last_clean":"2023-08-10T10:33:12.586920+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:12.586920+0000","last_undegraded":"2023-08-10T10:33:12.586920+0000","last_fullsized":"2023-08-10T10:33:12.586920+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'441","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.497784+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:14.497784+0000","last_peered":"2023-08-10T10:33:14.497784+0000","last_clean":"2023-08-10T10:33:14.497784+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:14.497784+0000","last_undegraded":"2023-08-10T10:33:14.497784+0000","last_fullsized":"2023-08-10T10:33:14.497784+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:11:32.547675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296882+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:31:15.296882+0000","last_peered":"2023-08-10T10:31:15.296882+0000","last_clean":"2023-08-10T10:31:15.296882+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:31:15.296882+0000","last_undegraded":"2023-08-10T10:31:15.296882+0000","last_fullsized":"2023-08-10T10:31:15.296882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:35:24.254384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612666+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:12.612666+0000","last_peered":"2023-08-10T10:33:12.612666+0000","last_clean":"2023-08-10T10:33:12.612666+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:12.612666+0000","last_undegraded":"2023-08-10T10:33:12.612666+0000","last_fullsized":"2023-08-10T10:33:12.612666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'466","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.552082+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:33:14.552082+0000","last_peered":"2023-08-10T10:33:14.552082+0000","last_clean":"2023-08-10T10:33:14.552082+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:33:14.552082+0000","last_undegraded":"2023-08-10T10:33:14.552082+0000","last_fullsized":"2023-08-10T10:33:14.552082+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:28.669274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558123+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:31:15.558123+0000","last_peered":"2023-08-10T10:31:15.558123+0000","last_clean":"2023-08-10T10:31:15.558123+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:31:15.558123+0000","last_undegraded":"2023-08-10T10:31:15.558123+0000","last_fullsized":"2023-08-10T10:31:15.558123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.099809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'10","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.593842+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:33:12.593842+0000","last_peered":"2023-08-10T10:33:12.593842+0000","last_clean":"2023-08-10T10:33:12.593842+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:12.593842+0000","last_undegraded":"2023-08-10T10:33:12.593842+0000","last_fullsized":"2023-08-10T10:33:12.593842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'472","reported_seq":490,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.552708+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:14.552708+0000","last_peered":"2023-08-10T10:33:14.552708+0000","last_clean":"2023-08-10T10:33:14.552708+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:14.552708+0000","last_undegraded":"2023-08-10T10:33:14.552708+0000","last_fullsized":"2023-08-10T10:33:14.552708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297997+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:31:15.297997+0000","last_peered":"2023-08-10T10:31:15.297997+0000","last_clean":"2023-08-10T10:31:15.297997+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:31:15.297997+0000","last_undegraded":"2023-08-10T10:31:15.297997+0000","last_fullsized":"2023-08-10T10:31:15.297997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.585689+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:33:12.585689+0000","last_peered":"2023-08-10T10:33:12.585689+0000","last_clean":"2023-08-10T10:33:12.585689+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:12.585689+0000","last_undegraded":"2023-08-10T10:33:12.585689+0000","last_fullsized":"2023-08-10T10:33:12.585689+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'459","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.680225+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:33:12.680225+0000","last_peered":"2023-08-10T10:33:12.680225+0000","last_clean":"2023-08-10T10:33:12.680225+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:33:12.680225+0000","last_undegraded":"2023-08-10T10:33:12.680225+0000","last_fullsized":"2023-08-10T10:33:12.680225+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:11.329930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.566167+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:32:59.566167+0000","last_peered":"2023-08-10T10:32:59.566167+0000","last_clean":"2023-08-10T10:32:59.566167+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:32:59.566167+0000","last_undegraded":"2023-08-10T10:32:59.566167+0000","last_fullsized":"2023-08-10T10:32:59.566167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:25.133924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612658+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:33:12.612658+0000","last_peered":"2023-08-10T10:33:12.612658+0000","last_clean":"2023-08-10T10:33:12.612658+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:12.612658+0000","last_undegraded":"2023-08-10T10:33:12.612658+0000","last_fullsized":"2023-08-10T10:33:12.612658+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'458","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.563167+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:14.563167+0000","last_peered":"2023-08-10T10:33:14.563167+0000","last_clean":"2023-08-10T10:33:14.563167+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:14.563167+0000","last_undegraded":"2023-08-10T10:33:14.563167+0000","last_fullsized":"2023-08-10T10:33:14.563167+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:49.157469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27262976,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.644932+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:32:59.644932+0000","last_peered":"2023-08-10T10:32:59.644932+0000","last_clean":"2023-08-10T10:32:59.644932+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:32:59.644932+0000","last_undegraded":"2023-08-10T10:32:59.644932+0000","last_fullsized":"2023-08-10T10:32:59.644932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.602601+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:12.602601+0000","last_peered":"2023-08-10T10:33:12.602601+0000","last_clean":"2023-08-10T10:33:12.602601+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:12.602601+0000","last_undegraded":"2023-08-10T10:33:12.602601+0000","last_fullsized":"2023-08-10T10:33:12.602601+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'454","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.635098+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:14.635098+0000","last_peered":"2023-08-10T10:33:14.635098+0000","last_clean":"2023-08-10T10:33:14.635098+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:14.635098+0000","last_undegraded":"2023-08-10T10:33:14.635098+0000","last_fullsized":"2023-08-10T10:33:14.635098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:55.391226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'10","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:09.644139+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:33:09.644139+0000","last_peered":"2023-08-10T10:33:09.644139+0000","last_clean":"2023-08-10T10:33:09.644139+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:09.644139+0000","last_undegraded":"2023-08-10T10:33:09.644139+0000","last_fullsized":"2023-08-10T10:33:09.644139+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612231+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:33:12.612231+0000","last_peered":"2023-08-10T10:33:12.612231+0000","last_clean":"2023-08-10T10:33:12.612231+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:12.612231+0000","last_undegraded":"2023-08-10T10:33:12.612231+0000","last_fullsized":"2023-08-10T10:33:12.612231+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:40:31.121005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'451","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.593671+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:14.593671+0000","last_peered":"2023-08-10T10:33:14.593671+0000","last_clean":"2023-08-10T10:33:14.593671+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:14.593671+0000","last_undegraded":"2023-08-10T10:33:14.593671+0000","last_fullsized":"2023-08-10T10:33:14.593671+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:35.104002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'553","reported_seq":579,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.562394+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:33:12.562394+0000","last_peered":"2023-08-10T10:33:12.562394+0000","last_clean":"2023-08-10T10:33:12.562394+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:12.562394+0000","last_undegraded":"2023-08-10T10:33:12.562394+0000","last_fullsized":"2023-08-10T10:33:12.562394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":553,"log_dups_size":0,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:21.332327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1964693,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":552,"num_write_kb":2333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.602716+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:12.602716+0000","last_peered":"2023-08-10T10:33:12.602716+0000","last_clean":"2023-08-10T10:33:12.602716+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:12.602716+0000","last_undegraded":"2023-08-10T10:33:12.602716+0000","last_fullsized":"2023-08-10T10:33:12.602716+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:17.491868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'485","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.634404+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:14.634404+0000","last_peered":"2023-08-10T10:33:14.634404+0000","last_clean":"2023-08-10T10:33:14.634404+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:14.634404+0000","last_undegraded":"2023-08-10T10:33:14.634404+0000","last_fullsized":"2023-08-10T10:33:14.634404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:30.844193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297505+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:31:15.297505+0000","last_peered":"2023-08-10T10:31:15.297505+0000","last_clean":"2023-08-10T10:31:15.297505+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:31:15.297505+0000","last_undegraded":"2023-08-10T10:31:15.297505+0000","last_fullsized":"2023-08-10T10:31:15.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'17","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.589160+0000","last_change":"2023-08-10T10:31:15.344082+0000","last_active":"2023-08-10T10:33:12.589160+0000","last_peered":"2023-08-10T10:33:12.589160+0000","last_clean":"2023-08-10T10:33:12.589160+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:12.589160+0000","last_undegraded":"2023-08-10T10:33:12.589160+0000","last_fullsized":"2023-08-10T10:33:12.589160+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:16.251149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'446","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.409332+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:12.409332+0000","last_peered":"2023-08-10T10:33:12.409332+0000","last_clean":"2023-08-10T10:33:12.409332+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:12.409332+0000","last_undegraded":"2023-08-10T10:33:12.409332+0000","last_fullsized":"2023-08-10T10:33:12.409332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:47.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298926+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:31:15.298926+0000","last_peered":"2023-08-10T10:31:15.298926+0000","last_clean":"2023-08-10T10:31:15.298926+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:31:15.298926+0000","last_undegraded":"2023-08-10T10:31:15.298926+0000","last_fullsized":"2023-08-10T10:31:15.298926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:49.308799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.587226+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:33:12.587226+0000","last_peered":"2023-08-10T10:33:12.587226+0000","last_clean":"2023-08-10T10:33:12.587226+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:33:12.587226+0000","last_undegraded":"2023-08-10T10:33:12.587226+0000","last_fullsized":"2023-08-10T10:33:12.587226+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:39.485653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'444","reported_seq":462,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.624839+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:12.624839+0000","last_peered":"2023-08-10T10:33:12.624839+0000","last_clean":"2023-08-10T10:33:12.624839+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:12.624839+0000","last_undegraded":"2023-08-10T10:33:12.624839+0000","last_fullsized":"2023-08-10T10:33:12.624839+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:55.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.649027+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:32:54.649027+0000","last_peered":"2023-08-10T10:32:54.649027+0000","last_clean":"2023-08-10T10:32:54.649027+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:32:54.649027+0000","last_undegraded":"2023-08-10T10:32:54.649027+0000","last_fullsized":"2023-08-10T10:32:54.649027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607619+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:33:12.607619+0000","last_peered":"2023-08-10T10:33:12.607619+0000","last_clean":"2023-08-10T10:33:12.607619+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:33:12.607619+0000","last_undegraded":"2023-08-10T10:33:12.607619+0000","last_fullsized":"2023-08-10T10:33:12.607619+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'502","reported_seq":520,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.626744+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:14.626744+0000","last_peered":"2023-08-10T10:33:14.626744+0000","last_clean":"2023-08-10T10:33:14.626744+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:14.626744+0000","last_undegraded":"2023-08-10T10:33:14.626744+0000","last_fullsized":"2023-08-10T10:33:14.626744+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:26.950178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.644202+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:32:54.644202+0000","last_peered":"2023-08-10T10:32:54.644202+0000","last_clean":"2023-08-10T10:32:54.644202+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:32:54.644202+0000","last_undegraded":"2023-08-10T10:32:54.644202+0000","last_fullsized":"2023-08-10T10:32:54.644202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:28.578497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.604339+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:12.604339+0000","last_peered":"2023-08-10T10:33:12.604339+0000","last_clean":"2023-08-10T10:33:12.604339+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:12.604339+0000","last_undegraded":"2023-08-10T10:33:12.604339+0000","last_fullsized":"2023-08-10T10:33:12.604339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:53.894741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'480","reported_seq":498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.482555+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:14.482555+0000","last_peered":"2023-08-10T10:33:14.482555+0000","last_clean":"2023-08-10T10:33:14.482555+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:14.482555+0000","last_undegraded":"2023-08-10T10:33:14.482555+0000","last_fullsized":"2023-08-10T10:33:14.482555+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":480,"log_dups_size":0,"ondisk_log_size":480,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:51.590601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297435+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:31:15.297435+0000","last_peered":"2023-08-10T10:31:15.297435+0000","last_clean":"2023-08-10T10:31:15.297435+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:31:15.297435+0000","last_undegraded":"2023-08-10T10:31:15.297435+0000","last_fullsized":"2023-08-10T10:31:15.297435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:14.302383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.585216+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:12.585216+0000","last_peered":"2023-08-10T10:33:12.585216+0000","last_clean":"2023-08-10T10:33:12.585216+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:12.585216+0000","last_undegraded":"2023-08-10T10:33:12.585216+0000","last_fullsized":"2023-08-10T10:33:12.585216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:26.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'493","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.676018+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:33:12.676018+0000","last_peered":"2023-08-10T10:33:12.676018+0000","last_clean":"2023-08-10T10:33:12.676018+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:12.676018+0000","last_undegraded":"2023-08-10T10:33:12.676018+0000","last_fullsized":"2023-08-10T10:33:12.676018+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24117248,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298234+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:31:15.298234+0000","last_peered":"2023-08-10T10:31:15.298234+0000","last_clean":"2023-08-10T10:31:15.298234+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:31:15.298234+0000","last_undegraded":"2023-08-10T10:31:15.298234+0000","last_fullsized":"2023-08-10T10:31:15.298234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:03.007876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'10","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612592+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:12.612592+0000","last_peered":"2023-08-10T10:33:12.612592+0000","last_clean":"2023-08-10T10:33:12.612592+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:12.612592+0000","last_undegraded":"2023-08-10T10:33:12.612592+0000","last_fullsized":"2023-08-10T10:33:12.612592+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:35.261347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'469","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.589379+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:33:14.589379+0000","last_peered":"2023-08-10T10:33:14.589379+0000","last_clean":"2023-08-10T10:33:14.589379+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:14.589379+0000","last_undegraded":"2023-08-10T10:33:14.589379+0000","last_fullsized":"2023-08-10T10:33:14.589379+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297852+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:31:15.297852+0000","last_peered":"2023-08-10T10:31:15.297852+0000","last_clean":"2023-08-10T10:31:15.297852+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:31:15.297852+0000","last_undegraded":"2023-08-10T10:31:15.297852+0000","last_fullsized":"2023-08-10T10:31:15.297852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'10","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613277+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:33:12.613277+0000","last_peered":"2023-08-10T10:33:12.613277+0000","last_clean":"2023-08-10T10:33:12.613277+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:12.613277+0000","last_undegraded":"2023-08-10T10:33:12.613277+0000","last_fullsized":"2023-08-10T10:33:12.613277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:38.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'455","reported_seq":473,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.557489+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:33:14.557489+0000","last_peered":"2023-08-10T10:33:14.557489+0000","last_clean":"2023-08-10T10:33:14.557489+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:14.557489+0000","last_undegraded":"2023-08-10T10:33:14.557489+0000","last_fullsized":"2023-08-10T10:33:14.557489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:00.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340760+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:31:15.340760+0000","last_peered":"2023-08-10T10:31:15.340760+0000","last_clean":"2023-08-10T10:31:15.340760+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:31:15.340760+0000","last_undegraded":"2023-08-10T10:31:15.340760+0000","last_fullsized":"2023-08-10T10:31:15.340760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:16.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613575+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:33:12.613575+0000","last_peered":"2023-08-10T10:33:12.613575+0000","last_clean":"2023-08-10T10:33:12.613575+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:12.613575+0000","last_undegraded":"2023-08-10T10:33:12.613575+0000","last_fullsized":"2023-08-10T10:33:12.613575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'439","reported_seq":457,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.630956+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:33:12.630956+0000","last_peered":"2023-08-10T10:33:12.630956+0000","last_clean":"2023-08-10T10:33:12.630956+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:12.630956+0000","last_undegraded":"2023-08-10T10:33:12.630956+0000","last_fullsized":"2023-08-10T10:33:12.630956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:29.585039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.564548+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:32:59.564548+0000","last_peered":"2023-08-10T10:32:59.564548+0000","last_clean":"2023-08-10T10:32:59.564548+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:32:59.564548+0000","last_undegraded":"2023-08-10T10:32:59.564548+0000","last_fullsized":"2023-08-10T10:32:59.564548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:19.074943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'10","reported_seq":34,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.608189+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:12.608189+0000","last_peered":"2023-08-10T10:33:12.608189+0000","last_clean":"2023-08-10T10:33:12.608189+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:12.608189+0000","last_undegraded":"2023-08-10T10:33:12.608189+0000","last_fullsized":"2023-08-10T10:33:12.608189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:41.250265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'473","reported_seq":491,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.671078+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:12.671078+0000","last_peered":"2023-08-10T10:33:12.671078+0000","last_clean":"2023-08-10T10:33:12.671078+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:12.671078+0000","last_undegraded":"2023-08-10T10:33:12.671078+0000","last_fullsized":"2023-08-10T10:33:12.671078+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:23.334412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132118+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:31:16.132118+0000","last_peered":"2023-08-10T10:31:16.132118+0000","last_clean":"2023-08-10T10:31:16.132118+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:31:16.132118+0000","last_undegraded":"2023-08-10T10:31:16.132118+0000","last_fullsized":"2023-08-10T10:31:16.132118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:48.763588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607670+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:33:12.607670+0000","last_peered":"2023-08-10T10:33:12.607670+0000","last_clean":"2023-08-10T10:33:12.607670+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:12.607670+0000","last_undegraded":"2023-08-10T10:33:12.607670+0000","last_fullsized":"2023-08-10T10:33:12.607670+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:23.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'452","reported_seq":470,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.632634+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:14.632634+0000","last_peered":"2023-08-10T10:33:14.632634+0000","last_clean":"2023-08-10T10:33:14.632634+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:14.632634+0000","last_undegraded":"2023-08-10T10:33:14.632634+0000","last_fullsized":"2023-08-10T10:33:14.632634+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:36.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.647488+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:32:44.647488+0000","last_peered":"2023-08-10T10:32:44.647488+0000","last_clean":"2023-08-10T10:32:44.647488+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:32:44.647488+0000","last_undegraded":"2023-08-10T10:32:44.647488+0000","last_fullsized":"2023-08-10T10:32:44.647488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:17.232518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.602455+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:33:12.602455+0000","last_peered":"2023-08-10T10:33:12.602455+0000","last_clean":"2023-08-10T10:33:12.602455+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:12.602455+0000","last_undegraded":"2023-08-10T10:33:12.602455+0000","last_fullsized":"2023-08-10T10:33:12.602455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:54:47.483257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'460","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:07.894729+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:07.894729+0000","last_peered":"2023-08-10T10:33:07.894729+0000","last_clean":"2023-08-10T10:33:07.894729+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:07.894729+0000","last_undegraded":"2023-08-10T10:33:07.894729+0000","last_fullsized":"2023-08-10T10:33:07.894729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.041993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297869+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:31:15.297869+0000","last_peered":"2023-08-10T10:31:15.297869+0000","last_clean":"2023-08-10T10:31:15.297869+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:31:15.297869+0000","last_undegraded":"2023-08-10T10:31:15.297869+0000","last_fullsized":"2023-08-10T10:31:15.297869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613088+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:33:12.613088+0000","last_peered":"2023-08-10T10:33:12.613088+0000","last_clean":"2023-08-10T10:33:12.613088+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:12.613088+0000","last_undegraded":"2023-08-10T10:33:12.613088+0000","last_fullsized":"2023-08-10T10:33:12.613088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'460","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.657696+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:12.657696+0000","last_peered":"2023-08-10T10:33:12.657696+0000","last_clean":"2023-08-10T10:33:12.657696+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:12.657696+0000","last_undegraded":"2023-08-10T10:33:12.657696+0000","last_fullsized":"2023-08-10T10:33:12.657696+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:21.282539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558794+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:31:15.558794+0000","last_peered":"2023-08-10T10:31:15.558794+0000","last_clean":"2023-08-10T10:31:15.558794+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:31:15.558794+0000","last_undegraded":"2023-08-10T10:31:15.558794+0000","last_fullsized":"2023-08-10T10:31:15.558794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:20.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.521825+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:33:04.521825+0000","last_peered":"2023-08-10T10:33:04.521825+0000","last_clean":"2023-08-10T10:33:04.521825+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:04.521825+0000","last_undegraded":"2023-08-10T10:33:04.521825+0000","last_fullsized":"2023-08-10T10:33:04.521825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:46.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611974+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:33:12.611974+0000","last_peered":"2023-08-10T10:33:12.611974+0000","last_clean":"2023-08-10T10:33:12.611974+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:12.611974+0000","last_undegraded":"2023-08-10T10:33:12.611974+0000","last_fullsized":"2023-08-10T10:33:12.611974+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:33.490533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'459","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.380438+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:14.380438+0000","last_peered":"2023-08-10T10:33:14.380438+0000","last_clean":"2023-08-10T10:33:14.380438+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:14.380438+0000","last_undegraded":"2023-08-10T10:33:14.380438+0000","last_fullsized":"2023-08-10T10:33:14.380438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.379842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340578+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:31:15.340578+0000","last_peered":"2023-08-10T10:31:15.340578+0000","last_clean":"2023-08-10T10:31:15.340578+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:31:15.340578+0000","last_undegraded":"2023-08-10T10:31:15.340578+0000","last_fullsized":"2023-08-10T10:31:15.340578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:50.341770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298059+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:31:15.298059+0000","last_peered":"2023-08-10T10:31:15.298059+0000","last_clean":"2023-08-10T10:31:15.298059+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:31:15.298059+0000","last_undegraded":"2023-08-10T10:31:15.298059+0000","last_fullsized":"2023-08-10T10:31:15.298059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:07.488469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.611967+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:33:12.611967+0000","last_peered":"2023-08-10T10:33:12.611967+0000","last_clean":"2023-08-10T10:33:12.611967+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:12.611967+0000","last_undegraded":"2023-08-10T10:33:12.611967+0000","last_fullsized":"2023-08-10T10:33:12.611967+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:35.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'413","reported_seq":430,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.679960+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:33:12.679960+0000","last_peered":"2023-08-10T10:33:12.679960+0000","last_clean":"2023-08-10T10:33:12.679960+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:12.679960+0000","last_undegraded":"2023-08-10T10:33:12.679960+0000","last_fullsized":"2023-08-10T10:33:12.679960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:37.499897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.295972+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:31:15.295972+0000","last_peered":"2023-08-10T10:31:15.295972+0000","last_clean":"2023-08-10T10:31:15.295972+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:31:15.295972+0000","last_undegraded":"2023-08-10T10:31:15.295972+0000","last_fullsized":"2023-08-10T10:31:15.295972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:02.669208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:34.627598+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:32:34.627598+0000","last_peered":"2023-08-10T10:32:34.627598+0000","last_clean":"2023-08-10T10:32:34.627598+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:32:34.627598+0000","last_undegraded":"2023-08-10T10:32:34.627598+0000","last_fullsized":"2023-08-10T10:32:34.627598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:24.427296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613211+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:33:12.613211+0000","last_peered":"2023-08-10T10:33:12.613211+0000","last_clean":"2023-08-10T10:33:12.613211+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:12.613211+0000","last_undegraded":"2023-08-10T10:33:12.613211+0000","last_fullsized":"2023-08-10T10:33:12.613211+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'451","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.352928+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:14.352928+0000","last_peered":"2023-08-10T10:33:14.352928+0000","last_clean":"2023-08-10T10:33:14.352928+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:14.352928+0000","last_undegraded":"2023-08-10T10:33:14.352928+0000","last_fullsized":"2023-08-10T10:33:14.352928+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340660+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:31:15.340660+0000","last_peered":"2023-08-10T10:31:15.340660+0000","last_clean":"2023-08-10T10:31:15.340660+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:31:15.340660+0000","last_undegraded":"2023-08-10T10:31:15.340660+0000","last_fullsized":"2023-08-10T10:31:15.340660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:12.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296544+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:31:15.296544+0000","last_peered":"2023-08-10T10:31:15.296544+0000","last_clean":"2023-08-10T10:31:15.296544+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:31:15.296544+0000","last_undegraded":"2023-08-10T10:31:15.296544+0000","last_fullsized":"2023-08-10T10:31:15.296544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:42.837063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298242+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:31:15.298242+0000","last_peered":"2023-08-10T10:31:15.298242+0000","last_clean":"2023-08-10T10:31:15.298242+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:31:15.298242+0000","last_undegraded":"2023-08-10T10:31:15.298242+0000","last_fullsized":"2023-08-10T10:31:15.298242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:38.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.608261+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:33:12.608261+0000","last_peered":"2023-08-10T10:33:12.608261+0000","last_clean":"2023-08-10T10:33:12.608261+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:12.608261+0000","last_undegraded":"2023-08-10T10:33:12.608261+0000","last_fullsized":"2023-08-10T10:33:12.608261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:07.362708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'423","reported_seq":441,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.624747+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:12.624747+0000","last_peered":"2023-08-10T10:33:12.624747+0000","last_clean":"2023-08-10T10:33:12.624747+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:12.624747+0000","last_undegraded":"2023-08-10T10:33:12.624747+0000","last_fullsized":"2023-08-10T10:33:12.624747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.363842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296820+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:31:15.296820+0000","last_peered":"2023-08-10T10:31:15.296820+0000","last_clean":"2023-08-10T10:31:15.296820+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:31:15.296820+0000","last_undegraded":"2023-08-10T10:31:15.296820+0000","last_fullsized":"2023-08-10T10:31:15.296820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:11.201211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'13","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.614319+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:33:12.614319+0000","last_peered":"2023-08-10T10:33:12.614319+0000","last_clean":"2023-08-10T10:33:12.614319+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:12.614319+0000","last_undegraded":"2023-08-10T10:33:12.614319+0000","last_fullsized":"2023-08-10T10:33:12.614319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:34.274732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6444,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":14,"num_write":12,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.614401+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:33:12.614401+0000","last_peered":"2023-08-10T10:33:12.614401+0000","last_clean":"2023-08-10T10:33:12.614401+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:12.614401+0000","last_undegraded":"2023-08-10T10:33:12.614401+0000","last_fullsized":"2023-08-10T10:33:12.614401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'469","reported_seq":487,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.566585+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:33:14.566585+0000","last_peered":"2023-08-10T10:33:14.566585+0000","last_clean":"2023-08-10T10:33:14.566585+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:33:14.566585+0000","last_undegraded":"2023-08-10T10:33:14.566585+0000","last_fullsized":"2023-08-10T10:33:14.566585+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:25.203845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297805+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:31:15.297805+0000","last_peered":"2023-08-10T10:31:15.297805+0000","last_clean":"2023-08-10T10:31:15.297805+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:31:15.297805+0000","last_undegraded":"2023-08-10T10:31:15.297805+0000","last_fullsized":"2023-08-10T10:31:15.297805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:40.440122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628271+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:32:39.628271+0000","last_peered":"2023-08-10T10:32:39.628271+0000","last_clean":"2023-08-10T10:32:39.628271+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:32:39.628271+0000","last_undegraded":"2023-08-10T10:32:39.628271+0000","last_fullsized":"2023-08-10T10:32:39.628271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.600691+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:33:12.600691+0000","last_peered":"2023-08-10T10:33:12.600691+0000","last_clean":"2023-08-10T10:33:12.600691+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:12.600691+0000","last_undegraded":"2023-08-10T10:33:12.600691+0000","last_fullsized":"2023-08-10T10:33:12.600691+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'506","reported_seq":524,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.660937+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:12.660937+0000","last_peered":"2023-08-10T10:33:12.660937+0000","last_clean":"2023-08-10T10:33:12.660937+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:12.660937+0000","last_undegraded":"2023-08-10T10:33:12.660937+0000","last_fullsized":"2023-08-10T10:33:12.660937+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":506,"log_dups_size":0,"ondisk_log_size":506,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:24.347845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.638107+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:32:44.638107+0000","last_peered":"2023-08-10T10:32:44.638107+0000","last_clean":"2023-08-10T10:32:44.638107+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:32:44.638107+0000","last_undegraded":"2023-08-10T10:32:44.638107+0000","last_fullsized":"2023-08-10T10:32:44.638107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:37.634596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558852+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:31:15.558852+0000","last_peered":"2023-08-10T10:31:15.558852+0000","last_clean":"2023-08-10T10:31:15.558852+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:31:15.558852+0000","last_undegraded":"2023-08-10T10:31:15.558852+0000","last_fullsized":"2023-08-10T10:31:15.558852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:39.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.602737+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:33:12.602737+0000","last_peered":"2023-08-10T10:33:12.602737+0000","last_clean":"2023-08-10T10:33:12.602737+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:12.602737+0000","last_undegraded":"2023-08-10T10:33:12.602737+0000","last_fullsized":"2023-08-10T10:33:12.602737+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:41.589758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'448","reported_seq":466,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.624973+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:12.624973+0000","last_peered":"2023-08-10T10:33:12.624973+0000","last_clean":"2023-08-10T10:33:12.624973+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:12.624973+0000","last_undegraded":"2023-08-10T10:33:12.624973+0000","last_fullsized":"2023-08-10T10:33:12.624973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:11.307754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132519+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:31:16.132519+0000","last_peered":"2023-08-10T10:31:16.132519+0000","last_clean":"2023-08-10T10:31:16.132519+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:31:16.132519+0000","last_undegraded":"2023-08-10T10:31:16.132519+0000","last_fullsized":"2023-08-10T10:31:16.132519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:08.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'11","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:08.559415+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:33:08.559415+0000","last_peered":"2023-08-10T10:33:08.559415+0000","last_clean":"2023-08-10T10:33:08.559415+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:08.559415+0000","last_undegraded":"2023-08-10T10:33:08.559415+0000","last_fullsized":"2023-08-10T10:33:08.559415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'9","reported_seq":33,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.599996+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:12.599996+0000","last_peered":"2023-08-10T10:33:12.599996+0000","last_clean":"2023-08-10T10:33:12.599996+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:12.599996+0000","last_undegraded":"2023-08-10T10:33:12.599996+0000","last_fullsized":"2023-08-10T10:33:12.599996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:22.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'432","reported_seq":450,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.454541+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:33:14.454541+0000","last_peered":"2023-08-10T10:33:14.454541+0000","last_clean":"2023-08-10T10:33:14.454541+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:14.454541+0000","last_undegraded":"2023-08-10T10:33:14.454541+0000","last_fullsized":"2023-08-10T10:33:14.454541+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:14.330929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.299995+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:31:15.299995+0000","last_peered":"2023-08-10T10:31:15.299995+0000","last_clean":"2023-08-10T10:31:15.299995+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:31:15.299995+0000","last_undegraded":"2023-08-10T10:31:15.299995+0000","last_fullsized":"2023-08-10T10:31:15.299995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'16","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.613723+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:33:12.613723+0000","last_peered":"2023-08-10T10:33:12.613723+0000","last_clean":"2023-08-10T10:33:12.613723+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:12.613723+0000","last_undegraded":"2023-08-10T10:33:12.613723+0000","last_fullsized":"2023-08-10T10:33:12.613723+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'483","reported_seq":501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.628150+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:14.628150+0000","last_peered":"2023-08-10T10:33:14.628150+0000","last_clean":"2023-08-10T10:33:14.628150+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:14.628150+0000","last_undegraded":"2023-08-10T10:33:14.628150+0000","last_fullsized":"2023-08-10T10:33:14.628150+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340816+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:31:15.340816+0000","last_peered":"2023-08-10T10:31:15.340816+0000","last_clean":"2023-08-10T10:31:15.340816+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:31:15.340816+0000","last_undegraded":"2023-08-10T10:31:15.340816+0000","last_fullsized":"2023-08-10T10:31:15.340816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'13","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607442+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:33:12.607442+0000","last_peered":"2023-08-10T10:33:12.607442+0000","last_clean":"2023-08-10T10:33:12.607442+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:12.607442+0000","last_undegraded":"2023-08-10T10:33:12.607442+0000","last_fullsized":"2023-08-10T10:33:12.607442+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:37.002252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'481","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.640538+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:14.640538+0000","last_peered":"2023-08-10T10:33:14.640538+0000","last_clean":"2023-08-10T10:33:14.640538+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:14.640538+0000","last_undegraded":"2023-08-10T10:33:14.640538+0000","last_fullsized":"2023-08-10T10:33:14.640538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":481,"log_dups_size":0,"ondisk_log_size":481,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.646564+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:33:04.646564+0000","last_peered":"2023-08-10T10:33:04.646564+0000","last_clean":"2023-08-10T10:33:04.646564+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:04.646564+0000","last_undegraded":"2023-08-10T10:33:04.646564+0000","last_fullsized":"2023-08-10T10:33:04.646564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'12","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.606926+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:33:12.606926+0000","last_peered":"2023-08-10T10:33:12.606926+0000","last_clean":"2023-08-10T10:33:12.606926+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:12.606926+0000","last_undegraded":"2023-08-10T10:33:12.606926+0000","last_fullsized":"2023-08-10T10:33:12.606926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:13.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'465","reported_seq":483,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.571691+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:14.571691+0000","last_peered":"2023-08-10T10:33:14.571691+0000","last_clean":"2023-08-10T10:33:14.571691+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:14.571691+0000","last_undegraded":"2023-08-10T10:33:14.571691+0000","last_fullsized":"2023-08-10T10:33:14.571691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:55.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298977+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:31:15.298977+0000","last_peered":"2023-08-10T10:31:15.298977+0000","last_clean":"2023-08-10T10:31:15.298977+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:31:15.298977+0000","last_undegraded":"2023-08-10T10:31:15.298977+0000","last_fullsized":"2023-08-10T10:31:15.298977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.604322+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:12.604322+0000","last_peered":"2023-08-10T10:33:12.604322+0000","last_clean":"2023-08-10T10:33:12.604322+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:12.604322+0000","last_undegraded":"2023-08-10T10:33:12.604322+0000","last_fullsized":"2023-08-10T10:33:12.604322+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'460","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.429085+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:33:14.429085+0000","last_peered":"2023-08-10T10:33:14.429085+0000","last_clean":"2023-08-10T10:33:14.429085+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:14.429085+0000","last_undegraded":"2023-08-10T10:33:14.429085+0000","last_fullsized":"2023-08-10T10:33:14.429085+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":460,"log_dups_size":0,"ondisk_log_size":460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:59.704514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628991+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:32:39.628991+0000","last_peered":"2023-08-10T10:32:39.628991+0000","last_clean":"2023-08-10T10:32:39.628991+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:32:39.628991+0000","last_undegraded":"2023-08-10T10:32:39.628991+0000","last_fullsized":"2023-08-10T10:32:39.628991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:44.096010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.607129+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:33:12.607129+0000","last_peered":"2023-08-10T10:33:12.607129+0000","last_clean":"2023-08-10T10:33:12.607129+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:12.607129+0000","last_undegraded":"2023-08-10T10:33:12.607129+0000","last_fullsized":"2023-08-10T10:33:12.607129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:36.250911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.604501+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:33:12.604501+0000","last_peered":"2023-08-10T10:33:12.604501+0000","last_clean":"2023-08-10T10:33:12.604501+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:12.604501+0000","last_undegraded":"2023-08-10T10:33:12.604501+0000","last_fullsized":"2023-08-10T10:33:12.604501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612027+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:12.612027+0000","last_peered":"2023-08-10T10:33:12.612027+0000","last_clean":"2023-08-10T10:33:12.612027+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:12.612027+0000","last_undegraded":"2023-08-10T10:33:12.612027+0000","last_fullsized":"2023-08-10T10:33:12.612027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.606053+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:12.606053+0000","last_peered":"2023-08-10T10:33:12.606053+0000","last_clean":"2023-08-10T10:33:12.606053+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:12.606053+0000","last_undegraded":"2023-08-10T10:33:12.606053+0000","last_fullsized":"2023-08-10T10:33:12.606053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:09.195453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'14","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.602709+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:12.602709+0000","last_peered":"2023-08-10T10:33:12.602709+0000","last_clean":"2023-08-10T10:33:12.602709+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:12.602709+0000","last_undegraded":"2023-08-10T10:33:12.602709+0000","last_fullsized":"2023-08-10T10:33:12.602709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:40.885396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'11","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.612223+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:33:12.612223+0000","last_peered":"2023-08-10T10:33:12.612223+0000","last_clean":"2023-08-10T10:33:12.612223+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:12.612223+0000","last_undegraded":"2023-08-10T10:33:12.612223+0000","last_fullsized":"2023-08-10T10:33:12.612223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":547356672,"num_objects":134,"num_object_clones":0,"num_object_copies":536,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":134,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":377,"num_write_kb":1018880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1111490560,"data_stored":1111490560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14749,"ondisk_log_size":14749,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1042,"ondisk_log_size":1042,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1971935,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":12,"num_read_kb":14,"num_write":631,"num_write_kb":2378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4005888,"data_stored":3943870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":631,"ondisk_log_size":631,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124568,"kb_used_data":89360,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94247272,"statfs":{"total":96636764160,"available":96509206528,"internally_reserved":0,"allocated":91504640,"data_stored":91294124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":0.83999999999999997,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":9.3949999999999996,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":2.4889999999999999,"5min":0.96499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":0.78800000000000003,"15min":0.66600000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.80700000000000005},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.82099999999999995,"15min":0.73899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":11.577999999999999},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.03,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.0609999999999999,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":22.148,"5min":22.148,"15min":22.148},"last":0.621}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.84699999999999998,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":10.237,"5min":10.237,"15min":10.237},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.8240000000000001,"5min":0.98799999999999999,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.68500000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":0.81899999999999995,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.4500000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.70099999999999996},{"interface":"front","average":{"1min":1.911,"5min":0.93300000000000005,"15min":0.77000000000000002},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.779,"5min":11.779,"15min":11.779},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.83999999999999997,"15min":0.80300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":1.5309999999999999,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":0.93600000000000005,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.5129999999999999,"5min":7.5129999999999999,"15min":7.5129999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.389,"5min":0.85099999999999998,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":7.3460000000000001,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.75600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574885,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":84156,"kb_used_data":53044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94287684,"statfs":{"total":96636764160,"available":96550588416,"internally_reserved":0,"allocated":54317056,"data_stored":54135839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":0.98699999999999999,"15min":0.80900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":2.569,"5min":1.1259999999999999,"15min":0.88600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.914,"5min":10.914,"15min":10.914},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.1200000000000001,"5min":1.2130000000000001,"15min":0.89500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":14.93,"5min":14.93,"15min":14.93},"last":0.80100000000000005},{"interface":"front","average":{"1min":2.6419999999999999,"5min":1.1299999999999999,"15min":0.878},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":10.957000000000001,"5min":10.957000000000001,"15min":10.957000000000001},"last":0.754}]},{"osd":2,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.218,"15min":0.877},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":19.654,"5min":19.654,"15min":19.654},"last":0.87},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.1060000000000001,"15min":0.85399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":12.848000000000001,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.60799999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":1.206,"15min":0.91300000000000003},"min":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.81999999999999995},{"interface":"front","average":{"1min":3.7080000000000002,"5min":1.3680000000000001,"15min":0.97799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":19.907,"5min":19.907,"15min":19.907},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":0.88500000000000001,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":5.9630000000000001,"5min":5.9630000000000001,"15min":5.9630000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.421,"5min":0.84899999999999998,"15min":0.754},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":6.7199999999999998},"last":0.88900000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":0.91800000000000004,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.524,"5min":0.90300000000000002,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.84399999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.85599999999999998},{"interface":"front","average":{"1min":2.0739999999999998,"5min":1.026,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.1639999999999997,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.90500000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108732,"kb_used_data":77620,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94263108,"statfs":{"total":96636764160,"available":96525422592,"internally_reserved":0,"allocated":79482880,"data_stored":79301663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[7,8,1,2,54,36,6],"upper_bound":128},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.47699999999999998,"15min":0.439},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":10.212999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.50900000000000001,"15min":0.46300000000000002},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":5.2919999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.58799999999999997,"15min":0.499},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":8.016,"5min":8.016,"15min":8.016},"last":6.032},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.59099999999999997,"15min":0.54800000000000004},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":5.0049999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":5.0970000000000004},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":0.88,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":10.734,"5min":10.734,"15min":10.734},"last":5.9850000000000003},{"interface":"front","average":{"1min":1.194,"5min":0.83799999999999997,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":5.0410000000000004}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":0.88600000000000001,"15min":0.77800000000000002},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":10.444000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":2.1619999999999999,"5min":1.0669999999999999,"15min":0.88500000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":21.681999999999999,"5min":21.681999999999999,"15min":21.681999999999999},"last":5.5439999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":0.91300000000000003,"15min":0.83999999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":10.516,"5min":10.516,"15min":10.516},"last":5.1200000000000001},{"interface":"front","average":{"1min":1.4339999999999999,"5min":0.94199999999999995,"15min":0.85999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":6.0670000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.65200000000000002,"5min":0.622,"15min":0.622},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":4.7919999999999998},{"interface":"front","average":{"1min":1.7,"5min":0.98199999999999998,"15min":0.86199999999999999},"min":{"1min":0.67900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":3.5030000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574886,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":107272,"kb_used_data":72064,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94264568,"statfs":{"total":96636764160,"available":96526917632,"internally_reserved":0,"allocated":73793536,"data_stored":73606582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1,0,1,1,1],"upper_bound":512},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.68300000000000005,"15min":0.61699999999999999},"min":{"1min":0.30499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":6.0490000000000004,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":1.3069999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.3780000000000001,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.84999999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":0.65200000000000002,"15min":0.56200000000000006},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.4589999999999996,"5min":5.4589999999999996,"15min":5.4589999999999996},"last":2.645},{"interface":"front","average":{"1min":1.27,"5min":0.95399999999999996,"15min":0.90100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.6970000000000001,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":1.9419999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":0.95599999999999996,"15min":0.79900000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.466,"5min":0.83399999999999996,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.0069999999999997,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":1.8560000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.234,"15min":1.254},"min":{"1min":0.51300000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.5460000000000003,"5min":12.045999999999999,"15min":12.045999999999999},"last":44.292000000000002},{"interface":"front","average":{"1min":1.992,"5min":1.135,"15min":0.99199999999999999},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":49.887999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.78100000000000003,"15min":0.73299999999999998},"min":{"1min":0.45500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":127.655},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0830000000000002,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":65.376000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":1.163,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":17.001999999999999,"5min":17.001999999999999,"15min":17.001999999999999},"last":6.7969999999999997},{"interface":"front","average":{"1min":2.2999999999999998,"5min":1.0580000000000001,"15min":0.85099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":13.141,"5min":13.141,"15min":13.141},"last":5.1479999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":1.234,"15min":1.135},"min":{"1min":0.66600000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.9569999999999999,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":6.8300000000000001},{"interface":"front","average":{"1min":2.2949999999999999,"5min":1.264,"15min":1.0920000000000001},"min":{"1min":0.625,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":17.032,"5min":17.032,"15min":17.032},"last":5.2779999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574886,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94396,"kb_used_data":63284,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94277444,"statfs":{"total":96636764160,"available":96540102656,"internally_reserved":0,"allocated":64802816,"data_stored":64621599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.56699999999999995,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.877,"5min":0.52600000000000002,"15min":0.46800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.7250000000000001,"5min":0.94499999999999995,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":11.686,"5min":11.686,"15min":11.686},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.61599999999999999,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":0.77100000000000002,"15min":0.61199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.54400000000000004},{"interface":"front","average":{"1min":1.042,"5min":0.68500000000000005,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.90500000000000003,"15min":0.76600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.3740000000000006,"5min":9.3740000000000006,"15min":9.3740000000000006},"last":0.80800000000000005},{"interface":"front","average":{"1min":2.1030000000000002,"5min":0.99099999999999999,"15min":0.80500000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.656000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0470000000000002,"5min":1.0109999999999999,"15min":0.83799999999999997},"min":{"1min":0.505,"5min":0.499,"15min":0.499},"max":{"1min":10.923,"5min":10.923,"15min":10.923},"last":0.67300000000000004},{"interface":"front","average":{"1min":2.1749999999999998,"5min":1.044,"15min":0.85599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":10.634,"5min":10.634,"15min":10.634},"last":0.78400000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":3.0990000000000002,"5min":1.216,"15min":0.90200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.618,"5min":11.618,"15min":11.618},"last":0.748},{"interface":"front","average":{"1min":3.004,"5min":1.224,"15min":0.92800000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":10.885999999999999,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":1.0660000000000001,"15min":0.89300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":9.3399999999999999,"5min":9.3399999999999999,"15min":9.3399999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.0289999999999999,"15min":0.86099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":9.4269999999999996,"5min":9.4269999999999996,"15min":9.4269999999999996},"last":0.872}]}]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":94400,"kb_used_data":63288,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94277440,"statfs":{"total":96636764160,"available":96540098560,"internally_reserved":0,"allocated":64806912,"data_stored":64621689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.62,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":0.70499999999999996,"15min":0.59299999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.143000000000001,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2010000000000001,"15min":1.181},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.923,"5min":12.754,"15min":12.754},"last":0.432}]},{"osd":2,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":0.86399999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.7669999999999999,"5min":0.93500000000000005,"15min":0.79600000000000004},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":16.927,"5min":16.927,"15min":16.927},"last":0.54100000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":0.93200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.73099999999999998},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.014,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":12.465999999999999,"5min":12.465999999999999,"15min":12.465999999999999},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":0.92000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":2.2370000000000001,"5min":1.0940000000000001,"15min":0.90400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":17.664000000000001,"5min":17.664000000000001,"15min":17.664000000000001},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":1.111,"15min":0.90600000000000003},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.67900000000000005},{"interface":"front","average":{"1min":2.1139999999999999,"5min":1.0580000000000001,"15min":0.88200000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":12.504,"5min":12.504,"15min":12.504},"last":0.69699999999999995}]},{"osd":7,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.93799999999999994,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.1459999999999999,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":16.977,"5min":16.977,"15min":16.977},"last":0.77300000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574886,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":169044,"kb_used_data":133836,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94202796,"statfs":{"total":96636764160,"available":96463663104,"internally_reserved":0,"allocated":137048064,"data_stored":136847384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3,1,1,1,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":0.94299999999999995,"15min":0.76500000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":19.064,"5min":19.064,"15min":19.064},"last":69.530000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.109,"15min":0.94999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.238,"5min":11.238,"15min":11.238},"last":19.388000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":1.0629999999999999,"15min":0.88900000000000001},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":64.784999999999997},{"interface":"front","average":{"1min":2.722,"5min":1.242,"15min":0.996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":19.033999999999999,"5min":19.033999999999999,"15min":19.033999999999999},"last":120.05}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1760000000000002,"5min":1.014,"15min":0.81999999999999995},"min":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":18.948,"5min":18.948,"15min":18.948},"last":119.992},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.1879999999999999,"15min":1.081},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":30.984000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.0189999999999999,"15min":0.86099999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":11.279,"5min":11.279,"15min":11.279},"last":64.823999999999998},{"interface":"front","average":{"1min":1.5960000000000001,"5min":0.96799999999999997,"15min":0.86299999999999999},"min":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":10.962999999999999,"5min":10.962999999999999,"15min":10.962999999999999},"last":30.940000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8240000000000001,"5min":1.073,"15min":0.94799999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":19,"5min":19,"15min":19},"last":165.98500000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.84899999999999998,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.4100000000000001,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":125.369}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.446,"15min":1.458},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.029,"5min":12.381,"15min":12.381},"last":113.884},{"interface":"front","average":{"1min":1.5369999999999999,"5min":0.96099999999999997,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.441,"15min":0.441},"max":{"1min":8.5950000000000006,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":124.836}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.91600000000000004,"15min":0.89400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.448,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":67.281999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.89200000000000002,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":125.12}]}]},{"osd":5,"up_from":13,"seq":55834574886,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":96452,"kb_used_data":65340,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94275388,"statfs":{"total":96636764160,"available":96537997312,"internally_reserved":0,"allocated":66908160,"data_stored":66719403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.046,"15min":1.024},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.9859999999999998,"5min":6.7640000000000002,"15min":6.7640000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5970000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.58099999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.22,"15min":1.1870000000000001},"min":{"1min":0.52000000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.9379999999999997,"5min":9.5939999999999994,"15min":9.5939999999999994},"last":0.75700000000000001},{"interface":"front","average":{"1min":1.595,"5min":1.111,"15min":1.0309999999999999},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":11.625,"5min":11.625,"15min":11.625},"last":0.621}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.02,"15min":1.042},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.504,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.96299999999999997,"15min":0.98699999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.579,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":0.81799999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3180000000000001,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1930000000000001,"15min":1.256},"min":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5309999999999999,"5min":10.688000000000001,"15min":10.688000000000001},"last":0.90100000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65800000000000003,"15min":0.63800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.88}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":0.80000000000000004,"15min":0.751},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77300000000000002,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.581,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.93200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":7026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1990656,"data_stored":1971193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1990656,"data_stored":1964909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":149422080,"data_stored":149422080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":157810688,"data_stored":157810688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":123207680,"data_stored":123207680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":123207680,"data_stored":123207680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":145227776,"data_stored":145227776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":141033472,"data_stored":141033472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":133693440,"data_stored":133693440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":137887744,"data_stored":137887744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:33:21.393 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:33:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.617+0000 7f57273ff700 1 Processor -- start 2023-08-10T10:33:21.619 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.618+0000 7f57273ff700 1 -- start start 2023-08-10T10:33:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f57273ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 0x7f572015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.621 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f57273ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57200710a0 0x7f572006a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f57273ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572006a170 con 0x7f57200716d0 2023-08-10T10:33:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f57273ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57200cdeb0 con 0x7f57200710a0 2023-08-10T10:33:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f57273ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200ce190 con 0x7f5720159d00 2023-08-10T10:33:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57200710a0 0x7f572006a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.622 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57200710a0 0x7f572006a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40248/0 (socket says 172.21.15.88:40248) 2023-08-10T10:33:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 -- 172.21.15.88:0/390867608 learned_addr learned my addr 172.21.15.88:0/390867608 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572519b700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 0x7f572015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 -- 172.21.15.88:0/390867608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 msgr2=0x7f572015d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 0x7f572015d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.623 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 -- 172.21.15.88:0/390867608 >> v1:172.21.15.187:6789/0 conn(0x7f57200716d0 legacy=0x7f5720070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572599c700 1 -- 172.21.15.88:0/390867608 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200ce470 con 0x7f57200710a0 2023-08-10T10:33:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.619+0000 7f572519b700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 0x7f572015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f572599c700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f572006a600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5718009e50 tx=0x7f571800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92eb63306bcedfc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f5717fff700 1 -- 172.21.15.88:0/390867608 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800e070 con 0x7f57200710a0 2023-08-10T10:33:21.624 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f5717fff700 1 -- 172.21.15.88:0/390867608 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571800b9c0 con 0x7f57200710a0 2023-08-10T10:33:21.625 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f5717fff700 1 -- 172.21.15.88:0/390867608 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571800bd70 con 0x7f57200710a0 2023-08-10T10:33:21.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f57273ff700 1 -- 172.21.15.88:0/390867608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 msgr2=0x7f572006a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.620+0000 7f57273ff700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f572006a600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5718009e50 tx=0x7f571800b330 comp rx=0 tx=0).stop 2023-08-10T10:33:21.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 -- 172.21.15.88:0/390867608 shutdown_connections 2023-08-10T10:33:21.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f572006a600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 --2- 172.21.15.88:0/390867608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5720159d00 0x7f572015d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 -- 172.21.15.88:0/390867608 >> 172.21.15.88:0/390867608 conn(0x7f57200ced50 msgr2=0x7f57200cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:21.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 -- 172.21.15.88:0/390867608 shutdown_connections 2023-08-10T10:33:21.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.621+0000 7f57273ff700 1 -- 172.21.15.88:0/390867608 wait complete. 2023-08-10T10:33:21.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.622+0000 7f57273ff700 1 Processor -- start 2023-08-10T10:33:21.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.622+0000 7f57273ff700 1 -- start start 2023-08-10T10:33:21.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 0x7f57200afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 0x7f572015c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572015b9f0 con 0x7f57200710a0 2023-08-10T10:33:21.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572015b150 con 0x7f5720159d00 2023-08-10T10:33:21.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.623+0000 7f57273ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572015b430 con 0x7f57200716d0 2023-08-10T10:33:21.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:40254/0 (socket says 172.21.15.88:40254) 2023-08-10T10:33:21.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 -- 172.21.15.88:0/692324525 learned_addr learned my addr 172.21.15.88:0/692324525 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:21.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572499a700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 0x7f57200afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572599c700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 0x7f572015c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 -- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 msgr2=0x7f57200afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 0x7f57200afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 -- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 msgr2=0x7f572015c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 0x7f572015c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 -- 172.21.15.88:0/692324525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718009b30 con 0x7f57200710a0 2023-08-10T10:33:21.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572499a700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 0x7f57200afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:21.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572599c700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 0x7f572015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:21.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f572519b700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f571c00e810 tx=0x7f571c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c00c020 con 0x7f57200710a0 2023-08-10T10:33:21.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c004250 con 0x7f57200710a0 2023-08-10T10:33:21.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.624+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c0036a0 con 0x7f57200710a0 2023-08-10T10:33:21.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.625+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572015b710 con 0x7f57200710a0 2023-08-10T10:33:21.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.625+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5720159580 con 0x7f57200710a0 2023-08-10T10:33:21.635 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.626+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57200c6050 con 0x7f57200710a0 2023-08-10T10:33:21.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.626+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f571c003800 con 0x7f57200710a0 2023-08-10T10:33:21.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.628+0000 7f5715ffb700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 0x7f570406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:21.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.628+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f571c089260 con 0x7f57200710a0 2023-08-10T10:33:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.628+0000 7f572499a700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 0x7f570406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.628+0000 7f572499a700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 0x7f570406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57200c55d0 tx=0x7f5710009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:21.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.632+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f571c053fd0 con 0x7f57200710a0 2023-08-10T10:33:21.824 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.823+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f572015a0e0 con 0x7f570406ace0 2023-08-10T10:33:21.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.834+0000 7f5715ffb700 1 -- 172.21.15.88:0/692324525 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391942 (secure 0 0 0) 0x7f57100014f0 con 0x7f570406ace0 2023-08-10T10:33:21.843 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 msgr2=0x7f570406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 0x7f570406d1a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f57200c55d0 tx=0x7f5710009040 comp rx=0 tx=0).stop 2023-08-10T10:33:21.846 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 msgr2=0x7f5720159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f571c00e810 tx=0x7f571c00ebd0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 shutdown_connections 2023-08-10T10:33:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5720159d00 0x7f572015c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f57200710a0 0x7f5720159040 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.847 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f570406ace0 0x7f570406d1a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 --2- 172.21.15.88:0/692324525 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57200716d0 0x7f57200afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 >> 172.21.15.88:0/692324525 conn(0x7f57200ced50 msgr2=0x7f572006d500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 shutdown_connections 2023-08-10T10:33:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:21.839+0000 7f57273ff700 1 -- 172.21.15.88:0/692324525 wait complete. 2023-08-10T10:33:21.848 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:33:21.859 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-08-10T10:33:21.602524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168353536,"num_objects":66,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":130,"num_read_kb":117,"num_write":1310,"num_write_kb":1032008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17189,"ondisk_log_size":17189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":596620,"kb_used_data":331340,"kb_used_omap":13,"kb_used_meta":265202,"kb_avail":754378100,"statfs":{"total":773094113280,"available":772483174400,"internally_reserved":0,"allocated":339292160,"data_stored":337779453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":271566936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3,1,1,1,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-234572658,"num_objects":-55,"num_object_clones":0,"num_object_copies":-220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-55,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":508,"num_write_kb":636284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002503"},"pg_stats":[{"pgid":"4.3f","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228032+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:33:16.228032+0000","last_peered":"2023-08-10T10:33:16.228032+0000","last_clean":"2023-08-10T10:33:16.228032+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:16.228032+0000","last_undegraded":"2023-08-10T10:33:16.228032+0000","last_fullsized":"2023-08-10T10:33:16.228032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227989+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:16.227989+0000","last_peered":"2023-08-10T10:33:16.227989+0000","last_clean":"2023-08-10T10:33:16.227989+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:16.227989+0000","last_undegraded":"2023-08-10T10:33:16.227989+0000","last_fullsized":"2023-08-10T10:33:16.227989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625516+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:16.625516+0000","last_peered":"2023-08-10T10:33:16.625516+0000","last_clean":"2023-08-10T10:33:16.625516+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:16.625516+0000","last_undegraded":"2023-08-10T10:33:16.625516+0000","last_fullsized":"2023-08-10T10:33:16.625516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.075290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215525+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:33:16.215525+0000","last_peered":"2023-08-10T10:33:16.215525+0000","last_clean":"2023-08-10T10:33:16.215525+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:16.215525+0000","last_undegraded":"2023-08-10T10:33:16.215525+0000","last_fullsized":"2023-08-10T10:33:16.215525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:59.927282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230603+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:33:16.230603+0000","last_peered":"2023-08-10T10:33:16.230603+0000","last_clean":"2023-08-10T10:33:16.230603+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:16.230603+0000","last_undegraded":"2023-08-10T10:33:16.230603+0000","last_fullsized":"2023-08-10T10:33:16.230603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.236136+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:16.236136+0000","last_peered":"2023-08-10T10:33:16.236136+0000","last_clean":"2023-08-10T10:33:16.236136+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:16.236136+0000","last_undegraded":"2023-08-10T10:33:16.236136+0000","last_fullsized":"2023-08-10T10:33:16.236136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.385568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215290+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:33:16.215290+0000","last_peered":"2023-08-10T10:33:16.215290+0000","last_clean":"2023-08-10T10:33:16.215290+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:16.215290+0000","last_undegraded":"2023-08-10T10:33:16.215290+0000","last_fullsized":"2023-08-10T10:33:16.215290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:22.895395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225385+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:16.225385+0000","last_peered":"2023-08-10T10:33:16.225385+0000","last_clean":"2023-08-10T10:33:16.225385+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:16.225385+0000","last_undegraded":"2023-08-10T10:33:16.225385+0000","last_fullsized":"2023-08-10T10:33:16.225385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.214785+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:16.214785+0000","last_peered":"2023-08-10T10:33:16.214785+0000","last_clean":"2023-08-10T10:33:16.214785+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:16.214785+0000","last_undegraded":"2023-08-10T10:33:16.214785+0000","last_fullsized":"2023-08-10T10:33:16.214785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:19.279630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'36","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228237+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:33:16.228237+0000","last_peered":"2023-08-10T10:33:16.228237+0000","last_clean":"2023-08-10T10:33:16.228237+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:16.228237+0000","last_undegraded":"2023-08-10T10:33:16.228237+0000","last_fullsized":"2023-08-10T10:33:16.228237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244641+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:33:16.244641+0000","last_peered":"2023-08-10T10:33:16.244641+0000","last_clean":"2023-08-10T10:33:16.244641+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:16.244641+0000","last_undegraded":"2023-08-10T10:33:16.244641+0000","last_fullsized":"2023-08-10T10:33:16.244641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:54.096841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.210763+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:33:16.210763+0000","last_peered":"2023-08-10T10:33:16.210763+0000","last_clean":"2023-08-10T10:33:16.210763+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:16.210763+0000","last_undegraded":"2023-08-10T10:33:16.210763+0000","last_fullsized":"2023-08-10T10:33:16.210763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.194328+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:33:16.194328+0000","last_peered":"2023-08-10T10:33:16.194328+0000","last_clean":"2023-08-10T10:33:16.194328+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:16.194328+0000","last_undegraded":"2023-08-10T10:33:16.194328+0000","last_fullsized":"2023-08-10T10:33:16.194328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227080+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:33:16.227080+0000","last_peered":"2023-08-10T10:33:16.227080+0000","last_clean":"2023-08-10T10:33:16.227080+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:16.227080+0000","last_undegraded":"2023-08-10T10:33:16.227080+0000","last_fullsized":"2023-08-10T10:33:16.227080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:45.102687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215084+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:33:16.215084+0000","last_peered":"2023-08-10T10:33:16.215084+0000","last_clean":"2023-08-10T10:33:16.215084+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:33:16.215084+0000","last_undegraded":"2023-08-10T10:33:16.215084+0000","last_fullsized":"2023-08-10T10:33:16.215084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243965+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:16.243965+0000","last_peered":"2023-08-10T10:33:16.243965+0000","last_clean":"2023-08-10T10:33:16.243965+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:16.243965+0000","last_undegraded":"2023-08-10T10:33:16.243965+0000","last_fullsized":"2023-08-10T10:33:16.243965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:54.252670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'28","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.651627+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:33:16.651627+0000","last_peered":"2023-08-10T10:33:16.651627+0000","last_clean":"2023-08-10T10:33:16.651627+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:33:16.651627+0000","last_undegraded":"2023-08-10T10:33:16.651627+0000","last_fullsized":"2023-08-10T10:33:16.651627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:10.276146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.226549+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:33:16.226549+0000","last_peered":"2023-08-10T10:33:16.226549+0000","last_clean":"2023-08-10T10:33:16.226549+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:16.226549+0000","last_undegraded":"2023-08-10T10:33:16.226549+0000","last_fullsized":"2023-08-10T10:33:16.226549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:41.704636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218369+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:33:16.218369+0000","last_peered":"2023-08-10T10:33:16.218369+0000","last_clean":"2023-08-10T10:33:16.218369+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:16.218369+0000","last_undegraded":"2023-08-10T10:33:16.218369+0000","last_fullsized":"2023-08-10T10:33:16.218369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:46.253304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244572+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:33:16.244572+0000","last_peered":"2023-08-10T10:33:16.244572+0000","last_clean":"2023-08-10T10:33:16.244572+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:16.244572+0000","last_undegraded":"2023-08-10T10:33:16.244572+0000","last_fullsized":"2023-08-10T10:33:16.244572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:28.531313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230142+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:16.230142+0000","last_peered":"2023-08-10T10:33:16.230142+0000","last_clean":"2023-08-10T10:33:16.230142+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:16.230142+0000","last_undegraded":"2023-08-10T10:33:16.230142+0000","last_fullsized":"2023-08-10T10:33:16.230142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.224403+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:33:16.224403+0000","last_peered":"2023-08-10T10:33:16.224403+0000","last_clean":"2023-08-10T10:33:16.224403+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:16.224403+0000","last_undegraded":"2023-08-10T10:33:16.224403+0000","last_fullsized":"2023-08-10T10:33:16.224403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229001+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:33:16.229001+0000","last_peered":"2023-08-10T10:33:16.229001+0000","last_clean":"2023-08-10T10:33:16.229001+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:16.229001+0000","last_undegraded":"2023-08-10T10:33:16.229001+0000","last_fullsized":"2023-08-10T10:33:16.229001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230115+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:16.230115+0000","last_peered":"2023-08-10T10:33:16.230115+0000","last_clean":"2023-08-10T10:33:16.230115+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:16.230115+0000","last_undegraded":"2023-08-10T10:33:16.230115+0000","last_fullsized":"2023-08-10T10:33:16.230115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.219153+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:33:16.219153+0000","last_peered":"2023-08-10T10:33:16.219153+0000","last_clean":"2023-08-10T10:33:16.219153+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:16.219153+0000","last_undegraded":"2023-08-10T10:33:16.219153+0000","last_fullsized":"2023-08-10T10:33:16.219153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.220593+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:33:16.220593+0000","last_peered":"2023-08-10T10:33:16.220593+0000","last_clean":"2023-08-10T10:33:16.220593+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:16.220593+0000","last_undegraded":"2023-08-10T10:33:16.220593+0000","last_fullsized":"2023-08-10T10:33:16.220593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229027+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:33:16.229027+0000","last_peered":"2023-08-10T10:33:16.229027+0000","last_clean":"2023-08-10T10:33:16.229027+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:16.229027+0000","last_undegraded":"2023-08-10T10:33:16.229027+0000","last_fullsized":"2023-08-10T10:33:16.229027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'443","reported_seq":461,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625580+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:16.625580+0000","last_peered":"2023-08-10T10:33:16.625580+0000","last_clean":"2023-08-10T10:33:16.625580+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:16.625580+0000","last_undegraded":"2023-08-10T10:33:16.625580+0000","last_fullsized":"2023-08-10T10:33:16.625580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:11:32.547675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296882+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:31:15.296882+0000","last_peered":"2023-08-10T10:31:15.296882+0000","last_clean":"2023-08-10T10:31:15.296882+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:31:15.296882+0000","last_undegraded":"2023-08-10T10:31:15.296882+0000","last_fullsized":"2023-08-10T10:31:15.296882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:35:24.254384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227376+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:16.227376+0000","last_peered":"2023-08-10T10:33:16.227376+0000","last_clean":"2023-08-10T10:33:16.227376+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:16.227376+0000","last_undegraded":"2023-08-10T10:33:16.227376+0000","last_fullsized":"2023-08-10T10:33:16.227376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'469","reported_seq":487,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.640008+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:33:16.640008+0000","last_peered":"2023-08-10T10:33:16.640008+0000","last_clean":"2023-08-10T10:33:16.640008+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:33:16.640008+0000","last_undegraded":"2023-08-10T10:33:16.640008+0000","last_fullsized":"2023-08-10T10:33:16.640008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:28.669274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558123+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:31:15.558123+0000","last_peered":"2023-08-10T10:31:15.558123+0000","last_clean":"2023-08-10T10:31:15.558123+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:31:15.558123+0000","last_undegraded":"2023-08-10T10:31:15.558123+0000","last_fullsized":"2023-08-10T10:31:15.558123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.099809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.222029+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:33:16.222029+0000","last_peered":"2023-08-10T10:33:16.222029+0000","last_clean":"2023-08-10T10:33:16.222029+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:16.222029+0000","last_undegraded":"2023-08-10T10:33:16.222029+0000","last_fullsized":"2023-08-10T10:33:16.222029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'474","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596287+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:16.596287+0000","last_peered":"2023-08-10T10:33:16.596287+0000","last_clean":"2023-08-10T10:33:16.596287+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:16.596287+0000","last_undegraded":"2023-08-10T10:33:16.596287+0000","last_fullsized":"2023-08-10T10:33:16.596287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297997+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:31:15.297997+0000","last_peered":"2023-08-10T10:31:15.297997+0000","last_clean":"2023-08-10T10:31:15.297997+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:31:15.297997+0000","last_undegraded":"2023-08-10T10:31:15.297997+0000","last_fullsized":"2023-08-10T10:31:15.297997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.231180+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:33:16.231180+0000","last_peered":"2023-08-10T10:33:16.231180+0000","last_clean":"2023-08-10T10:33:16.231180+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:16.231180+0000","last_undegraded":"2023-08-10T10:33:16.231180+0000","last_fullsized":"2023-08-10T10:33:16.231180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.640017+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:33:16.640017+0000","last_peered":"2023-08-10T10:33:16.640017+0000","last_clean":"2023-08-10T10:33:16.640017+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:33:16.640017+0000","last_undegraded":"2023-08-10T10:33:16.640017+0000","last_fullsized":"2023-08-10T10:33:16.640017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:11.329930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.566167+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:32:59.566167+0000","last_peered":"2023-08-10T10:32:59.566167+0000","last_clean":"2023-08-10T10:32:59.566167+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:32:59.566167+0000","last_undegraded":"2023-08-10T10:32:59.566167+0000","last_fullsized":"2023-08-10T10:32:59.566167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:25.133924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227076+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:33:16.227076+0000","last_peered":"2023-08-10T10:33:16.227076+0000","last_clean":"2023-08-10T10:33:16.227076+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:16.227076+0000","last_undegraded":"2023-08-10T10:33:16.227076+0000","last_fullsized":"2023-08-10T10:33:16.227076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'463","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661846+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:16.661846+0000","last_peered":"2023-08-10T10:33:16.661846+0000","last_clean":"2023-08-10T10:33:16.661846+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:16.661846+0000","last_undegraded":"2023-08-10T10:33:16.661846+0000","last_fullsized":"2023-08-10T10:33:16.661846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:49.157469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.644932+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:32:59.644932+0000","last_peered":"2023-08-10T10:32:59.644932+0000","last_clean":"2023-08-10T10:32:59.644932+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:32:59.644932+0000","last_undegraded":"2023-08-10T10:32:59.644932+0000","last_fullsized":"2023-08-10T10:32:59.644932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230587+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:16.230587+0000","last_peered":"2023-08-10T10:33:16.230587+0000","last_clean":"2023-08-10T10:33:16.230587+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:16.230587+0000","last_undegraded":"2023-08-10T10:33:16.230587+0000","last_fullsized":"2023-08-10T10:33:16.230587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.681597+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.681597+0000","last_peered":"2023-08-10T10:33:16.681597+0000","last_clean":"2023-08-10T10:33:16.681597+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.681597+0000","last_undegraded":"2023-08-10T10:33:16.681597+0000","last_fullsized":"2023-08-10T10:33:16.681597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:55.391226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'11","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.684491+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:33:12.684491+0000","last_peered":"2023-08-10T10:33:12.684491+0000","last_clean":"2023-08-10T10:33:12.684491+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:12.684491+0000","last_undegraded":"2023-08-10T10:33:12.684491+0000","last_fullsized":"2023-08-10T10:33:12.684491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225951+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:33:16.225951+0000","last_peered":"2023-08-10T10:33:16.225951+0000","last_clean":"2023-08-10T10:33:16.225951+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:16.225951+0000","last_undegraded":"2023-08-10T10:33:16.225951+0000","last_fullsized":"2023-08-10T10:33:16.225951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:40:31.121005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'453","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596074+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:16.596074+0000","last_peered":"2023-08-10T10:33:16.596074+0000","last_clean":"2023-08-10T10:33:16.596074+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:16.596074+0000","last_undegraded":"2023-08-10T10:33:16.596074+0000","last_fullsized":"2023-08-10T10:33:16.596074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:35.104002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'594","reported_seq":620,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:18.557387+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:33:18.557387+0000","last_peered":"2023-08-10T10:33:18.557387+0000","last_clean":"2023-08-10T10:33:18.557387+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:18.557387+0000","last_undegraded":"2023-08-10T10:33:18.557387+0000","last_fullsized":"2023-08-10T10:33:18.557387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:21.332327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2079719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":2471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244018+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:16.244018+0000","last_peered":"2023-08-10T10:33:16.244018+0000","last_clean":"2023-08-10T10:33:16.244018+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:16.244018+0000","last_undegraded":"2023-08-10T10:33:16.244018+0000","last_fullsized":"2023-08-10T10:33:16.244018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:17.491868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.672394+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:16.672394+0000","last_peered":"2023-08-10T10:33:16.672394+0000","last_clean":"2023-08-10T10:33:16.672394+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:16.672394+0000","last_undegraded":"2023-08-10T10:33:16.672394+0000","last_fullsized":"2023-08-10T10:33:16.672394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:30.844193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297505+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:31:15.297505+0000","last_peered":"2023-08-10T10:31:15.297505+0000","last_clean":"2023-08-10T10:31:15.297505+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:31:15.297505+0000","last_undegraded":"2023-08-10T10:31:15.297505+0000","last_fullsized":"2023-08-10T10:31:15.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'23","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229623+0000","last_change":"2023-08-10T10:31:15.344082+0000","last_active":"2023-08-10T10:33:16.229623+0000","last_peered":"2023-08-10T10:33:16.229623+0000","last_clean":"2023-08-10T10:33:16.229623+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:16.229623+0000","last_undegraded":"2023-08-10T10:33:16.229623+0000","last_fullsized":"2023-08-10T10:33:16.229623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:16.251149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'448","reported_seq":466,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.613265+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:16.613265+0000","last_peered":"2023-08-10T10:33:16.613265+0000","last_clean":"2023-08-10T10:33:16.613265+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:16.613265+0000","last_undegraded":"2023-08-10T10:33:16.613265+0000","last_fullsized":"2023-08-10T10:33:16.613265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:47.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298926+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:31:15.298926+0000","last_peered":"2023-08-10T10:31:15.298926+0000","last_clean":"2023-08-10T10:31:15.298926+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:31:15.298926+0000","last_undegraded":"2023-08-10T10:31:15.298926+0000","last_fullsized":"2023-08-10T10:31:15.298926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:49.308799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228843+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:33:16.228843+0000","last_peered":"2023-08-10T10:33:16.228843+0000","last_clean":"2023-08-10T10:33:16.228843+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:33:16.228843+0000","last_undegraded":"2023-08-10T10:33:16.228843+0000","last_fullsized":"2023-08-10T10:33:16.228843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:39.485653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.657216+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:12.657216+0000","last_peered":"2023-08-10T10:33:12.657216+0000","last_clean":"2023-08-10T10:33:12.657216+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:12.657216+0000","last_undegraded":"2023-08-10T10:33:12.657216+0000","last_fullsized":"2023-08-10T10:33:12.657216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:55.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.649027+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:32:54.649027+0000","last_peered":"2023-08-10T10:32:54.649027+0000","last_clean":"2023-08-10T10:32:54.649027+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:32:54.649027+0000","last_undegraded":"2023-08-10T10:32:54.649027+0000","last_fullsized":"2023-08-10T10:32:54.649027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229167+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:33:16.229167+0000","last_peered":"2023-08-10T10:33:16.229167+0000","last_clean":"2023-08-10T10:33:16.229167+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:33:16.229167+0000","last_undegraded":"2023-08-10T10:33:16.229167+0000","last_fullsized":"2023-08-10T10:33:16.229167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'507","reported_seq":525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.645635+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:16.645635+0000","last_peered":"2023-08-10T10:33:16.645635+0000","last_clean":"2023-08-10T10:33:16.645635+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:16.645635+0000","last_undegraded":"2023-08-10T10:33:16.645635+0000","last_fullsized":"2023-08-10T10:33:16.645635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:26.950178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.644202+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:32:54.644202+0000","last_peered":"2023-08-10T10:32:54.644202+0000","last_clean":"2023-08-10T10:32:54.644202+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:32:54.644202+0000","last_undegraded":"2023-08-10T10:32:54.644202+0000","last_fullsized":"2023-08-10T10:32:54.644202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:28.578497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229987+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:16.229987+0000","last_peered":"2023-08-10T10:33:16.229987+0000","last_clean":"2023-08-10T10:33:16.229987+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:16.229987+0000","last_undegraded":"2023-08-10T10:33:16.229987+0000","last_fullsized":"2023-08-10T10:33:16.229987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:53.894741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661711+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:16.661711+0000","last_peered":"2023-08-10T10:33:16.661711+0000","last_clean":"2023-08-10T10:33:16.661711+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:16.661711+0000","last_undegraded":"2023-08-10T10:33:16.661711+0000","last_fullsized":"2023-08-10T10:33:16.661711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:51.590601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297435+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:31:15.297435+0000","last_peered":"2023-08-10T10:31:15.297435+0000","last_clean":"2023-08-10T10:31:15.297435+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:31:15.297435+0000","last_undegraded":"2023-08-10T10:31:15.297435+0000","last_fullsized":"2023-08-10T10:31:15.297435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:14.302383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227858+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:16.227858+0000","last_peered":"2023-08-10T10:33:16.227858+0000","last_clean":"2023-08-10T10:33:16.227858+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:16.227858+0000","last_undegraded":"2023-08-10T10:33:16.227858+0000","last_fullsized":"2023-08-10T10:33:16.227858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:26.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637975+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:33:16.637975+0000","last_peered":"2023-08-10T10:33:16.637975+0000","last_clean":"2023-08-10T10:33:16.637975+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:16.637975+0000","last_undegraded":"2023-08-10T10:33:16.637975+0000","last_fullsized":"2023-08-10T10:33:16.637975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298234+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:31:15.298234+0000","last_peered":"2023-08-10T10:31:15.298234+0000","last_clean":"2023-08-10T10:31:15.298234+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:31:15.298234+0000","last_undegraded":"2023-08-10T10:31:15.298234+0000","last_fullsized":"2023-08-10T10:31:15.298234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:03.007876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243305+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:16.243305+0000","last_peered":"2023-08-10T10:33:16.243305+0000","last_clean":"2023-08-10T10:33:16.243305+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:16.243305+0000","last_undegraded":"2023-08-10T10:33:16.243305+0000","last_fullsized":"2023-08-10T10:33:16.243305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:35.261347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'471","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.660055+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:33:16.660055+0000","last_peered":"2023-08-10T10:33:16.660055+0000","last_clean":"2023-08-10T10:33:16.660055+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:16.660055+0000","last_undegraded":"2023-08-10T10:33:16.660055+0000","last_fullsized":"2023-08-10T10:33:16.660055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297852+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:31:15.297852+0000","last_peered":"2023-08-10T10:31:15.297852+0000","last_clean":"2023-08-10T10:31:15.297852+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:31:15.297852+0000","last_undegraded":"2023-08-10T10:31:15.297852+0000","last_fullsized":"2023-08-10T10:31:15.297852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227375+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:33:16.227375+0000","last_peered":"2023-08-10T10:33:16.227375+0000","last_clean":"2023-08-10T10:33:16.227375+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:16.227375+0000","last_undegraded":"2023-08-10T10:33:16.227375+0000","last_fullsized":"2023-08-10T10:33:16.227375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:38.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686298+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:33:16.686298+0000","last_peered":"2023-08-10T10:33:16.686298+0000","last_clean":"2023-08-10T10:33:16.686298+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:16.686298+0000","last_undegraded":"2023-08-10T10:33:16.686298+0000","last_fullsized":"2023-08-10T10:33:16.686298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:00.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340760+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:31:15.340760+0000","last_peered":"2023-08-10T10:31:15.340760+0000","last_clean":"2023-08-10T10:31:15.340760+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:31:15.340760+0000","last_undegraded":"2023-08-10T10:31:15.340760+0000","last_fullsized":"2023-08-10T10:31:15.340760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:16.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225794+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:33:16.225794+0000","last_peered":"2023-08-10T10:33:16.225794+0000","last_clean":"2023-08-10T10:33:16.225794+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:16.225794+0000","last_undegraded":"2023-08-10T10:33:16.225794+0000","last_fullsized":"2023-08-10T10:33:16.225794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603945+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:33:16.603945+0000","last_peered":"2023-08-10T10:33:16.603945+0000","last_clean":"2023-08-10T10:33:16.603945+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:16.603945+0000","last_undegraded":"2023-08-10T10:33:16.603945+0000","last_fullsized":"2023-08-10T10:33:16.603945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:29.585039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.564548+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:32:59.564548+0000","last_peered":"2023-08-10T10:32:59.564548+0000","last_clean":"2023-08-10T10:32:59.564548+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:32:59.564548+0000","last_undegraded":"2023-08-10T10:32:59.564548+0000","last_fullsized":"2023-08-10T10:32:59.564548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:19.074943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244911+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:16.244911+0000","last_peered":"2023-08-10T10:33:16.244911+0000","last_clean":"2023-08-10T10:33:16.244911+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:16.244911+0000","last_undegraded":"2023-08-10T10:33:16.244911+0000","last_fullsized":"2023-08-10T10:33:16.244911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:41.250265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'477","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625282+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:16.625282+0000","last_peered":"2023-08-10T10:33:16.625282+0000","last_clean":"2023-08-10T10:33:16.625282+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:16.625282+0000","last_undegraded":"2023-08-10T10:33:16.625282+0000","last_fullsized":"2023-08-10T10:33:16.625282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:23.334412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132118+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:31:16.132118+0000","last_peered":"2023-08-10T10:31:16.132118+0000","last_clean":"2023-08-10T10:31:16.132118+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:31:16.132118+0000","last_undegraded":"2023-08-10T10:31:16.132118+0000","last_fullsized":"2023-08-10T10:31:16.132118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:48.763588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243361+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:33:16.243361+0000","last_peered":"2023-08-10T10:33:16.243361+0000","last_clean":"2023-08-10T10:33:16.243361+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:16.243361+0000","last_undegraded":"2023-08-10T10:33:16.243361+0000","last_fullsized":"2023-08-10T10:33:16.243361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:23.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'456","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.660104+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:16.660104+0000","last_peered":"2023-08-10T10:33:16.660104+0000","last_clean":"2023-08-10T10:33:16.660104+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:16.660104+0000","last_undegraded":"2023-08-10T10:33:16.660104+0000","last_fullsized":"2023-08-10T10:33:16.660104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:36.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.647488+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:32:44.647488+0000","last_peered":"2023-08-10T10:32:44.647488+0000","last_clean":"2023-08-10T10:32:44.647488+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:32:44.647488+0000","last_undegraded":"2023-08-10T10:32:44.647488+0000","last_fullsized":"2023-08-10T10:32:44.647488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:17.232518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'12","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.242397+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:33:16.242397+0000","last_peered":"2023-08-10T10:33:16.242397+0000","last_clean":"2023-08-10T10:33:16.242397+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:16.242397+0000","last_undegraded":"2023-08-10T10:33:16.242397+0000","last_fullsized":"2023-08-10T10:33:16.242397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:54:47.483257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.618747+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.618747+0000","last_peered":"2023-08-10T10:33:16.618747+0000","last_clean":"2023-08-10T10:33:16.618747+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.618747+0000","last_undegraded":"2023-08-10T10:33:16.618747+0000","last_fullsized":"2023-08-10T10:33:16.618747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.041993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297869+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:31:15.297869+0000","last_peered":"2023-08-10T10:31:15.297869+0000","last_clean":"2023-08-10T10:31:15.297869+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:31:15.297869+0000","last_undegraded":"2023-08-10T10:31:15.297869+0000","last_fullsized":"2023-08-10T10:31:15.297869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228262+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:33:16.228262+0000","last_peered":"2023-08-10T10:33:16.228262+0000","last_clean":"2023-08-10T10:33:16.228262+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:16.228262+0000","last_undegraded":"2023-08-10T10:33:16.228262+0000","last_fullsized":"2023-08-10T10:33:16.228262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.671401+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:16.671401+0000","last_peered":"2023-08-10T10:33:16.671401+0000","last_clean":"2023-08-10T10:33:16.671401+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:16.671401+0000","last_undegraded":"2023-08-10T10:33:16.671401+0000","last_fullsized":"2023-08-10T10:33:16.671401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:21.282539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558794+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:31:15.558794+0000","last_peered":"2023-08-10T10:31:15.558794+0000","last_clean":"2023-08-10T10:31:15.558794+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:31:15.558794+0000","last_undegraded":"2023-08-10T10:31:15.558794+0000","last_fullsized":"2023-08-10T10:31:15.558794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:20.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.521825+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:33:04.521825+0000","last_peered":"2023-08-10T10:33:04.521825+0000","last_clean":"2023-08-10T10:33:04.521825+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:04.521825+0000","last_undegraded":"2023-08-10T10:33:04.521825+0000","last_fullsized":"2023-08-10T10:33:04.521825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:46.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229247+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:33:16.229247+0000","last_peered":"2023-08-10T10:33:16.229247+0000","last_clean":"2023-08-10T10:33:16.229247+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:16.229247+0000","last_undegraded":"2023-08-10T10:33:16.229247+0000","last_fullsized":"2023-08-10T10:33:16.229247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:33.490533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664708+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:16.664708+0000","last_peered":"2023-08-10T10:33:16.664708+0000","last_clean":"2023-08-10T10:33:16.664708+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:16.664708+0000","last_undegraded":"2023-08-10T10:33:16.664708+0000","last_fullsized":"2023-08-10T10:33:16.664708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.379842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340578+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:31:15.340578+0000","last_peered":"2023-08-10T10:31:15.340578+0000","last_clean":"2023-08-10T10:31:15.340578+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:31:15.340578+0000","last_undegraded":"2023-08-10T10:31:15.340578+0000","last_fullsized":"2023-08-10T10:31:15.340578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:50.341770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298059+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:31:15.298059+0000","last_peered":"2023-08-10T10:31:15.298059+0000","last_clean":"2023-08-10T10:31:15.298059+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:31:15.298059+0000","last_undegraded":"2023-08-10T10:31:15.298059+0000","last_fullsized":"2023-08-10T10:31:15.298059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:07.488469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.223020+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:33:16.223020+0000","last_peered":"2023-08-10T10:33:16.223020+0000","last_clean":"2023-08-10T10:33:16.223020+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:16.223020+0000","last_undegraded":"2023-08-10T10:33:16.223020+0000","last_fullsized":"2023-08-10T10:33:16.223020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:35.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":436,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637941+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:33:16.637941+0000","last_peered":"2023-08-10T10:33:16.637941+0000","last_clean":"2023-08-10T10:33:16.637941+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:16.637941+0000","last_undegraded":"2023-08-10T10:33:16.637941+0000","last_fullsized":"2023-08-10T10:33:16.637941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:37.499897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.295972+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:31:15.295972+0000","last_peered":"2023-08-10T10:31:15.295972+0000","last_clean":"2023-08-10T10:31:15.295972+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:31:15.295972+0000","last_undegraded":"2023-08-10T10:31:15.295972+0000","last_fullsized":"2023-08-10T10:31:15.295972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:02.669208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:34.627598+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:32:34.627598+0000","last_peered":"2023-08-10T10:32:34.627598+0000","last_clean":"2023-08-10T10:32:34.627598+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:32:34.627598+0000","last_undegraded":"2023-08-10T10:32:34.627598+0000","last_fullsized":"2023-08-10T10:32:34.627598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:24.427296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229559+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:33:16.229559+0000","last_peered":"2023-08-10T10:33:16.229559+0000","last_clean":"2023-08-10T10:33:16.229559+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:16.229559+0000","last_undegraded":"2023-08-10T10:33:16.229559+0000","last_fullsized":"2023-08-10T10:33:16.229559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596480+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.596480+0000","last_peered":"2023-08-10T10:33:16.596480+0000","last_clean":"2023-08-10T10:33:16.596480+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.596480+0000","last_undegraded":"2023-08-10T10:33:16.596480+0000","last_fullsized":"2023-08-10T10:33:16.596480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340660+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:31:15.340660+0000","last_peered":"2023-08-10T10:31:15.340660+0000","last_clean":"2023-08-10T10:31:15.340660+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:31:15.340660+0000","last_undegraded":"2023-08-10T10:31:15.340660+0000","last_fullsized":"2023-08-10T10:31:15.340660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:12.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296544+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:31:15.296544+0000","last_peered":"2023-08-10T10:31:15.296544+0000","last_clean":"2023-08-10T10:31:15.296544+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:31:15.296544+0000","last_undegraded":"2023-08-10T10:31:15.296544+0000","last_fullsized":"2023-08-10T10:31:15.296544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:42.837063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298242+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:31:15.298242+0000","last_peered":"2023-08-10T10:31:15.298242+0000","last_clean":"2023-08-10T10:31:15.298242+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:31:15.298242+0000","last_undegraded":"2023-08-10T10:31:15.298242+0000","last_fullsized":"2023-08-10T10:31:15.298242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:38.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.245524+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:33:16.245524+0000","last_peered":"2023-08-10T10:33:16.245524+0000","last_clean":"2023-08-10T10:33:16.245524+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:16.245524+0000","last_undegraded":"2023-08-10T10:33:16.245524+0000","last_fullsized":"2023-08-10T10:33:16.245524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:07.362708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'425","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.621533+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:16.621533+0000","last_peered":"2023-08-10T10:33:16.621533+0000","last_clean":"2023-08-10T10:33:16.621533+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:16.621533+0000","last_undegraded":"2023-08-10T10:33:16.621533+0000","last_fullsized":"2023-08-10T10:33:16.621533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.363842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296820+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:31:15.296820+0000","last_peered":"2023-08-10T10:31:15.296820+0000","last_clean":"2023-08-10T10:31:15.296820+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:31:15.296820+0000","last_undegraded":"2023-08-10T10:31:15.296820+0000","last_fullsized":"2023-08-10T10:31:15.296820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:11.201211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.586148+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:33:16.586148+0000","last_peered":"2023-08-10T10:33:16.586148+0000","last_clean":"2023-08-10T10:33:16.586148+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:16.586148+0000","last_undegraded":"2023-08-10T10:33:16.586148+0000","last_fullsized":"2023-08-10T10:33:16.586148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:34.274732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":14,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218934+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:33:16.218934+0000","last_peered":"2023-08-10T10:33:16.218934+0000","last_clean":"2023-08-10T10:33:16.218934+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:16.218934+0000","last_undegraded":"2023-08-10T10:33:16.218934+0000","last_fullsized":"2023-08-10T10:33:16.218934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":490,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661787+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:33:16.661787+0000","last_peered":"2023-08-10T10:33:16.661787+0000","last_clean":"2023-08-10T10:33:16.661787+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:33:16.661787+0000","last_undegraded":"2023-08-10T10:33:16.661787+0000","last_fullsized":"2023-08-10T10:33:16.661787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:25.203845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297805+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:31:15.297805+0000","last_peered":"2023-08-10T10:31:15.297805+0000","last_clean":"2023-08-10T10:31:15.297805+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:31:15.297805+0000","last_undegraded":"2023-08-10T10:31:15.297805+0000","last_fullsized":"2023-08-10T10:31:15.297805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:40.440122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628271+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:32:39.628271+0000","last_peered":"2023-08-10T10:32:39.628271+0000","last_clean":"2023-08-10T10:32:39.628271+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:32:39.628271+0000","last_undegraded":"2023-08-10T10:32:39.628271+0000","last_fullsized":"2023-08-10T10:32:39.628271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230813+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:33:16.230813+0000","last_peered":"2023-08-10T10:33:16.230813+0000","last_clean":"2023-08-10T10:33:16.230813+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:16.230813+0000","last_undegraded":"2023-08-10T10:33:16.230813+0000","last_fullsized":"2023-08-10T10:33:16.230813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'510","reported_seq":528,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.630370+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:16.630370+0000","last_peered":"2023-08-10T10:33:16.630370+0000","last_clean":"2023-08-10T10:33:16.630370+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:16.630370+0000","last_undegraded":"2023-08-10T10:33:16.630370+0000","last_fullsized":"2023-08-10T10:33:16.630370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:24.347845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.638107+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:32:44.638107+0000","last_peered":"2023-08-10T10:32:44.638107+0000","last_clean":"2023-08-10T10:32:44.638107+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:32:44.638107+0000","last_undegraded":"2023-08-10T10:32:44.638107+0000","last_fullsized":"2023-08-10T10:32:44.638107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:37.634596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558852+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:31:15.558852+0000","last_peered":"2023-08-10T10:31:15.558852+0000","last_clean":"2023-08-10T10:31:15.558852+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:31:15.558852+0000","last_undegraded":"2023-08-10T10:31:15.558852+0000","last_fullsized":"2023-08-10T10:31:15.558852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:39.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229942+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:33:16.229942+0000","last_peered":"2023-08-10T10:33:16.229942+0000","last_clean":"2023-08-10T10:33:16.229942+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:16.229942+0000","last_undegraded":"2023-08-10T10:33:16.229942+0000","last_fullsized":"2023-08-10T10:33:16.229942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:41.589758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637452+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.637452+0000","last_peered":"2023-08-10T10:33:16.637452+0000","last_clean":"2023-08-10T10:33:16.637452+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.637452+0000","last_undegraded":"2023-08-10T10:33:16.637452+0000","last_fullsized":"2023-08-10T10:33:16.637452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:11.307754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132519+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:31:16.132519+0000","last_peered":"2023-08-10T10:31:16.132519+0000","last_clean":"2023-08-10T10:31:16.132519+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:31:16.132519+0000","last_undegraded":"2023-08-10T10:31:16.132519+0000","last_fullsized":"2023-08-10T10:31:16.132519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:08.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:13.521996+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:33:13.521996+0000","last_peered":"2023-08-10T10:33:13.521996+0000","last_clean":"2023-08-10T10:33:13.521996+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:13.521996+0000","last_undegraded":"2023-08-10T10:33:13.521996+0000","last_fullsized":"2023-08-10T10:33:13.521996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.231476+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:16.231476+0000","last_peered":"2023-08-10T10:33:16.231476+0000","last_clean":"2023-08-10T10:33:16.231476+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:16.231476+0000","last_undegraded":"2023-08-10T10:33:16.231476+0000","last_fullsized":"2023-08-10T10:33:16.231476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:22.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'434","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.619303+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:33:16.619303+0000","last_peered":"2023-08-10T10:33:16.619303+0000","last_clean":"2023-08-10T10:33:16.619303+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:16.619303+0000","last_undegraded":"2023-08-10T10:33:16.619303+0000","last_fullsized":"2023-08-10T10:33:16.619303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:14.330929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.299995+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:31:15.299995+0000","last_peered":"2023-08-10T10:31:15.299995+0000","last_clean":"2023-08-10T10:31:15.299995+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:31:15.299995+0000","last_undegraded":"2023-08-10T10:31:15.299995+0000","last_fullsized":"2023-08-10T10:31:15.299995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225207+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:33:16.225207+0000","last_peered":"2023-08-10T10:33:16.225207+0000","last_clean":"2023-08-10T10:33:16.225207+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:16.225207+0000","last_undegraded":"2023-08-10T10:33:16.225207+0000","last_fullsized":"2023-08-10T10:33:16.225207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625704+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:16.625704+0000","last_peered":"2023-08-10T10:33:16.625704+0000","last_clean":"2023-08-10T10:33:16.625704+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:16.625704+0000","last_undegraded":"2023-08-10T10:33:16.625704+0000","last_fullsized":"2023-08-10T10:33:16.625704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340816+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:31:15.340816+0000","last_peered":"2023-08-10T10:31:15.340816+0000","last_clean":"2023-08-10T10:31:15.340816+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:31:15.340816+0000","last_undegraded":"2023-08-10T10:31:15.340816+0000","last_fullsized":"2023-08-10T10:31:15.340816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.241892+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:33:16.241892+0000","last_peered":"2023-08-10T10:33:16.241892+0000","last_clean":"2023-08-10T10:33:16.241892+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:16.241892+0000","last_undegraded":"2023-08-10T10:33:16.241892+0000","last_fullsized":"2023-08-10T10:33:16.241892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:37.002252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664108+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:16.664108+0000","last_peered":"2023-08-10T10:33:16.664108+0000","last_clean":"2023-08-10T10:33:16.664108+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:16.664108+0000","last_undegraded":"2023-08-10T10:33:16.664108+0000","last_fullsized":"2023-08-10T10:33:16.664108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.646564+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:33:04.646564+0000","last_peered":"2023-08-10T10:33:04.646564+0000","last_clean":"2023-08-10T10:33:04.646564+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:04.646564+0000","last_undegraded":"2023-08-10T10:33:04.646564+0000","last_fullsized":"2023-08-10T10:33:04.646564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.239711+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:33:16.239711+0000","last_peered":"2023-08-10T10:33:16.239711+0000","last_clean":"2023-08-10T10:33:16.239711+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:16.239711+0000","last_undegraded":"2023-08-10T10:33:16.239711+0000","last_fullsized":"2023-08-10T10:33:16.239711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:13.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'469","reported_seq":487,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.666795+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:16.666795+0000","last_peered":"2023-08-10T10:33:16.666795+0000","last_clean":"2023-08-10T10:33:16.666795+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:16.666795+0000","last_undegraded":"2023-08-10T10:33:16.666795+0000","last_fullsized":"2023-08-10T10:33:16.666795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:55.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298977+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:31:15.298977+0000","last_peered":"2023-08-10T10:31:15.298977+0000","last_clean":"2023-08-10T10:31:15.298977+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:31:15.298977+0000","last_undegraded":"2023-08-10T10:31:15.298977+0000","last_fullsized":"2023-08-10T10:31:15.298977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'28","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228863+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:16.228863+0000","last_peered":"2023-08-10T10:33:16.228863+0000","last_clean":"2023-08-10T10:33:16.228863+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:16.228863+0000","last_undegraded":"2023-08-10T10:33:16.228863+0000","last_fullsized":"2023-08-10T10:33:16.228863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.526604+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:33:14.526604+0000","last_peered":"2023-08-10T10:33:14.526604+0000","last_clean":"2023-08-10T10:33:14.526604+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:14.526604+0000","last_undegraded":"2023-08-10T10:33:14.526604+0000","last_fullsized":"2023-08-10T10:33:14.526604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:59.704514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628991+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:32:39.628991+0000","last_peered":"2023-08-10T10:32:39.628991+0000","last_clean":"2023-08-10T10:32:39.628991+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:32:39.628991+0000","last_undegraded":"2023-08-10T10:32:39.628991+0000","last_fullsized":"2023-08-10T10:32:39.628991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:44.096010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244882+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:33:16.244882+0000","last_peered":"2023-08-10T10:33:16.244882+0000","last_clean":"2023-08-10T10:33:16.244882+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:16.244882+0000","last_undegraded":"2023-08-10T10:33:16.244882+0000","last_fullsized":"2023-08-10T10:33:16.244882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:36.250911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'35","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218228+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:33:16.218228+0000","last_peered":"2023-08-10T10:33:16.218228+0000","last_clean":"2023-08-10T10:33:16.218228+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:16.218228+0000","last_undegraded":"2023-08-10T10:33:16.218228+0000","last_fullsized":"2023-08-10T10:33:16.218228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229043+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:16.229043+0000","last_peered":"2023-08-10T10:33:16.229043+0000","last_clean":"2023-08-10T10:33:16.229043+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:16.229043+0000","last_undegraded":"2023-08-10T10:33:16.229043+0000","last_fullsized":"2023-08-10T10:33:16.229043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244938+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:16.244938+0000","last_peered":"2023-08-10T10:33:16.244938+0000","last_clean":"2023-08-10T10:33:16.244938+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:16.244938+0000","last_undegraded":"2023-08-10T10:33:16.244938+0000","last_fullsized":"2023-08-10T10:33:16.244938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:09.195453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230396+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:16.230396+0000","last_peered":"2023-08-10T10:33:16.230396+0000","last_clean":"2023-08-10T10:33:16.230396+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:16.230396+0000","last_undegraded":"2023-08-10T10:33:16.230396+0000","last_fullsized":"2023-08-10T10:33:16.230396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:40.885396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.214509+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:33:16.214509+0000","last_peered":"2023-08-10T10:33:16.214509+0000","last_clean":"2023-08-10T10:33:16.214509+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:16.214509+0000","last_undegraded":"2023-08-10T10:33:16.214509+0000","last_fullsized":"2023-08-10T10:33:16.214509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":165675008,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":1027072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14846,"ondisk_log_size":14846,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1550,"ondisk_log_size":1550,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2088160,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":677,"num_write_kb":2520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4235264,"data_stored":4176320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":55680,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":57016320,"data_stored":56806142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":0.83999999999999997,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":9.3949999999999996,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":2.4889999999999999,"5min":0.96499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":0.78800000000000003,"15min":0.66600000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.82099999999999995,"15min":0.73899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":11.577999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.03,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.0609999999999999,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":22.148,"5min":22.148,"15min":22.148},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.84699999999999998,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":10.237,"5min":10.237,"15min":10.237},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.8240000000000001,"5min":0.98799999999999999,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":0.81899999999999995,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.4500000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.911,"5min":0.93300000000000005,"15min":0.77000000000000002},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.779,"5min":11.779,"15min":11.779},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.83999999999999997,"15min":0.80300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.5309999999999999,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.624}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":0.93600000000000005,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.5129999999999999,"5min":7.5129999999999999,"15min":7.5129999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.389,"5min":0.85099999999999998,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":7.3460000000000001,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62652,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94309188,"statfs":{"total":96636764160,"available":96572608512,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":0.98699999999999999,"15min":0.80900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":2.569,"5min":1.1259999999999999,"15min":0.88600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.914,"5min":10.914,"15min":10.914},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.1200000000000001,"5min":1.2130000000000001,"15min":0.89500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":14.93,"5min":14.93,"15min":14.93},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.6419999999999999,"5min":1.1299999999999999,"15min":0.878},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":10.957000000000001,"5min":10.957000000000001,"15min":10.957000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.218,"15min":0.877},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":19.654,"5min":19.654,"15min":19.654},"last":0.53700000000000003},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.1060000000000001,"15min":0.85399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":12.848000000000001,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":1.206,"15min":0.91300000000000003},"min":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.625},{"interface":"front","average":{"1min":3.7080000000000002,"5min":1.3680000000000001,"15min":0.97799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":19.907,"5min":19.907,"15min":19.907},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":0.88500000000000001,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":5.9630000000000001,"5min":5.9630000000000001,"15min":5.9630000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.421,"5min":0.84899999999999998,"15min":0.754},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":6.7199999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":0.91800000000000004,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.435},{"interface":"front","average":{"1min":1.524,"5min":0.90300000000000002,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.0739999999999998,"5min":1.026,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.1639999999999997,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.502}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81084,"kb_used_data":45876,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94290756,"statfs":{"total":96636764160,"available":96553734144,"internally_reserved":0,"allocated":46977024,"data_stored":46795807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.47699999999999998,"15min":0.439},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.50900000000000001,"15min":0.46300000000000002},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.58799999999999997,"15min":0.499},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":8.016,"5min":8.016,"15min":8.016},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.59099999999999997,"15min":0.54800000000000004},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":0.88,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":10.734,"5min":10.734,"15min":10.734},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.83799999999999997,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":0.88600000000000001,"15min":0.77800000000000002},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":10.444000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.1619999999999999,"5min":1.0669999999999999,"15min":0.88500000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":21.681999999999999,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":0.91300000000000003,"15min":0.83999999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":10.516,"5min":10.516,"15min":10.516},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":0.94199999999999995,"15min":0.85999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.65200000000000002,"5min":0.622,"15min":0.622},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.7,"5min":0.98199999999999998,"15min":0.86199999999999999},"min":{"1min":0.67900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78600,"kb_used_data":43392,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94293240,"statfs":{"total":96636764160,"available":96556277760,"internally_reserved":0,"allocated":44433408,"data_stored":44247653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.68300000000000005,"15min":0.61699999999999999},"min":{"1min":0.30499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":6.0490000000000004,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.497},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.3780000000000001,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":0.65200000000000002,"15min":0.56200000000000006},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.4589999999999996,"5min":5.4589999999999996,"15min":5.4589999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.27,"5min":0.95399999999999996,"15min":0.90100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.6970000000000001,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.443}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":0.95599999999999996,"15min":0.79900000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.466,"5min":0.83399999999999996,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.0069999999999997,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.234,"15min":1.254},"min":{"1min":0.51300000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.5460000000000003,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.992,"5min":1.135,"15min":0.99199999999999999},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.78100000000000003,"15min":0.73299999999999998},"min":{"1min":0.45500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0830000000000002,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":1.163,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":17.001999999999999,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":2.2999999999999998,"5min":1.0580000000000001,"15min":0.85099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":13.141,"5min":13.141,"15min":13.141},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":1.234,"15min":1.135},"min":{"1min":0.66600000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.9569999999999999,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":2.2949999999999999,"5min":1.264,"15min":1.0920000000000001},"min":{"1min":0.625,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":17.032,"5min":17.032,"15min":17.032},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71868,"kb_used_data":40756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94299972,"statfs":{"total":96636764160,"available":96563171328,"internally_reserved":0,"allocated":41734144,"data_stored":41552927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.56699999999999995,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.52600000000000002,"15min":0.46800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.7250000000000001,"5min":0.94499999999999995,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":11.686,"5min":11.686,"15min":11.686},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.61599999999999999,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":0.77100000000000002,"15min":0.61199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.042,"5min":0.68500000000000005,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.90500000000000003,"15min":0.76600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.3740000000000006,"5min":9.3740000000000006,"15min":9.3740000000000006},"last":0.67000000000000004},{"interface":"front","average":{"1min":2.1030000000000002,"5min":0.99099999999999999,"15min":0.80500000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.656000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0470000000000002,"5min":1.0109999999999999,"15min":0.83799999999999997},"min":{"1min":0.505,"5min":0.499,"15min":0.499},"max":{"1min":10.923,"5min":10.923,"15min":10.923},"last":0.63},{"interface":"front","average":{"1min":2.1749999999999998,"5min":1.044,"15min":0.85599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":10.634,"5min":10.634,"15min":10.634},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":3.0990000000000002,"5min":1.216,"15min":0.90200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.618,"5min":11.618,"15min":11.618},"last":0.54200000000000004},{"interface":"front","average":{"1min":3.004,"5min":1.224,"15min":0.92800000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":10.885999999999999,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":1.0660000000000001,"15min":0.89300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":9.3399999999999999,"5min":9.3399999999999999,"15min":9.3399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.0289999999999999,"15min":0.86099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":9.4269999999999996,"5min":9.4269999999999996,"15min":9.4269999999999996},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65728,"kb_used_data":34616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94306112,"statfs":{"total":96636764160,"available":96569458688,"internally_reserved":0,"allocated":35446784,"data_stored":35261561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.62,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":0.70499999999999996,"15min":0.59299999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.143000000000001,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2010000000000001,"15min":1.181},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.923,"5min":12.754,"15min":12.754},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":0.86399999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":0.93500000000000005,"15min":0.79600000000000004},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":16.927,"5min":16.927,"15min":16.927},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":0.93200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.014,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":12.465999999999999,"5min":12.465999999999999,"15min":12.465999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":0.92000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":2.2370000000000001,"5min":1.0940000000000001,"15min":0.90400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":17.664000000000001,"5min":17.664000000000001,"15min":17.664000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":1.111,"15min":0.90600000000000003},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.95099999999999996},{"interface":"front","average":{"1min":2.1139999999999999,"5min":1.0580000000000001,"15min":0.88200000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":12.504,"5min":12.504,"15min":12.504},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.93799999999999994,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.90500000000000003},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.1459999999999999,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":16.977,"5min":16.977,"15min":16.977},"last":0.98699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76996,"kb_used_data":41788,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94294844,"statfs":{"total":96636764160,"available":96557920256,"internally_reserved":0,"allocated":42790912,"data_stored":42591769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3,1,1,1,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":0.94299999999999995,"15min":0.76500000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":19.064,"5min":19.064,"15min":19.064},"last":69.530000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.109,"15min":0.94999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.238,"5min":11.238,"15min":11.238},"last":19.388000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":1.0629999999999999,"15min":0.88900000000000001},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":64.784999999999997},{"interface":"front","average":{"1min":2.722,"5min":1.242,"15min":0.996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":19.033999999999999,"5min":19.033999999999999,"15min":19.033999999999999},"last":120.05}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1760000000000002,"5min":1.014,"15min":0.81999999999999995},"min":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":18.948,"5min":18.948,"15min":18.948},"last":119.992},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.1879999999999999,"15min":1.081},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":30.984000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.0189999999999999,"15min":0.86099999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":11.279,"5min":11.279,"15min":11.279},"last":64.823999999999998},{"interface":"front","average":{"1min":1.5960000000000001,"5min":0.96799999999999997,"15min":0.86299999999999999},"min":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":10.962999999999999,"5min":10.962999999999999,"15min":10.962999999999999},"last":30.940000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8240000000000001,"5min":1.073,"15min":0.94799999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":19,"5min":19,"15min":19},"last":165.98500000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.84899999999999998,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.4100000000000001,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":125.369}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.446,"15min":1.458},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.029,"5min":12.381,"15min":12.381},"last":113.884},{"interface":"front","average":{"1min":1.5369999999999999,"5min":0.96099999999999997,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.441,"15min":0.441},"max":{"1min":8.5950000000000006,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":124.836}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.91600000000000004,"15min":0.89400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.448,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":67.281999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.89200000000000002,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":125.12}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68804,"kb_used_data":37692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94303036,"statfs":{"total":96636764160,"available":96566308864,"internally_reserved":0,"allocated":38596608,"data_stored":38407851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.046,"15min":1.024},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.9859999999999998,"5min":6.7640000000000002,"15min":6.7640000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5970000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.22,"15min":1.1870000000000001},"min":{"1min":0.52000000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.9379999999999997,"5min":9.5939999999999994,"15min":9.5939999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.595,"5min":1.111,"15min":1.0309999999999999},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":11.625,"5min":11.625,"15min":11.625},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.02,"15min":1.042},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.504,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.96299999999999997,"15min":0.98699999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.579,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3180000000000001,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1930000000000001,"15min":1.256},"min":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5309999999999999,"5min":10.688000000000001,"15min":10.688000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65800000000000003,"15min":0.63800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":0.80000000000000004,"15min":0.751},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77300000000000002,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.581,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2105344,"data_stored":2087418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2105344,"data_stored":2079935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43515904,"data_stored":43515904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46661632,"data_stored":46661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41418752,"data_stored":41418752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35127296,"data_stored":35127296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40370176,"data_stored":40370176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38273024,"data_stored":38273024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":54001664,"data_stored":54001664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:33:21.870 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-10T10:33:21.871 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:33:22.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.094+0000 7f47967ff700 1 Processor -- start 2023-08-10T10:33:22.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.094+0000 7f47967ff700 1 -- start start 2023-08-10T10:33:22.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f479015cf20 0x7f479015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47900b8870 0x7f47900b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b5040 0x7f479006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900cde30 con 0x7f47900b8870 2023-08-10T10:33:22.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900b54b0 con 0x7f479015cf20 2023-08-10T10:33:22.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f47967ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479015e590 con 0x7f47900b5040 2023-08-10T10:33:22.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.095+0000 7f478f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47900b8870 0x7f47900b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f47900b8870 0x7f47900b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45422/0 (socket says 172.21.15.88:45422) 2023-08-10T10:33:22.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 -- 172.21.15.88:0/2732421013 learned_addr learned my addr 172.21.15.88:0/2732421013 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:22.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f4794d9c700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b5040 0x7f479006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.099 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478ffff700 1 --2- 172.21.15.88:0/2732421013 >> v2:172.21.15.187:3300/0 conn(0x7f479015cf20 0x7f479015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 -- 172.21.15.88:0/2732421013 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b5040 msgr2=0x7f479006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:22.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b5040 0x7f479006a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 -- 172.21.15.88:0/2732421013 >> v2:172.21.15.187:3300/0 conn(0x7f479015cf20 msgr2=0x7f479015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 --2- 172.21.15.88:0/2732421013 >> v2:172.21.15.187:3300/0 conn(0x7f479015cf20 0x7f479015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 -- 172.21.15.88:0/2732421013 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47900b8e30 con 0x7f47900b8870 2023-08-10T10:33:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478f7fe700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47900b8870 0x7f47900b4b00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f479006d190 tx=0x7f4784009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13e1d60a500361a server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478effd700 1 -- 172.21.15.88:0/2732421013 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400b860 con 0x7f47900b8870 2023-08-10T10:33:22.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478effd700 1 -- 172.21.15.88:0/2732421013 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478400b9c0 con 0x7f47900b8870 2023-08-10T10:33:22.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.096+0000 7f478effd700 1 -- 172.21.15.88:0/2732421013 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478400bd50 con 0x7f47900b8870 2023-08-10T10:33:22.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 -- 172.21.15.88:0/2732421013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47900b8870 msgr2=0x7f47900b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47900b8870 0x7f47900b4b00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f479006d190 tx=0x7f4784009c00 comp rx=0 tx=0).stop 2023-08-10T10:33:22.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 -- 172.21.15.88:0/2732421013 shutdown_connections 2023-08-10T10:33:22.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 --2- 172.21.15.88:0/2732421013 >> v2:172.21.15.187:3300/0 conn(0x7f479015cf20 0x7f479015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b5040 0x7f479006a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 --2- 172.21.15.88:0/2732421013 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47900b8870 0x7f47900b4b00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 -- 172.21.15.88:0/2732421013 >> 172.21.15.88:0/2732421013 conn(0x7f47900d3080 msgr2=0x7f47900d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:22.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 -- 172.21.15.88:0/2732421013 shutdown_connections 2023-08-10T10:33:22.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.097+0000 7f47967ff700 1 -- 172.21.15.88:0/2732421013 wait complete. 2023-08-10T10:33:22.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.099+0000 7f47967ff700 1 Processor -- start 2023-08-10T10:33:22.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.099+0000 7f47967ff700 1 -- start start 2023-08-10T10:33:22.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 0x7f4790158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 0x7f4790159ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790159980 con 0x7f479015cf20 2023-08-10T10:33:22.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47901593d0 con 0x7f47900b5040 2023-08-10T10:33:22.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f47967ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47901596a0 con 0x7f47900b8870 2023-08-10T10:33:22.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45438/0 (socket says 172.21.15.88:45438) 2023-08-10T10:33:22.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 -- 172.21.15.88:0/739358984 learned_addr learned my addr 172.21.15.88:0/739358984 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:22.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f478f7fe700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 0x7f4790159ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f478ffff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 0x7f4790158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 -- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 msgr2=0x7f4790159ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 0x7f4790159ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.100+0000 7f4794d9c700 1 -- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 msgr2=0x7f4790158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f4794d9c700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 0x7f4790158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f4794d9c700 1 -- 172.21.15.88:0/739358984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4784009550 con 0x7f479015cf20 2023-08-10T10:33:22.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f478f7fe700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 0x7f4790159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:22.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f478ffff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 0x7f4790158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:22.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f4794d9c700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4788007d10 tx=0x7f478800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800ede0 con 0x7f479015cf20 2023-08-10T10:33:22.110 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788014420 con 0x7f479015cf20 2023-08-10T10:33:22.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47900ca1d0 con 0x7f479015cf20 2023-08-10T10:33:22.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880147d0 con 0x7f479015cf20 2023-08-10T10:33:22.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.101+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900ca790 con 0x7f479015cf20 2023-08-10T10:33:22.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.102+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f479004ecc0 con 0x7f479015cf20 2023-08-10T10:33:22.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.103+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4788014930 con 0x7f479015cf20 2023-08-10T10:33:22.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.104+0000 7f478cff9700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 0x7f477c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.104+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4788089f80 con 0x7f479015cf20 2023-08-10T10:33:22.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.104+0000 7f478ffff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 0x7f477c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.105+0000 7f478ffff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 0x7f477c06d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4780009820 tx=0x7f4780008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.108+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4788054c60 con 0x7f479015cf20 2023-08-10T10:33:22.301 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.299+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47900ce2f0 con 0x7f477c06ace0 2023-08-10T10:33:22.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.310+0000 7f478cff9700 1 -- 172.21.15.88:0/739358984 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391942 (secure 0 0 0) 0x7f4780015440 con 0x7f477c06ace0 2023-08-10T10:33:22.315 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:22.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 msgr2=0x7f477c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 0x7f477c06d1a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4780009820 tx=0x7f4780008040 comp rx=0 tx=0).stop 2023-08-10T10:33:22.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 msgr2=0x7f479015a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4788007d10 tx=0x7f478800e3c0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 shutdown_connections 2023-08-10T10:33:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f479015cf20 0x7f479015a530 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47900b5040 0x7f4790158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f477c06ace0 0x7f477c06d1a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 --2- 172.21.15.88:0/739358984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47900b8870 0x7f4790159ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 >> 172.21.15.88:0/739358984 conn(0x7f47900d3080 msgr2=0x7f47900b8090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:22.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 shutdown_connections 2023-08-10T10:33:22.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.315+0000 7f47967ff700 1 -- 172.21.15.88:0/739358984 wait complete. 2023-08-10T10:33:22.320 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:33:22.335 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2023-08-10T10:33:21.602524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":168353536,"num_objects":66,"num_object_clones":0,"num_object_copies":214,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":130,"num_read_kb":117,"num_write":1310,"num_write_kb":1032008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17189,"ondisk_log_size":17189,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":596620,"kb_used_data":331340,"kb_used_omap":13,"kb_used_meta":265202,"kb_avail":754378100,"statfs":{"total":773094113280,"available":772483174400,"internally_reserved":0,"allocated":339292160,"data_stored":337779453,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":271566936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3,1,1,1,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":47,"apply_latency_ms":47,"commit_latency_ns":47000000,"apply_latency_ns":47000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-234572658,"num_objects":-55,"num_object_clones":0,"num_object_copies":-220,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-55,"num_whiteouts":0,"num_read":8,"num_read_kb":10,"num_write":508,"num_write_kb":636284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002503"},"pg_stats":[{"pgid":"4.3f","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228032+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:33:16.228032+0000","last_peered":"2023-08-10T10:33:16.228032+0000","last_clean":"2023-08-10T10:33:16.228032+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:16.228032+0000","last_undegraded":"2023-08-10T10:33:16.228032+0000","last_fullsized":"2023-08-10T10:33:16.228032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227989+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:16.227989+0000","last_peered":"2023-08-10T10:33:16.227989+0000","last_clean":"2023-08-10T10:33:16.227989+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:16.227989+0000","last_undegraded":"2023-08-10T10:33:16.227989+0000","last_fullsized":"2023-08-10T10:33:16.227989+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625516+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:16.625516+0000","last_peered":"2023-08-10T10:33:16.625516+0000","last_clean":"2023-08-10T10:33:16.625516+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:16.625516+0000","last_undegraded":"2023-08-10T10:33:16.625516+0000","last_fullsized":"2023-08-10T10:33:16.625516+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.075290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215525+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:33:16.215525+0000","last_peered":"2023-08-10T10:33:16.215525+0000","last_clean":"2023-08-10T10:33:16.215525+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:16.215525+0000","last_undegraded":"2023-08-10T10:33:16.215525+0000","last_fullsized":"2023-08-10T10:33:16.215525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:59.927282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230603+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:33:16.230603+0000","last_peered":"2023-08-10T10:33:16.230603+0000","last_clean":"2023-08-10T10:33:16.230603+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:16.230603+0000","last_undegraded":"2023-08-10T10:33:16.230603+0000","last_fullsized":"2023-08-10T10:33:16.230603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.236136+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:16.236136+0000","last_peered":"2023-08-10T10:33:16.236136+0000","last_clean":"2023-08-10T10:33:16.236136+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:16.236136+0000","last_undegraded":"2023-08-10T10:33:16.236136+0000","last_fullsized":"2023-08-10T10:33:16.236136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.385568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215290+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:33:16.215290+0000","last_peered":"2023-08-10T10:33:16.215290+0000","last_clean":"2023-08-10T10:33:16.215290+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:16.215290+0000","last_undegraded":"2023-08-10T10:33:16.215290+0000","last_fullsized":"2023-08-10T10:33:16.215290+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:22.895395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225385+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:16.225385+0000","last_peered":"2023-08-10T10:33:16.225385+0000","last_clean":"2023-08-10T10:33:16.225385+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:16.225385+0000","last_undegraded":"2023-08-10T10:33:16.225385+0000","last_fullsized":"2023-08-10T10:33:16.225385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'30","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.214785+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:16.214785+0000","last_peered":"2023-08-10T10:33:16.214785+0000","last_clean":"2023-08-10T10:33:16.214785+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:16.214785+0000","last_undegraded":"2023-08-10T10:33:16.214785+0000","last_fullsized":"2023-08-10T10:33:16.214785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:19.279630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'36","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228237+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:33:16.228237+0000","last_peered":"2023-08-10T10:33:16.228237+0000","last_clean":"2023-08-10T10:33:16.228237+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:16.228237+0000","last_undegraded":"2023-08-10T10:33:16.228237+0000","last_fullsized":"2023-08-10T10:33:16.228237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244641+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:33:16.244641+0000","last_peered":"2023-08-10T10:33:16.244641+0000","last_clean":"2023-08-10T10:33:16.244641+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:16.244641+0000","last_undegraded":"2023-08-10T10:33:16.244641+0000","last_fullsized":"2023-08-10T10:33:16.244641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:54.096841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.210763+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:33:16.210763+0000","last_peered":"2023-08-10T10:33:16.210763+0000","last_clean":"2023-08-10T10:33:16.210763+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:16.210763+0000","last_undegraded":"2023-08-10T10:33:16.210763+0000","last_fullsized":"2023-08-10T10:33:16.210763+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.194328+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:33:16.194328+0000","last_peered":"2023-08-10T10:33:16.194328+0000","last_clean":"2023-08-10T10:33:16.194328+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:16.194328+0000","last_undegraded":"2023-08-10T10:33:16.194328+0000","last_fullsized":"2023-08-10T10:33:16.194328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227080+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:33:16.227080+0000","last_peered":"2023-08-10T10:33:16.227080+0000","last_clean":"2023-08-10T10:33:16.227080+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:16.227080+0000","last_undegraded":"2023-08-10T10:33:16.227080+0000","last_fullsized":"2023-08-10T10:33:16.227080+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:45.102687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.215084+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:33:16.215084+0000","last_peered":"2023-08-10T10:33:16.215084+0000","last_clean":"2023-08-10T10:33:16.215084+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:33:16.215084+0000","last_undegraded":"2023-08-10T10:33:16.215084+0000","last_fullsized":"2023-08-10T10:33:16.215084+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243965+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:16.243965+0000","last_peered":"2023-08-10T10:33:16.243965+0000","last_clean":"2023-08-10T10:33:16.243965+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:16.243965+0000","last_undegraded":"2023-08-10T10:33:16.243965+0000","last_fullsized":"2023-08-10T10:33:16.243965+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:54.252670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'28","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.651627+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:33:16.651627+0000","last_peered":"2023-08-10T10:33:16.651627+0000","last_clean":"2023-08-10T10:33:16.651627+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:33:16.651627+0000","last_undegraded":"2023-08-10T10:33:16.651627+0000","last_fullsized":"2023-08-10T10:33:16.651627+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:10.276146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.226549+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:33:16.226549+0000","last_peered":"2023-08-10T10:33:16.226549+0000","last_clean":"2023-08-10T10:33:16.226549+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:16.226549+0000","last_undegraded":"2023-08-10T10:33:16.226549+0000","last_fullsized":"2023-08-10T10:33:16.226549+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:41.704636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218369+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:33:16.218369+0000","last_peered":"2023-08-10T10:33:16.218369+0000","last_clean":"2023-08-10T10:33:16.218369+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:16.218369+0000","last_undegraded":"2023-08-10T10:33:16.218369+0000","last_fullsized":"2023-08-10T10:33:16.218369+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:46.253304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244572+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:33:16.244572+0000","last_peered":"2023-08-10T10:33:16.244572+0000","last_clean":"2023-08-10T10:33:16.244572+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:16.244572+0000","last_undegraded":"2023-08-10T10:33:16.244572+0000","last_fullsized":"2023-08-10T10:33:16.244572+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:28.531313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230142+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:16.230142+0000","last_peered":"2023-08-10T10:33:16.230142+0000","last_clean":"2023-08-10T10:33:16.230142+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:16.230142+0000","last_undegraded":"2023-08-10T10:33:16.230142+0000","last_fullsized":"2023-08-10T10:33:16.230142+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.224403+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:33:16.224403+0000","last_peered":"2023-08-10T10:33:16.224403+0000","last_clean":"2023-08-10T10:33:16.224403+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:16.224403+0000","last_undegraded":"2023-08-10T10:33:16.224403+0000","last_fullsized":"2023-08-10T10:33:16.224403+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229001+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:33:16.229001+0000","last_peered":"2023-08-10T10:33:16.229001+0000","last_clean":"2023-08-10T10:33:16.229001+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:16.229001+0000","last_undegraded":"2023-08-10T10:33:16.229001+0000","last_fullsized":"2023-08-10T10:33:16.229001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230115+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:16.230115+0000","last_peered":"2023-08-10T10:33:16.230115+0000","last_clean":"2023-08-10T10:33:16.230115+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:16.230115+0000","last_undegraded":"2023-08-10T10:33:16.230115+0000","last_fullsized":"2023-08-10T10:33:16.230115+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.219153+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:33:16.219153+0000","last_peered":"2023-08-10T10:33:16.219153+0000","last_clean":"2023-08-10T10:33:16.219153+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:16.219153+0000","last_undegraded":"2023-08-10T10:33:16.219153+0000","last_fullsized":"2023-08-10T10:33:16.219153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.220593+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:33:16.220593+0000","last_peered":"2023-08-10T10:33:16.220593+0000","last_clean":"2023-08-10T10:33:16.220593+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:16.220593+0000","last_undegraded":"2023-08-10T10:33:16.220593+0000","last_fullsized":"2023-08-10T10:33:16.220593+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229027+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:33:16.229027+0000","last_peered":"2023-08-10T10:33:16.229027+0000","last_clean":"2023-08-10T10:33:16.229027+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:16.229027+0000","last_undegraded":"2023-08-10T10:33:16.229027+0000","last_fullsized":"2023-08-10T10:33:16.229027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'443","reported_seq":461,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625580+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:16.625580+0000","last_peered":"2023-08-10T10:33:16.625580+0000","last_clean":"2023-08-10T10:33:16.625580+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:16.625580+0000","last_undegraded":"2023-08-10T10:33:16.625580+0000","last_fullsized":"2023-08-10T10:33:16.625580+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:11:32.547675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296882+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:31:15.296882+0000","last_peered":"2023-08-10T10:31:15.296882+0000","last_clean":"2023-08-10T10:31:15.296882+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:31:15.296882+0000","last_undegraded":"2023-08-10T10:31:15.296882+0000","last_fullsized":"2023-08-10T10:31:15.296882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:35:24.254384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227376+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:16.227376+0000","last_peered":"2023-08-10T10:33:16.227376+0000","last_clean":"2023-08-10T10:33:16.227376+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:16.227376+0000","last_undegraded":"2023-08-10T10:33:16.227376+0000","last_fullsized":"2023-08-10T10:33:16.227376+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'469","reported_seq":487,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.640008+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:33:16.640008+0000","last_peered":"2023-08-10T10:33:16.640008+0000","last_clean":"2023-08-10T10:33:16.640008+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:33:16.640008+0000","last_undegraded":"2023-08-10T10:33:16.640008+0000","last_fullsized":"2023-08-10T10:33:16.640008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:28.669274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":18432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558123+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:31:15.558123+0000","last_peered":"2023-08-10T10:31:15.558123+0000","last_clean":"2023-08-10T10:31:15.558123+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:31:15.558123+0000","last_undegraded":"2023-08-10T10:31:15.558123+0000","last_fullsized":"2023-08-10T10:31:15.558123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.099809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.222029+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:33:16.222029+0000","last_peered":"2023-08-10T10:33:16.222029+0000","last_clean":"2023-08-10T10:33:16.222029+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:16.222029+0000","last_undegraded":"2023-08-10T10:33:16.222029+0000","last_fullsized":"2023-08-10T10:33:16.222029+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'474","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596287+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:16.596287+0000","last_peered":"2023-08-10T10:33:16.596287+0000","last_clean":"2023-08-10T10:33:16.596287+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:16.596287+0000","last_undegraded":"2023-08-10T10:33:16.596287+0000","last_fullsized":"2023-08-10T10:33:16.596287+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297997+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:31:15.297997+0000","last_peered":"2023-08-10T10:31:15.297997+0000","last_clean":"2023-08-10T10:31:15.297997+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:31:15.297997+0000","last_undegraded":"2023-08-10T10:31:15.297997+0000","last_fullsized":"2023-08-10T10:31:15.297997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.231180+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:33:16.231180+0000","last_peered":"2023-08-10T10:33:16.231180+0000","last_clean":"2023-08-10T10:33:16.231180+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:16.231180+0000","last_undegraded":"2023-08-10T10:33:16.231180+0000","last_fullsized":"2023-08-10T10:33:16.231180+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.640017+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:33:16.640017+0000","last_peered":"2023-08-10T10:33:16.640017+0000","last_clean":"2023-08-10T10:33:16.640017+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:33:16.640017+0000","last_undegraded":"2023-08-10T10:33:16.640017+0000","last_fullsized":"2023-08-10T10:33:16.640017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:11.329930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.566167+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:32:59.566167+0000","last_peered":"2023-08-10T10:32:59.566167+0000","last_clean":"2023-08-10T10:32:59.566167+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:32:59.566167+0000","last_undegraded":"2023-08-10T10:32:59.566167+0000","last_fullsized":"2023-08-10T10:32:59.566167+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:25.133924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227076+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:33:16.227076+0000","last_peered":"2023-08-10T10:33:16.227076+0000","last_clean":"2023-08-10T10:33:16.227076+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:16.227076+0000","last_undegraded":"2023-08-10T10:33:16.227076+0000","last_fullsized":"2023-08-10T10:33:16.227076+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'463","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661846+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:16.661846+0000","last_peered":"2023-08-10T10:33:16.661846+0000","last_clean":"2023-08-10T10:33:16.661846+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:16.661846+0000","last_undegraded":"2023-08-10T10:33:16.661846+0000","last_fullsized":"2023-08-10T10:33:16.661846+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":463,"log_dups_size":0,"ondisk_log_size":463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:49.157469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.644932+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:32:59.644932+0000","last_peered":"2023-08-10T10:32:59.644932+0000","last_clean":"2023-08-10T10:32:59.644932+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:32:59.644932+0000","last_undegraded":"2023-08-10T10:32:59.644932+0000","last_fullsized":"2023-08-10T10:32:59.644932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230587+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:16.230587+0000","last_peered":"2023-08-10T10:33:16.230587+0000","last_clean":"2023-08-10T10:33:16.230587+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:16.230587+0000","last_undegraded":"2023-08-10T10:33:16.230587+0000","last_fullsized":"2023-08-10T10:33:16.230587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.681597+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.681597+0000","last_peered":"2023-08-10T10:33:16.681597+0000","last_clean":"2023-08-10T10:33:16.681597+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.681597+0000","last_undegraded":"2023-08-10T10:33:16.681597+0000","last_fullsized":"2023-08-10T10:33:16.681597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:55.391226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'11","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.684491+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:33:12.684491+0000","last_peered":"2023-08-10T10:33:12.684491+0000","last_clean":"2023-08-10T10:33:12.684491+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:12.684491+0000","last_undegraded":"2023-08-10T10:33:12.684491+0000","last_fullsized":"2023-08-10T10:33:12.684491+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225951+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:33:16.225951+0000","last_peered":"2023-08-10T10:33:16.225951+0000","last_clean":"2023-08-10T10:33:16.225951+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:16.225951+0000","last_undegraded":"2023-08-10T10:33:16.225951+0000","last_fullsized":"2023-08-10T10:33:16.225951+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:40:31.121005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'453","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596074+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:16.596074+0000","last_peered":"2023-08-10T10:33:16.596074+0000","last_clean":"2023-08-10T10:33:16.596074+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:16.596074+0000","last_undegraded":"2023-08-10T10:33:16.596074+0000","last_fullsized":"2023-08-10T10:33:16.596074+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:35.104002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'594","reported_seq":620,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:18.557387+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:33:18.557387+0000","last_peered":"2023-08-10T10:33:18.557387+0000","last_clean":"2023-08-10T10:33:18.557387+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:18.557387+0000","last_undegraded":"2023-08-10T10:33:18.557387+0000","last_fullsized":"2023-08-10T10:33:18.557387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:21.332327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2079719,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":593,"num_write_kb":2471,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244018+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:16.244018+0000","last_peered":"2023-08-10T10:33:16.244018+0000","last_clean":"2023-08-10T10:33:16.244018+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:16.244018+0000","last_undegraded":"2023-08-10T10:33:16.244018+0000","last_fullsized":"2023-08-10T10:33:16.244018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:17.491868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.672394+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:16.672394+0000","last_peered":"2023-08-10T10:33:16.672394+0000","last_clean":"2023-08-10T10:33:16.672394+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:16.672394+0000","last_undegraded":"2023-08-10T10:33:16.672394+0000","last_fullsized":"2023-08-10T10:33:16.672394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:30.844193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297505+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:31:15.297505+0000","last_peered":"2023-08-10T10:31:15.297505+0000","last_clean":"2023-08-10T10:31:15.297505+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:31:15.297505+0000","last_undegraded":"2023-08-10T10:31:15.297505+0000","last_fullsized":"2023-08-10T10:31:15.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'23","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229623+0000","last_change":"2023-08-10T10:31:15.344082+0000","last_active":"2023-08-10T10:33:16.229623+0000","last_peered":"2023-08-10T10:33:16.229623+0000","last_clean":"2023-08-10T10:33:16.229623+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:16.229623+0000","last_undegraded":"2023-08-10T10:33:16.229623+0000","last_fullsized":"2023-08-10T10:33:16.229623+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:16.251149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'448","reported_seq":466,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.613265+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:16.613265+0000","last_peered":"2023-08-10T10:33:16.613265+0000","last_clean":"2023-08-10T10:33:16.613265+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:16.613265+0000","last_undegraded":"2023-08-10T10:33:16.613265+0000","last_fullsized":"2023-08-10T10:33:16.613265+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:47.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298926+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:31:15.298926+0000","last_peered":"2023-08-10T10:31:15.298926+0000","last_clean":"2023-08-10T10:31:15.298926+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:31:15.298926+0000","last_undegraded":"2023-08-10T10:31:15.298926+0000","last_fullsized":"2023-08-10T10:31:15.298926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:49.308799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228843+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:33:16.228843+0000","last_peered":"2023-08-10T10:33:16.228843+0000","last_clean":"2023-08-10T10:33:16.228843+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:33:16.228843+0000","last_undegraded":"2023-08-10T10:33:16.228843+0000","last_fullsized":"2023-08-10T10:33:16.228843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:39.485653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.657216+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:12.657216+0000","last_peered":"2023-08-10T10:33:12.657216+0000","last_clean":"2023-08-10T10:33:12.657216+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:12.657216+0000","last_undegraded":"2023-08-10T10:33:12.657216+0000","last_fullsized":"2023-08-10T10:33:12.657216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:55.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.649027+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:32:54.649027+0000","last_peered":"2023-08-10T10:32:54.649027+0000","last_clean":"2023-08-10T10:32:54.649027+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:32:54.649027+0000","last_undegraded":"2023-08-10T10:32:54.649027+0000","last_fullsized":"2023-08-10T10:32:54.649027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229167+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:33:16.229167+0000","last_peered":"2023-08-10T10:33:16.229167+0000","last_clean":"2023-08-10T10:33:16.229167+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:33:16.229167+0000","last_undegraded":"2023-08-10T10:33:16.229167+0000","last_fullsized":"2023-08-10T10:33:16.229167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'507","reported_seq":525,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.645635+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:16.645635+0000","last_peered":"2023-08-10T10:33:16.645635+0000","last_clean":"2023-08-10T10:33:16.645635+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:16.645635+0000","last_undegraded":"2023-08-10T10:33:16.645635+0000","last_fullsized":"2023-08-10T10:33:16.645635+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:26.950178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.644202+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:32:54.644202+0000","last_peered":"2023-08-10T10:32:54.644202+0000","last_clean":"2023-08-10T10:32:54.644202+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:32:54.644202+0000","last_undegraded":"2023-08-10T10:32:54.644202+0000","last_fullsized":"2023-08-10T10:32:54.644202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:28.578497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229987+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:16.229987+0000","last_peered":"2023-08-10T10:33:16.229987+0000","last_clean":"2023-08-10T10:33:16.229987+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:16.229987+0000","last_undegraded":"2023-08-10T10:33:16.229987+0000","last_fullsized":"2023-08-10T10:33:16.229987+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:53.894741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661711+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:16.661711+0000","last_peered":"2023-08-10T10:33:16.661711+0000","last_clean":"2023-08-10T10:33:16.661711+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:16.661711+0000","last_undegraded":"2023-08-10T10:33:16.661711+0000","last_fullsized":"2023-08-10T10:33:16.661711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:51.590601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297435+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:31:15.297435+0000","last_peered":"2023-08-10T10:31:15.297435+0000","last_clean":"2023-08-10T10:31:15.297435+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:31:15.297435+0000","last_undegraded":"2023-08-10T10:31:15.297435+0000","last_fullsized":"2023-08-10T10:31:15.297435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:14.302383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227858+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:16.227858+0000","last_peered":"2023-08-10T10:33:16.227858+0000","last_clean":"2023-08-10T10:33:16.227858+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:16.227858+0000","last_undegraded":"2023-08-10T10:33:16.227858+0000","last_fullsized":"2023-08-10T10:33:16.227858+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:26.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637975+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:33:16.637975+0000","last_peered":"2023-08-10T10:33:16.637975+0000","last_clean":"2023-08-10T10:33:16.637975+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:16.637975+0000","last_undegraded":"2023-08-10T10:33:16.637975+0000","last_fullsized":"2023-08-10T10:33:16.637975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298234+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:31:15.298234+0000","last_peered":"2023-08-10T10:31:15.298234+0000","last_clean":"2023-08-10T10:31:15.298234+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:31:15.298234+0000","last_undegraded":"2023-08-10T10:31:15.298234+0000","last_fullsized":"2023-08-10T10:31:15.298234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:03.007876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243305+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:16.243305+0000","last_peered":"2023-08-10T10:33:16.243305+0000","last_clean":"2023-08-10T10:33:16.243305+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:16.243305+0000","last_undegraded":"2023-08-10T10:33:16.243305+0000","last_fullsized":"2023-08-10T10:33:16.243305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:35.261347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'471","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.660055+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:33:16.660055+0000","last_peered":"2023-08-10T10:33:16.660055+0000","last_clean":"2023-08-10T10:33:16.660055+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:16.660055+0000","last_undegraded":"2023-08-10T10:33:16.660055+0000","last_fullsized":"2023-08-10T10:33:16.660055+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297852+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:31:15.297852+0000","last_peered":"2023-08-10T10:31:15.297852+0000","last_clean":"2023-08-10T10:31:15.297852+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:31:15.297852+0000","last_undegraded":"2023-08-10T10:31:15.297852+0000","last_fullsized":"2023-08-10T10:31:15.297852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.227375+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:33:16.227375+0000","last_peered":"2023-08-10T10:33:16.227375+0000","last_clean":"2023-08-10T10:33:16.227375+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:16.227375+0000","last_undegraded":"2023-08-10T10:33:16.227375+0000","last_fullsized":"2023-08-10T10:33:16.227375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:38.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686298+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:33:16.686298+0000","last_peered":"2023-08-10T10:33:16.686298+0000","last_clean":"2023-08-10T10:33:16.686298+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:16.686298+0000","last_undegraded":"2023-08-10T10:33:16.686298+0000","last_fullsized":"2023-08-10T10:33:16.686298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:00.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340760+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:31:15.340760+0000","last_peered":"2023-08-10T10:31:15.340760+0000","last_clean":"2023-08-10T10:31:15.340760+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:31:15.340760+0000","last_undegraded":"2023-08-10T10:31:15.340760+0000","last_fullsized":"2023-08-10T10:31:15.340760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:16.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225794+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:33:16.225794+0000","last_peered":"2023-08-10T10:33:16.225794+0000","last_clean":"2023-08-10T10:33:16.225794+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:16.225794+0000","last_undegraded":"2023-08-10T10:33:16.225794+0000","last_fullsized":"2023-08-10T10:33:16.225794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603945+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:33:16.603945+0000","last_peered":"2023-08-10T10:33:16.603945+0000","last_clean":"2023-08-10T10:33:16.603945+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:16.603945+0000","last_undegraded":"2023-08-10T10:33:16.603945+0000","last_fullsized":"2023-08-10T10:33:16.603945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:29.585039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.564548+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:32:59.564548+0000","last_peered":"2023-08-10T10:32:59.564548+0000","last_clean":"2023-08-10T10:32:59.564548+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:32:59.564548+0000","last_undegraded":"2023-08-10T10:32:59.564548+0000","last_fullsized":"2023-08-10T10:32:59.564548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:19.074943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'20","reported_seq":44,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244911+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:16.244911+0000","last_peered":"2023-08-10T10:33:16.244911+0000","last_clean":"2023-08-10T10:33:16.244911+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:16.244911+0000","last_undegraded":"2023-08-10T10:33:16.244911+0000","last_fullsized":"2023-08-10T10:33:16.244911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:41.250265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'477","reported_seq":495,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625282+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:16.625282+0000","last_peered":"2023-08-10T10:33:16.625282+0000","last_clean":"2023-08-10T10:33:16.625282+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:16.625282+0000","last_undegraded":"2023-08-10T10:33:16.625282+0000","last_fullsized":"2023-08-10T10:33:16.625282+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:23.334412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":34816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132118+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:31:16.132118+0000","last_peered":"2023-08-10T10:31:16.132118+0000","last_clean":"2023-08-10T10:31:16.132118+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:31:16.132118+0000","last_undegraded":"2023-08-10T10:31:16.132118+0000","last_fullsized":"2023-08-10T10:31:16.132118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:48.763588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.243361+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:33:16.243361+0000","last_peered":"2023-08-10T10:33:16.243361+0000","last_clean":"2023-08-10T10:33:16.243361+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:16.243361+0000","last_undegraded":"2023-08-10T10:33:16.243361+0000","last_fullsized":"2023-08-10T10:33:16.243361+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:23.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'456","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.660104+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:16.660104+0000","last_peered":"2023-08-10T10:33:16.660104+0000","last_clean":"2023-08-10T10:33:16.660104+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:16.660104+0000","last_undegraded":"2023-08-10T10:33:16.660104+0000","last_fullsized":"2023-08-10T10:33:16.660104+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:36.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.647488+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:32:44.647488+0000","last_peered":"2023-08-10T10:32:44.647488+0000","last_clean":"2023-08-10T10:32:44.647488+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:32:44.647488+0000","last_undegraded":"2023-08-10T10:32:44.647488+0000","last_fullsized":"2023-08-10T10:32:44.647488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:17.232518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'12","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.242397+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:33:16.242397+0000","last_peered":"2023-08-10T10:33:16.242397+0000","last_clean":"2023-08-10T10:33:16.242397+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:16.242397+0000","last_undegraded":"2023-08-10T10:33:16.242397+0000","last_fullsized":"2023-08-10T10:33:16.242397+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:54:47.483257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.618747+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.618747+0000","last_peered":"2023-08-10T10:33:16.618747+0000","last_clean":"2023-08-10T10:33:16.618747+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.618747+0000","last_undegraded":"2023-08-10T10:33:16.618747+0000","last_fullsized":"2023-08-10T10:33:16.618747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.041993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297869+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:31:15.297869+0000","last_peered":"2023-08-10T10:31:15.297869+0000","last_clean":"2023-08-10T10:31:15.297869+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:31:15.297869+0000","last_undegraded":"2023-08-10T10:31:15.297869+0000","last_fullsized":"2023-08-10T10:31:15.297869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228262+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:33:16.228262+0000","last_peered":"2023-08-10T10:33:16.228262+0000","last_clean":"2023-08-10T10:33:16.228262+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:16.228262+0000","last_undegraded":"2023-08-10T10:33:16.228262+0000","last_fullsized":"2023-08-10T10:33:16.228262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.671401+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:16.671401+0000","last_peered":"2023-08-10T10:33:16.671401+0000","last_clean":"2023-08-10T10:33:16.671401+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:16.671401+0000","last_undegraded":"2023-08-10T10:33:16.671401+0000","last_fullsized":"2023-08-10T10:33:16.671401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:21.282539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558794+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:31:15.558794+0000","last_peered":"2023-08-10T10:31:15.558794+0000","last_clean":"2023-08-10T10:31:15.558794+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:31:15.558794+0000","last_undegraded":"2023-08-10T10:31:15.558794+0000","last_fullsized":"2023-08-10T10:31:15.558794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:20.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.521825+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:33:04.521825+0000","last_peered":"2023-08-10T10:33:04.521825+0000","last_clean":"2023-08-10T10:33:04.521825+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:04.521825+0000","last_undegraded":"2023-08-10T10:33:04.521825+0000","last_fullsized":"2023-08-10T10:33:04.521825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:46.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'21","reported_seq":45,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229247+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:33:16.229247+0000","last_peered":"2023-08-10T10:33:16.229247+0000","last_clean":"2023-08-10T10:33:16.229247+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:16.229247+0000","last_undegraded":"2023-08-10T10:33:16.229247+0000","last_fullsized":"2023-08-10T10:33:16.229247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:33.490533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664708+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:16.664708+0000","last_peered":"2023-08-10T10:33:16.664708+0000","last_clean":"2023-08-10T10:33:16.664708+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:16.664708+0000","last_undegraded":"2023-08-10T10:33:16.664708+0000","last_fullsized":"2023-08-10T10:33:16.664708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:22.379842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340578+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:31:15.340578+0000","last_peered":"2023-08-10T10:31:15.340578+0000","last_clean":"2023-08-10T10:31:15.340578+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:31:15.340578+0000","last_undegraded":"2023-08-10T10:31:15.340578+0000","last_fullsized":"2023-08-10T10:31:15.340578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:50.341770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298059+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:31:15.298059+0000","last_peered":"2023-08-10T10:31:15.298059+0000","last_clean":"2023-08-10T10:31:15.298059+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:31:15.298059+0000","last_undegraded":"2023-08-10T10:31:15.298059+0000","last_fullsized":"2023-08-10T10:31:15.298059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:07.488469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.223020+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:33:16.223020+0000","last_peered":"2023-08-10T10:33:16.223020+0000","last_clean":"2023-08-10T10:33:16.223020+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:16.223020+0000","last_undegraded":"2023-08-10T10:33:16.223020+0000","last_fullsized":"2023-08-10T10:33:16.223020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:35.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":436,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637941+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:33:16.637941+0000","last_peered":"2023-08-10T10:33:16.637941+0000","last_clean":"2023-08-10T10:33:16.637941+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:16.637941+0000","last_undegraded":"2023-08-10T10:33:16.637941+0000","last_fullsized":"2023-08-10T10:33:16.637941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:37.499897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.295972+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:31:15.295972+0000","last_peered":"2023-08-10T10:31:15.295972+0000","last_clean":"2023-08-10T10:31:15.295972+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:31:15.295972+0000","last_undegraded":"2023-08-10T10:31:15.295972+0000","last_fullsized":"2023-08-10T10:31:15.295972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:02.669208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:34.627598+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:32:34.627598+0000","last_peered":"2023-08-10T10:32:34.627598+0000","last_clean":"2023-08-10T10:32:34.627598+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:32:34.627598+0000","last_undegraded":"2023-08-10T10:32:34.627598+0000","last_fullsized":"2023-08-10T10:32:34.627598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:24.427296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229559+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:33:16.229559+0000","last_peered":"2023-08-10T10:33:16.229559+0000","last_clean":"2023-08-10T10:33:16.229559+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:16.229559+0000","last_undegraded":"2023-08-10T10:33:16.229559+0000","last_fullsized":"2023-08-10T10:33:16.229559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596480+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.596480+0000","last_peered":"2023-08-10T10:33:16.596480+0000","last_clean":"2023-08-10T10:33:16.596480+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.596480+0000","last_undegraded":"2023-08-10T10:33:16.596480+0000","last_fullsized":"2023-08-10T10:33:16.596480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340660+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:31:15.340660+0000","last_peered":"2023-08-10T10:31:15.340660+0000","last_clean":"2023-08-10T10:31:15.340660+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:31:15.340660+0000","last_undegraded":"2023-08-10T10:31:15.340660+0000","last_fullsized":"2023-08-10T10:31:15.340660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:12.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296544+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:31:15.296544+0000","last_peered":"2023-08-10T10:31:15.296544+0000","last_clean":"2023-08-10T10:31:15.296544+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:31:15.296544+0000","last_undegraded":"2023-08-10T10:31:15.296544+0000","last_fullsized":"2023-08-10T10:31:15.296544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:42.837063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298242+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:31:15.298242+0000","last_peered":"2023-08-10T10:31:15.298242+0000","last_clean":"2023-08-10T10:31:15.298242+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:31:15.298242+0000","last_undegraded":"2023-08-10T10:31:15.298242+0000","last_fullsized":"2023-08-10T10:31:15.298242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:38.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.245524+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:33:16.245524+0000","last_peered":"2023-08-10T10:33:16.245524+0000","last_clean":"2023-08-10T10:33:16.245524+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:16.245524+0000","last_undegraded":"2023-08-10T10:33:16.245524+0000","last_fullsized":"2023-08-10T10:33:16.245524+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:07.362708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'425","reported_seq":443,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.621533+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:16.621533+0000","last_peered":"2023-08-10T10:33:16.621533+0000","last_clean":"2023-08-10T10:33:16.621533+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:16.621533+0000","last_undegraded":"2023-08-10T10:33:16.621533+0000","last_fullsized":"2023-08-10T10:33:16.621533+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.363842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296820+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:31:15.296820+0000","last_peered":"2023-08-10T10:31:15.296820+0000","last_clean":"2023-08-10T10:31:15.296820+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:31:15.296820+0000","last_undegraded":"2023-08-10T10:31:15.296820+0000","last_fullsized":"2023-08-10T10:31:15.296820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:11.201211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'15","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.586148+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:33:16.586148+0000","last_peered":"2023-08-10T10:33:16.586148+0000","last_clean":"2023-08-10T10:33:16.586148+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:16.586148+0000","last_undegraded":"2023-08-10T10:33:16.586148+0000","last_fullsized":"2023-08-10T10:33:16.586148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:34.274732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7643,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":14,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218934+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:33:16.218934+0000","last_peered":"2023-08-10T10:33:16.218934+0000","last_clean":"2023-08-10T10:33:16.218934+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:16.218934+0000","last_undegraded":"2023-08-10T10:33:16.218934+0000","last_fullsized":"2023-08-10T10:33:16.218934+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":490,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661787+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:33:16.661787+0000","last_peered":"2023-08-10T10:33:16.661787+0000","last_clean":"2023-08-10T10:33:16.661787+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:33:16.661787+0000","last_undegraded":"2023-08-10T10:33:16.661787+0000","last_fullsized":"2023-08-10T10:33:16.661787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:25.203845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297805+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:31:15.297805+0000","last_peered":"2023-08-10T10:31:15.297805+0000","last_clean":"2023-08-10T10:31:15.297805+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:31:15.297805+0000","last_undegraded":"2023-08-10T10:31:15.297805+0000","last_fullsized":"2023-08-10T10:31:15.297805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:40.440122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628271+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:32:39.628271+0000","last_peered":"2023-08-10T10:32:39.628271+0000","last_clean":"2023-08-10T10:32:39.628271+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:32:39.628271+0000","last_undegraded":"2023-08-10T10:32:39.628271+0000","last_fullsized":"2023-08-10T10:32:39.628271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230813+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:33:16.230813+0000","last_peered":"2023-08-10T10:33:16.230813+0000","last_clean":"2023-08-10T10:33:16.230813+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:16.230813+0000","last_undegraded":"2023-08-10T10:33:16.230813+0000","last_fullsized":"2023-08-10T10:33:16.230813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'510","reported_seq":528,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.630370+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:16.630370+0000","last_peered":"2023-08-10T10:33:16.630370+0000","last_clean":"2023-08-10T10:33:16.630370+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:16.630370+0000","last_undegraded":"2023-08-10T10:33:16.630370+0000","last_fullsized":"2023-08-10T10:33:16.630370+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:24.347845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.638107+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:32:44.638107+0000","last_peered":"2023-08-10T10:32:44.638107+0000","last_clean":"2023-08-10T10:32:44.638107+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:32:44.638107+0000","last_undegraded":"2023-08-10T10:32:44.638107+0000","last_fullsized":"2023-08-10T10:32:44.638107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:37.634596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558852+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:31:15.558852+0000","last_peered":"2023-08-10T10:31:15.558852+0000","last_clean":"2023-08-10T10:31:15.558852+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:31:15.558852+0000","last_undegraded":"2023-08-10T10:31:15.558852+0000","last_fullsized":"2023-08-10T10:31:15.558852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:39.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229942+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:33:16.229942+0000","last_peered":"2023-08-10T10:33:16.229942+0000","last_clean":"2023-08-10T10:33:16.229942+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:16.229942+0000","last_undegraded":"2023-08-10T10:33:16.229942+0000","last_fullsized":"2023-08-10T10:33:16.229942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:41.589758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637452+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.637452+0000","last_peered":"2023-08-10T10:33:16.637452+0000","last_clean":"2023-08-10T10:33:16.637452+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.637452+0000","last_undegraded":"2023-08-10T10:33:16.637452+0000","last_fullsized":"2023-08-10T10:33:16.637452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:11.307754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132519+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:31:16.132519+0000","last_peered":"2023-08-10T10:31:16.132519+0000","last_clean":"2023-08-10T10:31:16.132519+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:31:16.132519+0000","last_undegraded":"2023-08-10T10:31:16.132519+0000","last_fullsized":"2023-08-10T10:31:16.132519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:08.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:13.521996+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:33:13.521996+0000","last_peered":"2023-08-10T10:33:13.521996+0000","last_clean":"2023-08-10T10:33:13.521996+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:13.521996+0000","last_undegraded":"2023-08-10T10:33:13.521996+0000","last_fullsized":"2023-08-10T10:33:13.521996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'18","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.231476+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:16.231476+0000","last_peered":"2023-08-10T10:33:16.231476+0000","last_clean":"2023-08-10T10:33:16.231476+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:16.231476+0000","last_undegraded":"2023-08-10T10:33:16.231476+0000","last_fullsized":"2023-08-10T10:33:16.231476+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:22.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'434","reported_seq":452,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.619303+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:33:16.619303+0000","last_peered":"2023-08-10T10:33:16.619303+0000","last_clean":"2023-08-10T10:33:16.619303+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:16.619303+0000","last_undegraded":"2023-08-10T10:33:16.619303+0000","last_fullsized":"2023-08-10T10:33:16.619303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:14.330929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.299995+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:31:15.299995+0000","last_peered":"2023-08-10T10:31:15.299995+0000","last_clean":"2023-08-10T10:31:15.299995+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:31:15.299995+0000","last_undegraded":"2023-08-10T10:31:15.299995+0000","last_fullsized":"2023-08-10T10:31:15.299995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.225207+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:33:16.225207+0000","last_peered":"2023-08-10T10:33:16.225207+0000","last_clean":"2023-08-10T10:33:16.225207+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:16.225207+0000","last_undegraded":"2023-08-10T10:33:16.225207+0000","last_fullsized":"2023-08-10T10:33:16.225207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625704+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:16.625704+0000","last_peered":"2023-08-10T10:33:16.625704+0000","last_clean":"2023-08-10T10:33:16.625704+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:16.625704+0000","last_undegraded":"2023-08-10T10:33:16.625704+0000","last_fullsized":"2023-08-10T10:33:16.625704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340816+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:31:15.340816+0000","last_peered":"2023-08-10T10:31:15.340816+0000","last_clean":"2023-08-10T10:31:15.340816+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:31:15.340816+0000","last_undegraded":"2023-08-10T10:31:15.340816+0000","last_fullsized":"2023-08-10T10:31:15.340816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.241892+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:33:16.241892+0000","last_peered":"2023-08-10T10:33:16.241892+0000","last_clean":"2023-08-10T10:33:16.241892+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:16.241892+0000","last_undegraded":"2023-08-10T10:33:16.241892+0000","last_fullsized":"2023-08-10T10:33:16.241892+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:37.002252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664108+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:16.664108+0000","last_peered":"2023-08-10T10:33:16.664108+0000","last_clean":"2023-08-10T10:33:16.664108+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:16.664108+0000","last_undegraded":"2023-08-10T10:33:16.664108+0000","last_fullsized":"2023-08-10T10:33:16.664108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.646564+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:33:04.646564+0000","last_peered":"2023-08-10T10:33:04.646564+0000","last_clean":"2023-08-10T10:33:04.646564+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:04.646564+0000","last_undegraded":"2023-08-10T10:33:04.646564+0000","last_fullsized":"2023-08-10T10:33:04.646564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'15","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.239711+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:33:16.239711+0000","last_peered":"2023-08-10T10:33:16.239711+0000","last_clean":"2023-08-10T10:33:16.239711+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:16.239711+0000","last_undegraded":"2023-08-10T10:33:16.239711+0000","last_fullsized":"2023-08-10T10:33:16.239711+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:13.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'469","reported_seq":487,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.666795+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:16.666795+0000","last_peered":"2023-08-10T10:33:16.666795+0000","last_clean":"2023-08-10T10:33:16.666795+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:16.666795+0000","last_undegraded":"2023-08-10T10:33:16.666795+0000","last_fullsized":"2023-08-10T10:33:16.666795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":469,"log_dups_size":0,"ondisk_log_size":469,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:55.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298977+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:31:15.298977+0000","last_peered":"2023-08-10T10:31:15.298977+0000","last_clean":"2023-08-10T10:31:15.298977+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:31:15.298977+0000","last_undegraded":"2023-08-10T10:31:15.298977+0000","last_fullsized":"2023-08-10T10:31:15.298977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'28","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.228863+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:16.228863+0000","last_peered":"2023-08-10T10:33:16.228863+0000","last_clean":"2023-08-10T10:33:16.228863+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:16.228863+0000","last_undegraded":"2023-08-10T10:33:16.228863+0000","last_fullsized":"2023-08-10T10:33:16.228863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:14.526604+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:33:14.526604+0000","last_peered":"2023-08-10T10:33:14.526604+0000","last_clean":"2023-08-10T10:33:14.526604+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:14.526604+0000","last_undegraded":"2023-08-10T10:33:14.526604+0000","last_fullsized":"2023-08-10T10:33:14.526604+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:59.704514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'5","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628991+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:32:39.628991+0000","last_peered":"2023-08-10T10:32:39.628991+0000","last_clean":"2023-08-10T10:32:39.628991+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:32:39.628991+0000","last_undegraded":"2023-08-10T10:32:39.628991+0000","last_fullsized":"2023-08-10T10:32:39.628991+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:44.096010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244882+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:33:16.244882+0000","last_peered":"2023-08-10T10:33:16.244882+0000","last_clean":"2023-08-10T10:33:16.244882+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:16.244882+0000","last_undegraded":"2023-08-10T10:33:16.244882+0000","last_fullsized":"2023-08-10T10:33:16.244882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:36.250911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'35","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.218228+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:33:16.218228+0000","last_peered":"2023-08-10T10:33:16.218228+0000","last_clean":"2023-08-10T10:33:16.218228+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:16.218228+0000","last_undegraded":"2023-08-10T10:33:16.218228+0000","last_fullsized":"2023-08-10T10:33:16.218228+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.229043+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:16.229043+0000","last_peered":"2023-08-10T10:33:16.229043+0000","last_clean":"2023-08-10T10:33:16.229043+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:16.229043+0000","last_undegraded":"2023-08-10T10:33:16.229043+0000","last_fullsized":"2023-08-10T10:33:16.229043+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.244938+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:16.244938+0000","last_peered":"2023-08-10T10:33:16.244938+0000","last_clean":"2023-08-10T10:33:16.244938+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:16.244938+0000","last_undegraded":"2023-08-10T10:33:16.244938+0000","last_fullsized":"2023-08-10T10:33:16.244938+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:09.195453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.230396+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:16.230396+0000","last_peered":"2023-08-10T10:33:16.230396+0000","last_clean":"2023-08-10T10:33:16.230396+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:16.230396+0000","last_undegraded":"2023-08-10T10:33:16.230396+0000","last_fullsized":"2023-08-10T10:33:16.230396+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:40.885396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'19","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.214509+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:33:16.214509+0000","last_peered":"2023-08-10T10:33:16.214509+0000","last_clean":"2023-08-10T10:33:16.214509+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:16.214509+0000","last_undegraded":"2023-08-10T10:33:16.214509+0000","last_fullsized":"2023-08-10T10:33:16.214509+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":165675008,"num_objects":41,"num_object_clones":0,"num_object_copies":164,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":474,"num_write_kb":1027072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331350016,"data_stored":331350016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14846,"ondisk_log_size":14846,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1550,"ondisk_log_size":1550,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2088160,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":14,"num_read_kb":17,"num_write":677,"num_write_kb":2520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4235264,"data_stored":4176320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":55680,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":57016320,"data_stored":56806142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":0.83999999999999997,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":9.3949999999999996,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.35799999999999998},{"interface":"front","average":{"1min":2.4889999999999999,"5min":0.96499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.51800000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":0.78800000000000003,"15min":0.66600000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.40000000000000002},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.82099999999999995,"15min":0.73899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":11.577999999999999},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.03,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.0609999999999999,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":22.148,"5min":22.148,"15min":22.148},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.84699999999999998,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":10.237,"5min":10.237,"15min":10.237},"last":0.45400000000000001},{"interface":"front","average":{"1min":1.8240000000000001,"5min":0.98799999999999999,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":0.81899999999999995,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.4500000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.47299999999999998},{"interface":"front","average":{"1min":1.911,"5min":0.93300000000000005,"15min":0.77000000000000002},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.779,"5min":11.779,"15min":11.779},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.83999999999999997,"15min":0.80300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.5309999999999999,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.624}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":0.93600000000000005,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.5129999999999999,"5min":7.5129999999999999,"15min":7.5129999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.389,"5min":0.85099999999999998,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":7.3460000000000001,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.65100000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574886,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62652,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94309188,"statfs":{"total":96636764160,"available":96572608512,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":0.98699999999999999,"15min":0.80900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":2.569,"5min":1.1259999999999999,"15min":0.88600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.914,"5min":10.914,"15min":10.914},"last":0.60099999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.1200000000000001,"5min":1.2130000000000001,"15min":0.89500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":14.93,"5min":14.93,"15min":14.93},"last":0.45400000000000001},{"interface":"front","average":{"1min":2.6419999999999999,"5min":1.1299999999999999,"15min":0.878},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":10.957000000000001,"5min":10.957000000000001,"15min":10.957000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.218,"15min":0.877},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":19.654,"5min":19.654,"15min":19.654},"last":0.53700000000000003},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.1060000000000001,"15min":0.85399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":12.848000000000001,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":1.206,"15min":0.91300000000000003},"min":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.625},{"interface":"front","average":{"1min":3.7080000000000002,"5min":1.3680000000000001,"15min":0.97799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":19.907,"5min":19.907,"15min":19.907},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":0.88500000000000001,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":5.9630000000000001,"5min":5.9630000000000001,"15min":5.9630000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":1.421,"5min":0.84899999999999998,"15min":0.754},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":6.7199999999999998},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":0.91800000000000004,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.435},{"interface":"front","average":{"1min":1.524,"5min":0.90300000000000002,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.66100000000000003},{"interface":"front","average":{"1min":2.0739999999999998,"5min":1.026,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.1639999999999997,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.502}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":81084,"kb_used_data":45876,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94290756,"statfs":{"total":96636764160,"available":96553734144,"internally_reserved":0,"allocated":46977024,"data_stored":46795807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.47699999999999998,"15min":0.439},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.50900000000000001,"15min":0.46300000000000002},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.53800000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.58799999999999997,"15min":0.499},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":8.016,"5min":8.016,"15min":8.016},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.59099999999999997,"15min":0.54800000000000004},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.46300000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":0.88,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":10.734,"5min":10.734,"15min":10.734},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.83799999999999997,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":0.88600000000000001,"15min":0.77800000000000002},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":10.444000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.1619999999999999,"5min":1.0669999999999999,"15min":0.88500000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":21.681999999999999,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.51600000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":0.91300000000000003,"15min":0.83999999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":10.516,"5min":10.516,"15min":10.516},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":0.94199999999999995,"15min":0.85999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.65200000000000002,"5min":0.622,"15min":0.622},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.7,"5min":0.98199999999999998,"15min":0.86199999999999999},"min":{"1min":0.67900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":0.59399999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574887,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":78600,"kb_used_data":43392,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94293240,"statfs":{"total":96636764160,"available":96556277760,"internally_reserved":0,"allocated":44433408,"data_stored":44247653,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":0.68300000000000005,"15min":0.61699999999999999},"min":{"1min":0.30499999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":6.0490000000000004,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.497},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":4.3780000000000001,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":0.65200000000000002,"15min":0.56200000000000006},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":5.4589999999999996,"5min":5.4589999999999996,"15min":5.4589999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":1.27,"5min":0.95399999999999996,"15min":0.90100000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":6.6970000000000001,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.443}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":0.95599999999999996,"15min":0.79900000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.466,"5min":0.83399999999999996,"15min":0.72899999999999998},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":7.0069999999999997,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.234,"15min":1.254},"min":{"1min":0.51300000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":4.5460000000000003,"5min":12.045999999999999,"15min":12.045999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.992,"5min":1.135,"15min":0.99199999999999999},"min":{"1min":0.54500000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":16.969000000000001,"5min":16.969000000000001,"15min":16.969000000000001},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.78100000000000003,"15min":0.73299999999999998},"min":{"1min":0.45500000000000002,"5min":0.434,"15min":0.434},"max":{"1min":4.016,"5min":4.016,"15min":4.016},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.0600000000000001,"15min":1.0760000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":2.0830000000000002,"5min":8.0220000000000002,"15min":8.0220000000000002},"last":0.68300000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.992,"5min":1.163,"15min":1.0249999999999999},"min":{"1min":0.59299999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":17.001999999999999,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":2.2999999999999998,"5min":1.0580000000000001,"15min":0.85099999999999998},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":13.141,"5min":13.141,"15min":13.141},"last":0.67000000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.827,"5min":1.234,"15min":1.135},"min":{"1min":0.66600000000000004,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":6.9569999999999999,"5min":7.9370000000000003,"15min":7.9370000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":2.2949999999999999,"5min":1.264,"15min":1.0920000000000001},"min":{"1min":0.625,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":17.032,"5min":17.032,"15min":17.032},"last":0.85499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574887,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71868,"kb_used_data":40756,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94299972,"statfs":{"total":96636764160,"available":96563171328,"internally_reserved":0,"allocated":41734144,"data_stored":41552927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.56699999999999995,"15min":0.50700000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.877,"5min":0.52600000000000002,"15min":0.46800000000000003},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.9419999999999999,"5min":1.9419999999999999,"15min":1.9419999999999999},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.7250000000000001,"5min":0.94499999999999995,"15min":0.64800000000000002},"min":{"1min":0.433,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":11.686,"5min":11.686,"15min":11.686},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.61599999999999999,"15min":0.56399999999999995},"min":{"1min":0.35899999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.724,"5min":0.77100000000000002,"15min":0.61199999999999999},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":11.715,"5min":11.715,"15min":11.715},"last":0.47199999999999998},{"interface":"front","average":{"1min":1.042,"5min":0.68500000000000005,"15min":0.625},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.7410000000000001,"5min":0.90500000000000003,"15min":0.76600000000000001},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":9.3740000000000006,"5min":9.3740000000000006,"15min":9.3740000000000006},"last":0.67000000000000004},{"interface":"front","average":{"1min":2.1030000000000002,"5min":0.99099999999999999,"15min":0.80500000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.656000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.65800000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0470000000000002,"5min":1.0109999999999999,"15min":0.83799999999999997},"min":{"1min":0.505,"5min":0.499,"15min":0.499},"max":{"1min":10.923,"5min":10.923,"15min":10.923},"last":0.63},{"interface":"front","average":{"1min":2.1749999999999998,"5min":1.044,"15min":0.85599999999999998},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":10.634,"5min":10.634,"15min":10.634},"last":0.64400000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":3.0990000000000002,"5min":1.216,"15min":0.90200000000000002},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.618,"5min":11.618,"15min":11.618},"last":0.54200000000000004},{"interface":"front","average":{"1min":3.004,"5min":1.224,"15min":0.92800000000000005},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":10.885999999999999,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1059999999999999,"5min":1.0660000000000001,"15min":0.89300000000000002},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":9.3399999999999999,"5min":9.3399999999999999,"15min":9.3399999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":2.0409999999999999,"5min":1.0289999999999999,"15min":0.86099999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":9.4269999999999996,"5min":9.4269999999999996,"15min":9.4269999999999996},"last":0.59599999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":65728,"kb_used_data":34616,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94306112,"statfs":{"total":96636764160,"available":96569458688,"internally_reserved":0,"allocated":35446784,"data_stored":35261561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.62,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.44700000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":0.70499999999999996,"15min":0.59299999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.143000000000001,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2010000000000001,"15min":1.181},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.923,"5min":12.754,"15min":12.754},"last":0.41599999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":0.86399999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.51500000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":0.93500000000000005,"15min":0.79600000000000004},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":16.927,"5min":16.927,"15min":16.927},"last":0.48699999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":0.93200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.84999999999999998},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.014,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":12.465999999999999,"5min":12.465999999999999,"15min":12.465999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":0.92000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":2.2370000000000001,"5min":1.0940000000000001,"15min":0.90400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":17.664000000000001,"5min":17.664000000000001,"15min":17.664000000000001},"last":0.83599999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":1.111,"15min":0.90600000000000003},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.95099999999999996},{"interface":"front","average":{"1min":2.1139999999999999,"5min":1.0580000000000001,"15min":0.88200000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":12.504,"5min":12.504,"15min":12.504},"last":0.93400000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.93799999999999994,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.90500000000000003},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.1459999999999999,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":16.977,"5min":16.977,"15min":16.977},"last":0.98699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574887,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76996,"kb_used_data":41788,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94294844,"statfs":{"total":96636764160,"available":96557920256,"internally_reserved":0,"allocated":42790912,"data_stored":42591769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,1,1,0,3,1,1,1,4],"upper_bound":512},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":0.94299999999999995,"15min":0.76500000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":19.064,"5min":19.064,"15min":19.064},"last":69.530000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.109,"15min":0.94999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.238,"5min":11.238,"15min":11.238},"last":19.388000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":1.0629999999999999,"15min":0.88900000000000001},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":64.784999999999997},{"interface":"front","average":{"1min":2.722,"5min":1.242,"15min":0.996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":19.033999999999999,"5min":19.033999999999999,"15min":19.033999999999999},"last":120.05}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1760000000000002,"5min":1.014,"15min":0.81999999999999995},"min":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":18.948,"5min":18.948,"15min":18.948},"last":119.992},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.1879999999999999,"15min":1.081},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":30.984000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.0189999999999999,"15min":0.86099999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":11.279,"5min":11.279,"15min":11.279},"last":64.823999999999998},{"interface":"front","average":{"1min":1.5960000000000001,"5min":0.96799999999999997,"15min":0.86299999999999999},"min":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":10.962999999999999,"5min":10.962999999999999,"15min":10.962999999999999},"last":30.940000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8240000000000001,"5min":1.073,"15min":0.94799999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":19,"5min":19,"15min":19},"last":165.98500000000001},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.84899999999999998,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.4100000000000001,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":125.369}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.446,"15min":1.458},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.029,"5min":12.381,"15min":12.381},"last":113.884},{"interface":"front","average":{"1min":1.5369999999999999,"5min":0.96099999999999997,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.441,"15min":0.441},"max":{"1min":8.5950000000000006,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":124.836}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.91600000000000004,"15min":0.89400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.448,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":67.281999999999996},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.89200000000000002,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":125.12}]}]},{"osd":5,"up_from":13,"seq":55834574887,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":68804,"kb_used_data":37692,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94303036,"statfs":{"total":96636764160,"available":96566308864,"internally_reserved":0,"allocated":38596608,"data_stored":38407851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":1.046,"15min":1.024},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":5.9859999999999998,"5min":6.7640000000000002,"15min":6.7640000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":1.385,"5min":1.0880000000000001,"15min":1.038},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":6.5970000000000004,"5min":6.6980000000000004,"15min":6.6980000000000004},"last":0.65500000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.22,"15min":1.1870000000000001},"min":{"1min":0.52000000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":5.9379999999999997,"5min":9.5939999999999994,"15min":9.5939999999999994},"last":0.69099999999999995},{"interface":"front","average":{"1min":1.595,"5min":1.111,"15min":1.0309999999999999},"min":{"1min":0.46700000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":11.625,"5min":11.625,"15min":11.625},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":1.02,"15min":1.042},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.504,"5min":6.8330000000000002,"15min":6.8330000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.96299999999999997,"15min":0.98699999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.579,"5min":6.8079999999999998,"15min":6.8079999999999998},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":1.0309999999999999,"15min":1.0669999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3180000000000001,"5min":6.9699999999999998,"15min":6.9699999999999998},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":1.1930000000000001,"15min":1.256},"min":{"1min":0.59499999999999997,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5309999999999999,"5min":10.688000000000001,"15min":10.688000000000001},"last":0.52100000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.63200000000000001,"15min":0.61599999999999999},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.423,"5min":1.423,"15min":1.423},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.65800000000000003,"15min":0.63800000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.65100000000000002,"15min":0.64000000000000001},"min":{"1min":0.44400000000000001,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.8109999999999999,"5min":1.8109999999999999,"15min":1.8109999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.71199999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":0.80000000000000004,"15min":0.751},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.444,"5min":4.444,"15min":4.444},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.77300000000000002,"15min":0.76600000000000001},"min":{"1min":0.51200000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.581,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":0.628}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2105344,"data_stored":2087418,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2105344,"data_stored":2079935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":43515904,"data_stored":43515904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":46661632,"data_stored":46661632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":41418752,"data_stored":41418752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35127296,"data_stored":35127296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":40370176,"data_stored":40370176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":38273024,"data_stored":38273024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":54001664,"data_stored":54001664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:33:22.343 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:33:22.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.571+0000 7faeb1fff700 1 Processor -- start 2023-08-10T10:33:22.573 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.571+0000 7faeb1fff700 1 -- start start 2023-08-10T10:33:22.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.572+0000 7faeb1fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faeac159d00 0x7faeac15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.572+0000 7faeb1fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.572+0000 7faeb1fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeac06a170 con 0x7faeac071b50 2023-08-10T10:33:22.574 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.572+0000 7faeb1fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeac0cdeb0 con 0x7faeac159d00 2023-08-10T10:33:22.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.572+0000 7faeb1fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac0ce190 con 0x7faeac0716d0 2023-08-10T10:33:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faea3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.576 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faeac159d00 0x7faeac15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faea3fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.88:51558/0 (socket says 172.21.15.88:51558) 2023-08-10T10:33:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faeac159d00 0x7faeac15d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:50042/0 (socket says 172.21.15.88:50042) 2023-08-10T10:33:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faea3fff700 1 -- 172.21.15.88:0/3396553607 learned_addr learned my addr 172.21.15.88:0/3396553607 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 -- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 msgr2=0x7faeac070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:22.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 -- 172.21.15.88:0/3396553607 >> v1:172.21.15.187:6789/0 conn(0x7faeac071b50 legacy=0x7faeac06a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faeab7fe700 1 -- 172.21.15.88:0/3396553607 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac0ce470 con 0x7faeac159d00 2023-08-10T10:33:22.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.573+0000 7faea3fff700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:33:22.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeab7fe700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac159d00 0x7faeac15d8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009840 tx=0x7fae9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5c54ad4e0551627 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeaaffd700 1 -- 172.21.15.88:0/3396553607 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011830 con 0x7faeac159d00 2023-08-10T10:33:22.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeaaffd700 1 -- 172.21.15.88:0/3396553607 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae9c011990 con 0x7faeac159d00 2023-08-10T10:33:22.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeaaffd700 1 -- 172.21.15.88:0/3396553607 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae9c011d20 con 0x7faeac159d00 2023-08-10T10:33:22.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeb1fff700 1 -- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac159d00 msgr2=0x7faeac15d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.574+0000 7faeb1fff700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac159d00 0x7faeac15d8d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009840 tx=0x7fae9c009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:22.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 -- 172.21.15.88:0/3396553607 shutdown_connections 2023-08-10T10:33:22.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac159d00 0x7faeac15d8d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 --2- 172.21.15.88:0/3396553607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac0716d0 0x7faeac070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 -- 172.21.15.88:0/3396553607 >> 172.21.15.88:0/3396553607 conn(0x7faeac0ced50 msgr2=0x7faeac0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:22.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 -- 172.21.15.88:0/3396553607 shutdown_connections 2023-08-10T10:33:22.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.575+0000 7faeb1fff700 1 -- 172.21.15.88:0/3396553607 wait complete. 2023-08-10T10:33:22.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.576+0000 7faeb1fff700 1 Processor -- start 2023-08-10T10:33:22.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.576+0000 7faeb1fff700 1 -- start start 2023-08-10T10:33:22.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 0x7faeac146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac071b50 0x7faeac1466a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac14dfa0 con 0x7faeac159d00 2023-08-10T10:33:22.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeac14d670 con 0x7faeac0716d0 2023-08-10T10:33:22.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.577+0000 7faeb1fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeac147350 con 0x7faeac071b50 2023-08-10T10:33:22.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45448/0 (socket says 172.21.15.88:45448) 2023-08-10T10:33:22.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 -- 172.21.15.88:0/602798687 learned_addr learned my addr 172.21.15.88:0/602798687 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:22.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeab7fe700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 0x7faeac146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faea3fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac071b50 0x7faeac1466a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 -- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac071b50 msgr2=0x7faeac1466a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac071b50 0x7faeac1466a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 -- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 msgr2=0x7faeac146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 0x7faeac146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 -- 172.21.15.88:0/602798687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae94009550 con 0x7faeac159d00 2023-08-10T10:33:22.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeab7fe700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 0x7faeac146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:22.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.578+0000 7faeabfff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faea400cc50 tx=0x7faea400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.579+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea400ad80 con 0x7faeac159d00 2023-08-10T10:33:22.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.579+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faea400ce50 con 0x7faeac159d00 2023-08-10T10:33:22.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.579+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faea4003c40 con 0x7faeac159d00 2023-08-10T10:33:22.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.579+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae9c0094a0 con 0x7faeac159d00 2023-08-10T10:33:22.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.579+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeac14d8e0 con 0x7faeac159d00 2023-08-10T10:33:22.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.580+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeac0c5540 con 0x7faeac159d00 2023-08-10T10:33:22.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.581+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7faea40050d0 con 0x7faeac159d00 2023-08-10T10:33:22.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.581+0000 7faea8ff9700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 0x7fae8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:22.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.582+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7faea40898d0 con 0x7faeac159d00 2023-08-10T10:33:22.588 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.582+0000 7faeab7fe700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 0x7fae8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:22.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.582+0000 7faeab7fe700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 0x7fae8c06d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae9c000c00 tx=0x7fae9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:22.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.586+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7faea4054640 con 0x7faeac159d00 2023-08-10T10:33:22.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.784+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faeac14e0e0 con 0x7faeac159d00 2023-08-10T10:33:22.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.785+0000 7faea8ff9700 1 -- 172.21.15.88:0/602798687 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7faea4057c60 con 0x7faeac159d00 2023-08-10T10:33:22.787 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:22.788 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:33:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 msgr2=0x7fae8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 0x7fae8c06d1a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae9c000c00 tx=0x7fae9c008030 comp rx=0 tx=0).stop 2023-08-10T10:33:22.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 msgr2=0x7faeac14f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:22.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faea400cc50 tx=0x7faea400a340 comp rx=0 tx=0).stop 2023-08-10T10:33:22.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 shutdown_connections 2023-08-10T10:33:22.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faeac159d00 0x7faeac14f580 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faeac0716d0 0x7faeac146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fae8c06ace0 0x7fae8c06d1a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 --2- 172.21.15.88:0/602798687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faeac071b50 0x7faeac1466a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 >> 172.21.15.88:0/602798687 conn(0x7faeac0ced50 msgr2=0x7faeac0cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 shutdown_connections 2023-08-10T10:33:22.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:22.788+0000 7faeb1fff700 1 -- 172.21.15.88:0/602798687 wait complete. 2023-08-10T10:33:23.809 INFO:tasks.ceph:Scrubbing osd.0 2023-08-10T10:33:23.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:24.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.030+0000 7f24b2fff700 1 Processor -- start 2023-08-10T10:33:24.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.031+0000 7f24b2fff700 1 -- start start 2023-08-10T10:33:24.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b2fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f24ac0cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b2fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0c43a0 con 0x7f24ac06dca0 2023-08-10T10:33:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b2fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24ac0c4960 con 0x7f24ac143810 2023-08-10T10:33:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b2fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac06e8c0 con 0x7f24ac0cc6c0 2023-08-10T10:33:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b159c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f24ac06dca0 0x7f24ac0c9140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45860/0 (socket says 172.21.15.88:45860) 2023-08-10T10:33:24.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.032+0000 7f24b159c700 1 -- 172.21.15.88:0/1066104861 learned_addr learned my addr 172.21.15.88:0/1066104861 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24abfff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f24ac0cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1493756855 0 0) 0x7f24ac0c43a0 con 0x7f24ac06dca0 2023-08-10T10:33:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f249c0035b0 con 0x7f24ac06dca0 2023-08-10T10:33:24.037 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 867187292 0 0) 0x7f249c0035b0 con 0x7f24ac06dca0 2023-08-10T10:33:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 msgr2=0x7f24ac0cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f24ac0cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 >> v1:172.21.15.187:6789/0 conn(0x7f24ac143810 legacy=0x7f24ac0c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac06eba0 con 0x7f24ac06dca0 2023-08-10T10:33:24.038 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f24a40019f0 con 0x7f24ac06dca0 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 >> v1:172.21.15.88:6789/0 conn(0x7f24ac06dca0 legacy=0x7f24ac0c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249c003a30 0x7f249c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f249c004850 0x7f249c004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f249c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac06e8c0 con 0x7f249c004850 2023-08-10T10:33:24.039 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f249c00dd20 con 0x7f249c003a30 2023-08-10T10:33:24.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f249c00dee0 con 0x7f24ac0cc6c0 2023-08-10T10:33:24.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.033+0000 7f24abfff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f249c004850 0x7f249c004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24b0d9b700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249c003a30 0x7f249c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24b159c700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f249c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.040 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 -- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 msgr2=0x7f249c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24ac0cc6c0 0x7f249c005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 -- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249c003a30 msgr2=0x7f249c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249c003a30 0x7f249c003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 -- 172.21.15.88:0/1066104861 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0035b0 con 0x7f249c004850 2023-08-10T10:33:24.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24b0d9b700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f249c003a30 0x7f249c003e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:24.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24abfff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f249c004850 0x7f249c004cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2498009b30 tx=0x7f249c005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8c7dd17b0256cf server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e6c0 con 0x7f249c004850 2023-08-10T10:33:24.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249800e820 con 0x7f249c004850 2023-08-10T10:33:24.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.034+0000 7f24ab7fe700 1 -- 172.21.15.88:0/1066104861 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800eb90 con 0x7f249c004850 2023-08-10T10:33:24.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 -- 172.21.15.88:0/1066104861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f249c004850 msgr2=0x7f249c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 --2- 172.21.15.88:0/1066104861 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f249c004850 0x7f249c004cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2498009b30 tx=0x7f249c005880 comp rx=0 tx=0).stop 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b159c700 1 -- 172.21.15.88:0/1066104861 reap_dead start 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 -- 172.21.15.88:0/1066104861 shutdown_connections 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 -- 172.21.15.88:0/1066104861 >> 172.21.15.88:0/1066104861 conn(0x7f24ac0cb570 msgr2=0x7f24ac0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 -- 172.21.15.88:0/1066104861 shutdown_connections 2023-08-10T10:33:24.043 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.035+0000 7f24b2fff700 1 -- 172.21.15.88:0/1066104861 wait complete. 2023-08-10T10:33:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.037+0000 7f24b2fff700 1 Processor -- start 2023-08-10T10:33:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.037+0000 7f24b2fff700 1 -- start start 2023-08-10T10:33:24.046 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249c004850 0x7f24ac0b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 0x7f24ac0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24ac0ca510 0x7f24ac15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0ca990 con 0x7f24ac159710 2023-08-10T10:33:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0b2840 con 0x7f24ac0ca510 2023-08-10T10:33:24.047 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24b2fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24ac0b2a90 con 0x7f249c004850 2023-08-10T10:33:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24abfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 0x7f24ac0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24abfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 0x7f24ac0c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45462/0 (socket says 172.21.15.88:45462) 2023-08-10T10:33:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.038+0000 7f24abfff700 1 -- 172.21.15.88:0/2601825705 learned_addr learned my addr 172.21.15.88:0/2601825705 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24b0d9b700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249c004850 0x7f24ac0b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24b159c700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24ac0ca510 0x7f24ac15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 -- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249c004850 msgr2=0x7f24ac0b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f249c004850 0x7f24ac0b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 -- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24ac0ca510 msgr2=0x7f24ac15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24ac0ca510 0x7f24ac15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac06e690 con 0x7f24ac159710 2023-08-10T10:33:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24abfff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 0x7f24ac0c9fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f249c00dcf0 tx=0x7f24980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2498021070 con 0x7f24ac159710 2023-08-10T10:33:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24980045d0 con 0x7f24ac159710 2023-08-10T10:33:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24ac0b2d70 con 0x7f24ac159710 2023-08-10T10:33:24.050 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.039+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249800e6c0 con 0x7f24ac159710 2023-08-10T10:33:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.040+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24ac0b3330 con 0x7f24ac159710 2023-08-10T10:33:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.040+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f24ac06e510 con 0x7f24ac159710 2023-08-10T10:33:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.041+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2498025070 con 0x7f24ac159710 2023-08-10T10:33:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.042+0000 7f24a97fa700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f249006ace0 0x7f249006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f249808b0b0 con 0x7f24ac159710 2023-08-10T10:33:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24b0d9b700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f249006ace0 0x7f249006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24a97fa700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f2490074a00 0x7f2490076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2490077550 con 0x7f2490074a00 2023-08-10T10:33:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249808b420 con 0x7f24ac159710 2023-08-10T10:33:24.052 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24b159c700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f2490074a00 0x7f2490076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.043+0000 7f24b0d9b700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f249006ace0 0x7f249006d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007b50 tx=0x7f24a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.044+0000 7f24b159c700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f2490074a00 0x7f2490076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.053 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.044+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== osd.0 v2:172.21.15.88:6800/707783139 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2490077550 con 0x7f2490074a00 2023-08-10T10:33:24.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 --> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f24ac0c45f0 con 0x7f2490074a00 2023-08-10T10:33:24.061 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24a97fa700 1 -- 172.21.15.88:0/2601825705 <== osd.0 v2:172.21.15.88:6800/707783139 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f24a40020f0 con 0x7f2490074a00 2023-08-10T10:33:24.062 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:24.062 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:24.062 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f2490074a00 msgr2=0x7f2490076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6800/707783139,v1:172.21.15.88:6801/707783139] conn(0x7f2490074a00 0x7f2490076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.063 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f249006ace0 msgr2=0x7f249006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f249006ace0 0x7f249006d1a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f24a0007b50 tx=0x7f24a0009040 comp rx=0 tx=0).stop 2023-08-10T10:33:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 msgr2=0x7f24ac0c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 --2- 172.21.15.88:0/2601825705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24ac159710 0x7f24ac0c9fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f249c00dcf0 tx=0x7f24980047c0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b159c700 1 -- 172.21.15.88:0/2601825705 reap_dead start 2023-08-10T10:33:24.064 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 shutdown_connections 2023-08-10T10:33:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.060+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 >> 172.21.15.88:0/2601825705 conn(0x7f24ac0cb570 msgr2=0x7f24ac140050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.061+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 shutdown_connections 2023-08-10T10:33:24.065 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.061+0000 7f24b2fff700 1 -- 172.21.15.88:0/2601825705 wait complete. 2023-08-10T10:33:24.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-10T10:33:24.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.273+0000 7fd112bff700 1 Processor -- start 2023-08-10T10:33:24.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.273+0000 7fd112bff700 1 -- start start 2023-08-10T10:33:24.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd10c159790 0x7fd10c071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd10c0c9f20 0x7fd10c0ca390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c0cb410 con 0x7fd10c159790 2023-08-10T10:33:24.277 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd10c06af70 con 0x7fd10c0c9f20 2023-08-10T10:33:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd112bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0ca8d0 con 0x7fd10c1593b0 2023-08-10T10:33:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd10bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd10c159790 0x7fd10c071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd10bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd10c159790 0x7fd10c071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45472/0 (socket says 172.21.15.88:45472) 2023-08-10T10:33:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd10bfff700 1 -- 172.21.15.88:0/524996572 learned_addr learned my addr 172.21.15.88:0/524996572 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:24.278 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd11099b700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.279 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.275+0000 7fd11119c700 1 --2- 172.21.15.88:0/524996572 >> v2:172.21.15.187:3300/0 conn(0x7fd10c0c9f20 0x7fd10c0ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 -- 172.21.15.88:0/524996572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 msgr2=0x7fd10c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.280 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 -- 172.21.15.88:0/524996572 >> v2:172.21.15.187:3300/0 conn(0x7fd10c0c9f20 msgr2=0x7fd10c0ca390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 --2- 172.21.15.88:0/524996572 >> v2:172.21.15.187:3300/0 conn(0x7fd10c0c9f20 0x7fd10c0ca390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 -- 172.21.15.88:0/524996572 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10c0cab70 con 0x7fd10c159790 2023-08-10T10:33:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10bfff700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c159790 0x7fd10c071760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd10c15e110 tx=0x7fd0f800ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bc69fe28b76a98 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10b7fe700 1 -- 172.21.15.88:0/524996572 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f800cb70 con 0x7fd10c159790 2023-08-10T10:33:24.281 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10b7fe700 1 -- 172.21.15.88:0/524996572 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f800ccd0 con 0x7fd10c159790 2023-08-10T10:33:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.276+0000 7fd10b7fe700 1 -- 172.21.15.88:0/524996572 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f8018620 con 0x7fd10c159790 2023-08-10T10:33:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 -- 172.21.15.88:0/524996572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c159790 msgr2=0x7fd10c071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c159790 0x7fd10c071760 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fd10c15e110 tx=0x7fd0f800ad70 comp rx=0 tx=0).stop 2023-08-10T10:33:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 -- 172.21.15.88:0/524996572 shutdown_connections 2023-08-10T10:33:24.282 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 --2- 172.21.15.88:0/524996572 >> v2:172.21.15.187:3300/0 conn(0x7fd10c0c9f20 0x7fd10c0ca390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 --2- 172.21.15.88:0/524996572 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c159790 0x7fd10c071760 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 -- 172.21.15.88:0/524996572 >> 172.21.15.88:0/524996572 conn(0x7fd10c0ced50 msgr2=0x7fd10c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 -- 172.21.15.88:0/524996572 shutdown_connections 2023-08-10T10:33:24.283 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.277+0000 7fd112bff700 1 -- 172.21.15.88:0/524996572 wait complete. 2023-08-10T10:33:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.279+0000 7fd112bff700 1 Processor -- start 2023-08-10T10:33:24.284 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.279+0000 7fd112bff700 1 -- start start 2023-08-10T10:33:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd10c159790 0x7fd10c0c1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.286 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c8f30 con 0x7fd10c0c9f20 2023-08-10T10:33:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c7950 con 0x7fd10c159790 2023-08-10T10:33:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd112bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd10c0c7c30 con 0x7fd10c1593b0 2023-08-10T10:33:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45484/0 (socket says 172.21.15.88:45484) 2023-08-10T10:33:24.287 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 -- 172.21.15.88:0/245841303 learned_addr learned my addr 172.21.15.88:0/245841303 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:24.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd10bfff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11119c700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd10c159790 0x7fd10c0c1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 -- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 msgr2=0x7fd10c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 -- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd10c159790 msgr2=0x7fd10c0c1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd10c159790 0x7fd10c0c1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.280+0000 7fd11099b700 1 -- 172.21.15.88:0/245841303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f800a6f0 con 0x7fd10c0c9f20 2023-08-10T10:33:24.289 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd11099b700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd10000e9b0 tx=0x7fd10000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd100009710 con 0x7fd10c0c9f20 2023-08-10T10:33:24.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10000c850 con 0x7fd10c0c9f20 2023-08-10T10:33:24.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10000cbc0 con 0x7fd10c0c9f20 2023-08-10T10:33:24.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd10c0c7f10 con 0x7fd10c0c9f20 2023-08-10T10:33:24.290 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.281+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd10c0c84d0 con 0x7fd10c0c9f20 2023-08-10T10:33:24.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.282+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd10c0c8840 con 0x7fd10c0c9f20 2023-08-10T10:33:24.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.283+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd10000cd20 con 0x7fd10c0c9f20 2023-08-10T10:33:24.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.284+0000 7fd1097fa700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.291 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.285+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd1000898d0 con 0x7fd10c0c9f20 2023-08-10T10:33:24.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.285+0000 7fd10bfff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.285+0000 7fd10bfff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800adb0 tx=0x7fd0f8012000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.292 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.289+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fd1000580d0 con 0x7fd10c0c9f20 2023-08-10T10:33:24.486 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.485+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd10c0cb130 con 0x7fd0f006ace0 2023-08-10T10:33:24.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.486+0000 7fd1097fa700 1 -- 172.21.15.88:0/245841303 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd0f801e040 con 0x7fd0f006ace0 2023-08-10T10:33:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 msgr2=0x7fd0f006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 0x7fd0f006d1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800adb0 tx=0x7fd0f8012000 comp rx=0 tx=0).stop 2023-08-10T10:33:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 msgr2=0x7fd10c0c5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fd10000e9b0 tx=0x7fd10000ed70 comp rx=0 tx=0).stop 2023-08-10T10:33:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 shutdown_connections 2023-08-10T10:33:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd10c159790 0x7fd10c0c1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd10c0c9f20 0x7fd10c0c5460 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd0f006ace0 0x7fd0f006d1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 --2- 172.21.15.88:0/245841303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd10c1593b0 0x7fd10c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 >> 172.21.15.88:0/245841303 conn(0x7fd10c0ced50 msgr2=0x7fd10c15aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 shutdown_connections 2023-08-10T10:33:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.488+0000 7fd112bff700 1 -- 172.21.15.88:0/245841303 wait complete. 2023-08-10T10:33:24.492 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 0 to deep-scrub 2023-08-10T10:33:24.508 INFO:tasks.ceph:Scrubbing osd.1 2023-08-10T10:33:24.509 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.707+0000 7fd363bff700 1 Processor -- start 2023-08-10T10:33:24.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.708+0000 7fd363bff700 1 -- start start 2023-08-10T10:33:24.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd363bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0cbf40 0x7fd35c161610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd363bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd35c0af070 0x7fd35c0ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd363bff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c157b10 con 0x7fd35c0b17d0 2023-08-10T10:33:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd363bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c1611f0 con 0x7fd35c0af070 2023-08-10T10:33:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd363bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c161b50 con 0x7fd35c0cbf40 2023-08-10T10:33:24.711 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd36119a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd35c0af070 0x7fd35c0ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd36219c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fd35c0b17d0 0x7fd35c0ca3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45864/0 (socket says 172.21.15.88:45864) 2023-08-10T10:33:24.712 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd36219c700 1 -- 172.21.15.88:0/2040029678 learned_addr learned my addr 172.21.15.88:0/2040029678 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:24.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.709+0000 7fd36199b700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0cbf40 0x7fd35c161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.713 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd36119a700 1 -- 172.21.15.88:0/2040029678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0cbf40 msgr2=0x7fd35c161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd36119a700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0cbf40 0x7fd35c161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd36119a700 1 -- 172.21.15.88:0/2040029678 >> v1:172.21.15.88:6789/0 conn(0x7fd35c0b17d0 legacy=0x7fd35c0ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd36119a700 1 -- 172.21.15.88:0/2040029678 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0cf390 con 0x7fd35c0af070 2023-08-10T10:33:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd360999700 1 -- 172.21.15.88:0/2040029678 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1501502498 0 0) 0x7fd354001490 con 0x7fd35c0b17d0 2023-08-10T10:33:24.714 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd36119a700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c0ceb40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009840 tx=0x7fd34c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee488e3101bff3b8 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd360999700 1 -- 172.21.15.88:0/2040029678 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c011830 con 0x7fd35c0af070 2023-08-10T10:33:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd360999700 1 -- 172.21.15.88:0/2040029678 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd34c011990 con 0x7fd35c0af070 2023-08-10T10:33:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.710+0000 7fd360999700 1 -- 172.21.15.88:0/2040029678 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd34c011d20 con 0x7fd35c0af070 2023-08-10T10:33:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 -- 172.21.15.88:0/2040029678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 msgr2=0x7fd35c0ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.715 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c0ceb40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009840 tx=0x7fd34c009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 -- 172.21.15.88:0/2040029678 shutdown_connections 2023-08-10T10:33:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0cbf40 0x7fd35c161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 --2- 172.21.15.88:0/2040029678 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c0ceb40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 -- 172.21.15.88:0/2040029678 >> 172.21.15.88:0/2040029678 conn(0x7fd35c0cc7d0 msgr2=0x7fd35c0ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.716 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 -- 172.21.15.88:0/2040029678 shutdown_connections 2023-08-10T10:33:24.717 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.711+0000 7fd363bff700 1 -- 172.21.15.88:0/2040029678 wait complete. 2023-08-10T10:33:24.718 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.712+0000 7fd363bff700 1 Processor -- start 2023-08-10T10:33:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.713+0000 7fd363bff700 1 -- start start 2023-08-10T10:33:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b17d0 0x7fd35c160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.719 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c0cbf40 0x7fd35c160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0b4470 con 0x7fd35c0af070 2023-08-10T10:33:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0b3860 con 0x7fd35c0cbf40 2023-08-10T10:33:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd363bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0b3b40 con 0x7fd35c0b17d0 2023-08-10T10:33:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.720 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45490/0 (socket says 172.21.15.88:45490) 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 -- 172.21.15.88:0/3859512490 learned_addr learned my addr 172.21.15.88:0/3859512490 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36219c700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c0cbf40 0x7fd35c160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36119a700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b17d0 0x7fd35c160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 -- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b17d0 msgr2=0x7fd35c160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b17d0 0x7fd35c160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.721 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 -- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c0cbf40 msgr2=0x7fd35c160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c0cbf40 0x7fd35c160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34c0094a0 con 0x7fd35c0af070 2023-08-10T10:33:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36219c700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c0cbf40 0x7fd35c160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.714+0000 7fd36199b700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c1f5b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd35800e810 tx=0x7fd35800ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.722 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.715+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358013610 con 0x7fd35c0af070 2023-08-10T10:33:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.715+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd358013770 con 0x7fd35c0af070 2023-08-10T10:33:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.715+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c0b3e20 con 0x7fd35c0af070 2023-08-10T10:33:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.715+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd358013b20 con 0x7fd35c0af070 2023-08-10T10:33:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.715+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c1f60a0 con 0x7fd35c0af070 2023-08-10T10:33:24.723 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.716+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd35c160e10 con 0x7fd35c0af070 2023-08-10T10:33:24.724 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.717+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fd358013c80 con 0x7fd35c0af070 2023-08-10T10:33:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd3527fc700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd34006ace0 0x7fd34006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fd358089820 con 0x7fd35c0af070 2023-08-10T10:33:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd36119a700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd34006ace0 0x7fd34006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd3527fc700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7fd340074a00 0x7fd340076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.725 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd340077550 con 0x7fd340074a00 2023-08-10T10:33:24.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd358089b90 con 0x7fd35c0af070 2023-08-10T10:33:24.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd36219c700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7fd340074a00 0x7fd340076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.718+0000 7fd36119a700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd34006ace0 0x7fd34006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0090b0 tx=0x7fd34c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.719+0000 7fd36219c700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7fd340074a00 0x7fd340076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.726 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.719+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== osd.1 v2:172.21.15.88:6808/4133826760 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd340077550 con 0x7fd340074a00 2023-08-10T10:33:24.735 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.734+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 --> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd35c0cf670 con 0x7fd340074a00 2023-08-10T10:33:24.736 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd3527fc700 1 -- 172.21.15.88:0/3859512490 <== osd.1 v2:172.21.15.88:6808/4133826760 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd354007230 con 0x7fd340074a00 2023-08-10T10:33:24.736 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:24.737 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:24.737 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:24.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7fd340074a00 msgr2=0x7fd340076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6808/4133826760,v1:172.21.15.88:6809/4133826760] conn(0x7fd340074a00 0x7fd340076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd34006ace0 msgr2=0x7fd34006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.738 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fd34006ace0 0x7fd34006d1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd34c0090b0 tx=0x7fd34c01c040 comp rx=0 tx=0).stop 2023-08-10T10:33:24.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 msgr2=0x7fd35c1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 --2- 172.21.15.88:0/3859512490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd35c0af070 0x7fd35c1f5b60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd35800e810 tx=0x7fd35800ebd0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.739 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd36219c700 1 -- 172.21.15.88:0/3859512490 reap_dead start 2023-08-10T10:33:24.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 shutdown_connections 2023-08-10T10:33:24.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 >> 172.21.15.88:0/3859512490 conn(0x7fd35c0cc7d0 msgr2=0x7fd35c15e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 shutdown_connections 2023-08-10T10:33:24.740 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.735+0000 7fd363bff700 1 -- 172.21.15.88:0/3859512490 wait complete. 2023-08-10T10:33:24.753 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-10T10:33:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.949+0000 7f03ddbff700 1 Processor -- start 2023-08-10T10:33:24.951 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.950+0000 7f03ddbff700 1 -- start start 2023-08-10T10:33:24.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03ddbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 0x7f03d8070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.952 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03ddbff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d806a170 con 0x7f03d8159d00 2023-08-10T10:33:24.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03ddbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d80cdeb0 con 0x7f03d8071b50 2023-08-10T10:33:24.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03ddbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d815dfe0 con 0x7f03d80716d0 2023-08-10T10:33:24.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03d77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f03d8159d00 0x7f03d815d8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45880/0 (socket says 172.21.15.88:45880) 2023-08-10T10:33:24.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03d77fe700 1 -- 172.21.15.88:0/1045114723 learned_addr learned my addr 172.21.15.88:0/1045114723 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:24.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03cffff700 1 --2- 172.21.15.88:0/1045114723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 0x7f03d8070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3081815693 0 0) 0x7f03d806a170 con 0x7f03d8159d00 2023-08-10T10:33:24.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.951+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c40035b0 con 0x7f03d8159d00 2023-08-10T10:33:24.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2405991666 0 0) 0x7f03d80cdeb0 con 0x7f03d8071b50 2023-08-10T10:33:24.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03d806a170 con 0x7f03d8071b50 2023-08-10T10:33:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03cffff700 1 -- 172.21.15.88:0/1045114723 >> v1:172.21.15.187:6789/0 conn(0x7f03d8071b50 legacy=0x7f03d806a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03cffff700 1 -- 172.21.15.88:0/1045114723 >> v1:172.21.15.88:6789/0 conn(0x7f03d8159d00 legacy=0x7f03d815d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03cffff700 1 -- 172.21.15.88:0/1045114723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d80ce190 con 0x7f03d80716d0 2023-08-10T10:33:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03cffff700 1 --2- 172.21.15.88:0/1045114723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 0x7f03d8070990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009870 tx=0x7f03c0009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b670bb37ec668e84 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011830 con 0x7f03d80716d0 2023-08-10T10:33:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c0011990 con 0x7f03d80716d0 2023-08-10T10:33:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.952+0000 7f03d6ffd700 1 -- 172.21.15.88:0/1045114723 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c0011d20 con 0x7f03d80716d0 2023-08-10T10:33:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 -- 172.21.15.88:0/1045114723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 msgr2=0x7f03d8070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 --2- 172.21.15.88:0/1045114723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 0x7f03d8070990 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03c0009870 tx=0x7f03c0009b80 comp rx=0 tx=0).stop 2023-08-10T10:33:24.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 -- 172.21.15.88:0/1045114723 shutdown_connections 2023-08-10T10:33:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 --2- 172.21.15.88:0/1045114723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d80716d0 0x7f03d8070990 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 -- 172.21.15.88:0/1045114723 >> 172.21.15.88:0/1045114723 conn(0x7f03d80ced50 msgr2=0x7f03d80cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 -- 172.21.15.88:0/1045114723 shutdown_connections 2023-08-10T10:33:24.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.953+0000 7f03ddbff700 1 -- 172.21.15.88:0/1045114723 wait complete. 2023-08-10T10:33:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.955+0000 7f03ddbff700 1 Processor -- start 2023-08-10T10:33:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.955+0000 7f03ddbff700 1 -- start start 2023-08-10T10:33:24.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03d8071b50 0x7f03d8156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d8159d00 0x7f03d8152b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81560f0 con 0x7f03d80716d0 2023-08-10T10:33:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81554e0 con 0x7f03d8071b50 2023-08-10T10:33:24.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03ddbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03d81557c0 con 0x7f03d8159d00 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45500/0 (socket says 172.21.15.88:45500) 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 -- 172.21.15.88:0/2776166255 learned_addr learned my addr 172.21.15.88:0/2776166255 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 -- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d8159d00 msgr2=0x7f03d8152b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d8159d00 0x7f03d8152b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 -- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03d8071b50 msgr2=0x7f03d8156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03d8071b50 0x7f03d8156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.956+0000 7f03d77fe700 1 -- 172.21.15.88:0/2776166255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c00094a0 con 0x7f03d80716d0 2023-08-10T10:33:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03d77fe700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f03c800c4d0 tx=0x7f03c800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8005d70 con 0x7f03d80716d0 2023-08-10T10:33:24.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c80070d0 con 0x7f03d80716d0 2023-08-10T10:33:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8007480 con 0x7f03d80716d0 2023-08-10T10:33:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d8155aa0 con 0x7f03d80716d0 2023-08-10T10:33:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.957+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d8155120 con 0x7f03d80716d0 2023-08-10T10:33:24.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.958+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d80cac20 con 0x7f03d80716d0 2023-08-10T10:33:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.959+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f03c80075e0 con 0x7f03d80716d0 2023-08-10T10:33:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.960+0000 7f03d4ff9700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:24.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.960+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f03c8088e90 con 0x7f03d80716d0 2023-08-10T10:33:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.960+0000 7f03cffff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.961+0000 7f03cffff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 0x7f03b806d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03d80caa20 tx=0x7f03c0010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:24.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:24.964+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f03c8053ae0 con 0x7f03d80716d0 2023-08-10T10:33:25.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.160+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f03d80ce750 con 0x7f03b806ace0 2023-08-10T10:33:25.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.161+0000 7f03d4ff9700 1 -- 172.21.15.88:0/2776166255 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f03c00117f0 con 0x7f03b806ace0 2023-08-10T10:33:25.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.163+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 msgr2=0x7f03b806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.163+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 0x7f03b806d1a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f03d80caa20 tx=0x7f03c0010000 comp rx=0 tx=0).stop 2023-08-10T10:33:25.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.163+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 msgr2=0x7f03d8154be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.163+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f03c800c4d0 tx=0x7f03c800c890 comp rx=0 tx=0).stop 2023-08-10T10:33:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.163+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 shutdown_connections 2023-08-10T10:33:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f03b806ace0 0x7f03b806d1a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03d8159d00 0x7f03d8152b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.166 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f03d80716d0 0x7f03d8154be0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 --2- 172.21.15.88:0/2776166255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03d8071b50 0x7f03d8156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 >> 172.21.15.88:0/2776166255 conn(0x7f03d80ced50 msgr2=0x7f03d8070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 shutdown_connections 2023-08-10T10:33:25.167 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.164+0000 7f03ddbff700 1 -- 172.21.15.88:0/2776166255 wait complete. 2023-08-10T10:33:25.168 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 1 to deep-scrub 2023-08-10T10:33:25.183 INFO:tasks.ceph:Scrubbing osd.2 2023-08-10T10:33:25.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:25.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.382+0000 7fc588bff700 1 Processor -- start 2023-08-10T10:33:25.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.382+0000 7fc588bff700 1 -- start start 2023-08-10T10:33:25.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc588bff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc584143810 0x7fc5840c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc588bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc588bff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5840c43a0 con 0x7fc5840cc6c0 2023-08-10T10:33:25.385 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc588bff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5840c4960 con 0x7fc584143810 2023-08-10T10:33:25.386 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc588bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58406e8c0 con 0x7fc58406dca0 2023-08-10T10:33:25.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc584143810 0x7fc5840c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc584143810 0x7fc5840c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45510/0 (socket says 172.21.15.88:45510) 2023-08-10T10:33:25.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 -- 172.21.15.88:0/579511663 learned_addr learned my addr 172.21.15.88:0/579511663 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:25.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc582d9d700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 -- 172.21.15.88:0/579511663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 msgr2=0x7fc5840c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:25.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.384+0000 7fc58259c700 1 -- 172.21.15.88:0/579511663 >> v1:172.21.15.187:6789/0 conn(0x7fc5840cc6c0 legacy=0x7fc5840cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.385+0000 7fc58259c700 1 -- 172.21.15.88:0/579511663 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58406eba0 con 0x7fc584143810 2023-08-10T10:33:25.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.385+0000 7fc58259c700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc5840c4df0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098f0 tx=0x7fc574009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb6d20004521780 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.385+0000 7fc581d9b700 1 -- 172.21.15.88:0/579511663 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011830 con 0x7fc584143810 2023-08-10T10:33:25.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.385+0000 7fc581d9b700 1 -- 172.21.15.88:0/579511663 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc574011990 con 0x7fc584143810 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.385+0000 7fc581d9b700 1 -- 172.21.15.88:0/579511663 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc574011d20 con 0x7fc584143810 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 -- 172.21.15.88:0/579511663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 msgr2=0x7fc5840c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc5840c4df0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc5740098f0 tx=0x7fc574009c00 comp rx=0 tx=0).stop 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 -- 172.21.15.88:0/579511663 shutdown_connections 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 --2- 172.21.15.88:0/579511663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc5840c4df0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 -- 172.21.15.88:0/579511663 >> 172.21.15.88:0/579511663 conn(0x7fc5840cb570 msgr2=0x7fc5840cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:25.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 -- 172.21.15.88:0/579511663 shutdown_connections 2023-08-10T10:33:25.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.386+0000 7fc588bff700 1 -- 172.21.15.88:0/579511663 wait complete. 2023-08-10T10:33:25.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.387+0000 7fc588bff700 1 Processor -- start 2023-08-10T10:33:25.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.388+0000 7fc588bff700 1 -- start start 2023-08-10T10:33:25.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.388+0000 7fc588bff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.388+0000 7fc588bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840cc6c0 0x7fc5840b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc588bff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc58415cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc588bff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58415d270 con 0x7fc584143810 2023-08-10T10:33:25.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc588bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840b2ae0 con 0x7fc5840cc6c0 2023-08-10T10:33:25.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc588bff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5840b1ed0 con 0x7fc58406dca0 2023-08-10T10:33:25.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc58415cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc58415cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45514/0 (socket says 172.21.15.88:45514) 2023-08-10T10:33:25.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 -- 172.21.15.88:0/2322050863 learned_addr learned my addr 172.21.15.88:0/2322050863 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:25.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc58259c700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc57bfff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840cc6c0 0x7fc5840b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 -- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 msgr2=0x7fc5840b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc58406dca0 0x7fc5840b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 -- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840cc6c0 msgr2=0x7fc5840b17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840cc6c0 0x7fc5840b17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc574009550 con 0x7fc584143810 2023-08-10T10:33:25.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.389+0000 7fc582d9d700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc58415cd30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00efc0 tx=0x7fc57c00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.390+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00cad0 con 0x7fc584143810 2023-08-10T10:33:25.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.390+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c00f040 con 0x7fc584143810 2023-08-10T10:33:25.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.390+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5840b21b0 con 0x7fc584143810 2023-08-10T10:33:25.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.390+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00ce70 con 0x7fc584143810 2023-08-10T10:33:25.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.390+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5840b2770 con 0x7fc584143810 2023-08-10T10:33:25.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.391+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5840c5330 con 0x7fc584143810 2023-08-10T10:33:25.398 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.392+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fc57c014480 con 0x7fc584143810 2023-08-10T10:33:25.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57affd700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc56406ace0 0x7fc56406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fc57c08a270 con 0x7fc584143810 2023-08-10T10:33:25.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc58259c700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc56406ace0 0x7fc56406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57affd700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fc564074a00 0x7fc564076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc564077550 con 0x7fc564074a00 2023-08-10T10:33:25.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc57c08c850 con 0x7fc584143810 2023-08-10T10:33:25.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.393+0000 7fc57bfff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fc564074a00 0x7fc564076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.394+0000 7fc58259c700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc56406ace0 0x7fc56406d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc574009c40 tx=0x7fc574008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.394+0000 7fc57bfff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fc564074a00 0x7fc564076e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.395+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== osd.2 v2:172.21.15.88:6816/2073214128 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc564077550 con 0x7fc564074a00 2023-08-10T10:33:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.409+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 --> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc5840c45f0 con 0x7fc564074a00 2023-08-10T10:33:25.411 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc57affd700 1 -- 172.21.15.88:0/2322050863 <== osd.2 v2:172.21.15.88:6816/2073214128 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc56c0014c0 con 0x7fc564074a00 2023-08-10T10:33:25.412 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:25.412 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:25.412 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fc564074a00 msgr2=0x7fc564076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6816/2073214128,v1:172.21.15.88:6817/2073214128] conn(0x7fc564074a00 0x7fc564076e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.413 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc56406ace0 msgr2=0x7fc56406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fc56406ace0 0x7fc56406d1a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc574009c40 tx=0x7fc574008030 comp rx=0 tx=0).stop 2023-08-10T10:33:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 msgr2=0x7fc58415cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 --2- 172.21.15.88:0/2322050863 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc584143810 0x7fc58415cd30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fc57c00efc0 tx=0x7fc57c00c0c0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc582d9d700 1 -- 172.21.15.88:0/2322050863 reap_dead start 2023-08-10T10:33:25.414 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 shutdown_connections 2023-08-10T10:33:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 >> 172.21.15.88:0/2322050863 conn(0x7fc5840cb570 msgr2=0x7fc584070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 shutdown_connections 2023-08-10T10:33:25.415 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.410+0000 7fc588bff700 1 -- 172.21.15.88:0/2322050863 wait complete. 2023-08-10T10:33:25.429 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-10T10:33:25.627 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.626+0000 7f7b729ff700 1 Processor -- start 2023-08-10T10:33:25.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.626+0000 7f7b729ff700 1 -- start start 2023-08-10T10:33:25.628 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.627+0000 7f7b729ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b6c0b8870 0x7f7b6c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.627+0000 7f7b729ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0b8e30 con 0x7f7b6c0b5040 2023-08-10T10:33:25.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.627+0000 7f7b729ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6c0ce010 con 0x7f7b6c15cf20 2023-08-10T10:33:25.629 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.627+0000 7f7b729ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6c0cde30 con 0x7f7b6c0b8870 2023-08-10T10:33:25.630 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.627+0000 7f7b6b7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7b6c0b8870 0x7f7b6c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b70f9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7b6c0b5040 0x7f7b6c0d1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45890/0 (socket says 172.21.15.88:45890) 2023-08-10T10:33:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b70f9c700 1 -- 172.21.15.88:0/3879174254 learned_addr learned my addr 172.21.15.88:0/3879174254 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6b7fe700 1 -- 172.21.15.88:0/3879174254 >> v1:172.21.15.187:6789/0 conn(0x7f7b6c15cf20 legacy=0x7f7b6c15e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6b7fe700 1 -- 172.21.15.88:0/3879174254 >> v1:172.21.15.88:6789/0 conn(0x7f7b6c0b5040 legacy=0x7f7b6c0d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.631 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6b7fe700 1 -- 172.21.15.88:0/3879174254 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6c0ce2f0 con 0x7f7b6c0b8870 2023-08-10T10:33:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6affd700 1 -- 172.21.15.88:0/3879174254 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409379823 0 0) 0x7f7b6c0b8e30 con 0x7f7b6c0b5040 2023-08-10T10:33:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6b7fe700 1 --2- 172.21.15.88:0/3879174254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b8870 0x7f7b6c0b4b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009840 tx=0x7f7b60009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21690a9368c6ed0f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6affd700 1 -- 172.21.15.88:0/3879174254 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60011830 con 0x7f7b6c0b8870 2023-08-10T10:33:25.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6affd700 1 -- 172.21.15.88:0/3879174254 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60011990 con 0x7f7b6c0b8870 2023-08-10T10:33:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.628+0000 7f7b6affd700 1 -- 172.21.15.88:0/3879174254 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60011d20 con 0x7f7b6c0b8870 2023-08-10T10:33:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 -- 172.21.15.88:0/3879174254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b8870 msgr2=0x7f7b6c0b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3879174254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b8870 0x7f7b6c0b4b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7b60009840 tx=0x7f7b60009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 -- 172.21.15.88:0/3879174254 shutdown_connections 2023-08-10T10:33:25.633 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3879174254 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b8870 0x7f7b6c0b4b00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 -- 172.21.15.88:0/3879174254 >> 172.21.15.88:0/3879174254 conn(0x7f7b6c0d3080 msgr2=0x7f7b6c0d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 -- 172.21.15.88:0/3879174254 shutdown_connections 2023-08-10T10:33:25.634 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.629+0000 7f7b729ff700 1 -- 172.21.15.88:0/3879174254 wait complete. 2023-08-10T10:33:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.631+0000 7f7b729ff700 1 Processor -- start 2023-08-10T10:33:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.631+0000 7f7b729ff700 1 -- start start 2023-08-10T10:33:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.636 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 0x7f7b6c1f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b6c15cf20 0x7f7b6c0b6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0b7810 con 0x7f7b6c0b5040 2023-08-10T10:33:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0b7af0 con 0x7f7b6c15cf20 2023-08-10T10:33:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b729ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0cbb40 con 0x7f7b6c0b8870 2023-08-10T10:33:25.637 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45546/0 (socket says 172.21.15.88:45546) 2023-08-10T10:33:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 -- 172.21.15.88:0/3720921548 learned_addr learned my addr 172.21.15.88:0/3720921548 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b70f9c700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b6c15cf20 0x7f7b6c0b6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6b7fe700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 0x7f7b6c1f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.638 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 -- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 msgr2=0x7f7b6c1f6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 0x7f7b6c1f6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 -- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b6c15cf20 msgr2=0x7f7b6c0b6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b6c15cf20 0x7f7b6c0b6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6bfff700 1 -- 172.21.15.88:0/3720921548 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600094a0 con 0x7f7b6c0b5040 2023-08-10T10:33:25.639 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.632+0000 7f7b6b7fe700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 0x7f7b6c1f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b6bfff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c4e0 tx=0x7f7b5c00c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0052d0 con 0x7f7b6c0b5040 2023-08-10T10:33:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5c005430 con 0x7f7b6c0b5040 2023-08-10T10:33:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6c0cbe20 con 0x7f7b6c0b5040 2023-08-10T10:33:25.640 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5c0038c0 con 0x7f7b6c0b5040 2023-08-10T10:33:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.633+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b6c1f2540 con 0x7f7b6c0b5040 2023-08-10T10:33:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.634+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b6c0cc060 con 0x7f7b6c0b5040 2023-08-10T10:33:25.641 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.635+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7b5c003a20 con 0x7f7b6c0b5040 2023-08-10T10:33:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.636+0000 7f7b68ff9700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 0x7f7b5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.636+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7b5c088cf0 con 0x7f7b6c0b5040 2023-08-10T10:33:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.636+0000 7f7b6b7fe700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 0x7f7b5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:25.642 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.637+0000 7f7b6b7fe700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 0x7f7b5806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0d0490 tx=0x7f7b6001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:25.643 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.640+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7b5c0539d0 con 0x7f7b6c0b5040 2023-08-10T10:33:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.843+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b6c0ce5d0 con 0x7f7b5806ace0 2023-08-10T10:33:25.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.844+0000 7f7b68ff9700 1 -- 172.21.15.88:0/3720921548 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f7b60011cb0 con 0x7f7b5806ace0 2023-08-10T10:33:25.848 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 msgr2=0x7f7b5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 0x7f7b5806d1a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0d0490 tx=0x7f7b6001c040 comp rx=0 tx=0).stop 2023-08-10T10:33:25.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 msgr2=0x7f7b6c1f5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:25.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00c4e0 tx=0x7f7b5c00c7f0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.849 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 shutdown_connections 2023-08-10T10:33:25.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b6c15cf20 0x7f7b6c0b6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7b6c0b5040 0x7f7b6c1f5ee0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7b5806ace0 0x7f7b5806d1a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 --2- 172.21.15.88:0/3720921548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b6c0b8870 0x7f7b6c1f6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:25.850 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 >> 172.21.15.88:0/3720921548 conn(0x7f7b6c0d3080 msgr2=0x7f7b6c0d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 shutdown_connections 2023-08-10T10:33:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:25.847+0000 7f7b729ff700 1 -- 172.21.15.88:0/3720921548 wait complete. 2023-08-10T10:33:25.851 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 2 to deep-scrub 2023-08-10T10:33:25.867 INFO:tasks.ceph:Scrubbing osd.3 2023-08-10T10:33:25.867 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:26.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.065+0000 7ff6cfbff700 1 Processor -- start 2023-08-10T10:33:26.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.065+0000 7ff6cfbff700 1 -- start start 2023-08-10T10:33:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cfbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6c8143810 0x7ff6c80c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cfbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 0x7ff6c80cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cfbff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c80c43a0 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cfbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c80c4960 con 0x7ff6c8143810 2023-08-10T10:33:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cfbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c806e8c0 con 0x7ff6c80cc6c0 2023-08-10T10:33:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.066+0000 7ff6cd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6c8143810 0x7ff6c80c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff6c8143810 0x7ff6c80c4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45556/0 (socket says 172.21.15.88:45556) 2023-08-10T10:33:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 -- 172.21.15.88:0/2539554640 learned_addr learned my addr 172.21.15.88:0/2539554640 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:26.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd19a700 1 --2- 172.21.15.88:0/2539554640 >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 0x7ff6c80cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 -- 172.21.15.88:0/2539554640 >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 msgr2=0x7ff6c80cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 --2- 172.21.15.88:0/2539554640 >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 0x7ff6c80cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 -- 172.21.15.88:0/2539554640 >> v1:172.21.15.187:6789/0 conn(0x7ff6c80ce3c0 legacy=0x7ff6c80c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 -- 172.21.15.88:0/2539554640 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c806eba0 con 0x7ff6c8143810 2023-08-10T10:33:26.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd19a700 1 --2- 172.21.15.88:0/2539554640 >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 0x7ff6c80cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cd99b700 1 --2- 172.21.15.88:0/2539554640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c8143810 0x7ff6c80c4df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8072850 tx=0x7ff6c4009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c88b5d2d4a8d74 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.067+0000 7ff6cc999700 1 -- 172.21.15.88:0/2539554640 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c4004230 con 0x7ff6c8143810 2023-08-10T10:33:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cc999700 1 -- 172.21.15.88:0/2539554640 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c4004390 con 0x7ff6c8143810 2023-08-10T10:33:26.072 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cc999700 1 -- 172.21.15.88:0/2539554640 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40036a0 con 0x7ff6c8143810 2023-08-10T10:33:26.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 -- 172.21.15.88:0/2539554640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c8143810 msgr2=0x7ff6c80c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/2539554640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c8143810 0x7ff6c80c4df0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8072850 tx=0x7ff6c4009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 -- 172.21.15.88:0/2539554640 shutdown_connections 2023-08-10T10:33:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/2539554640 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c8143810 0x7ff6c80c4df0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/2539554640 >> v2:172.21.15.187:3300/0 conn(0x7ff6c80cc6c0 0x7ff6c80cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 -- 172.21.15.88:0/2539554640 >> 172.21.15.88:0/2539554640 conn(0x7ff6c80cb570 msgr2=0x7ff6c80cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 -- 172.21.15.88:0/2539554640 shutdown_connections 2023-08-10T10:33:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.068+0000 7ff6cfbff700 1 -- 172.21.15.88:0/2539554640 wait complete. 2023-08-10T10:33:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.070+0000 7ff6cfbff700 1 Processor -- start 2023-08-10T10:33:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.070+0000 7ff6cfbff700 1 -- start start 2023-08-10T10:33:26.076 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c80cc6c0 0x7ff6c815ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 0x7ff6c815bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c8143810 0x7ff6c80ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80ae3d0 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c815c4c0 con 0x7ff6c8143810 2023-08-10T10:33:26.077 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cfbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c80adb70 con 0x7ff6c80cc6c0 2023-08-10T10:33:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 0x7ff6c815bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cd19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 0x7ff6c815bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45558/0 (socket says 172.21.15.88:45558) 2023-08-10T10:33:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cd19a700 1 -- 172.21.15.88:0/3554110752 learned_addr learned my addr 172.21.15.88:0/3554110752 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6cd99b700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c80cc6c0 0x7ff6c815ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.078 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.071+0000 7ff6ce19c700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c8143810 0x7ff6c80ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 -- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c80cc6c0 msgr2=0x7ff6c815ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c80cc6c0 0x7ff6c815ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 -- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c8143810 msgr2=0x7ff6c80ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c8143810 0x7ff6c80ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4009550 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.079 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cd19a700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 0x7ff6c815bf80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c820 tx=0x7ff6b800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8011800 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8011960 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8011d10 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c80ade10 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.080 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.072+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c80c5d40 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.081 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.073+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6c80c5bc0 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.074+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7ff6b8018360 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6be7fc700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff6ac06ace0 0x7ff6ac06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7ff6b80895d0 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.082 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6cd99b700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff6ac06ace0 0x7ff6ac06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6be7fc700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7ff6ac0749f0 0x7ff6ac076e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6ac077540 con 0x7ff6ac0749f0 2023-08-10T10:33:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.075+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6b808bbb0 con 0x7ff6c80ce3c0 2023-08-10T10:33:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.076+0000 7ff6ce19c700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7ff6ac0749f0 0x7ff6ac076e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.083 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.076+0000 7ff6cd99b700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff6ac06ace0 0x7ff6ac06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009130 tx=0x7ff6c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.076+0000 7ff6ce19c700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7ff6ac0749f0 0x7ff6ac076e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.084 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.077+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== osd.3 v2:172.21.15.88:6824/551215602 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff6ac077540 con 0x7ff6ac0749f0 2023-08-10T10:33:26.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 --> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff6c80c5330 con 0x7ff6ac0749f0 2023-08-10T10:33:26.093 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6be7fc700 1 -- 172.21.15.88:0/3554110752 <== osd.3 v2:172.21.15.88:6824/551215602 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7ff6c000b4b0 con 0x7ff6ac0749f0 2023-08-10T10:33:26.094 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:26.094 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:26.094 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:26.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7ff6ac0749f0 msgr2=0x7ff6ac076e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.095 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6824/551215602,v1:172.21.15.88:6825/551215602] conn(0x7ff6ac0749f0 0x7ff6ac076e70 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff6ac06ace0 msgr2=0x7ff6ac06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7ff6ac06ace0 0x7ff6ac06d1a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009130 tx=0x7ff6c4008030 comp rx=0 tx=0).stop 2023-08-10T10:33:26.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 msgr2=0x7ff6c815bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6cfbff700 1 --2- 172.21.15.88:0/3554110752 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff6c80ce3c0 0x7ff6c815bf80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800c820 tx=0x7ff6b800cb30 comp rx=0 tx=0).stop 2023-08-10T10:33:26.096 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.092+0000 7ff6ce19c700 1 -- 172.21.15.88:0/3554110752 reap_dead start 2023-08-10T10:33:26.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.093+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 shutdown_connections 2023-08-10T10:33:26.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.093+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 >> 172.21.15.88:0/3554110752 conn(0x7ff6c80cb570 msgr2=0x7ff6c806cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.093+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 shutdown_connections 2023-08-10T10:33:26.097 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.093+0000 7ff6cfbff700 1 -- 172.21.15.88:0/3554110752 wait complete. 2023-08-10T10:33:26.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-10T10:33:26.306 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.305+0000 7fecafdff700 1 Processor -- start 2023-08-10T10:33:26.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.305+0000 7fecafdff700 1 -- start start 2023-08-10T10:33:26.307 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.306+0000 7fecafdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 0x7feca80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.306+0000 7fecafdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80cf560 0x7feca806d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.306+0000 7fecafdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca80b05c0 con 0x7feca80afd50 2023-08-10T10:33:26.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.306+0000 7fecafdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca815ee50 con 0x7feca80cf560 2023-08-10T10:33:26.308 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.306+0000 7fecafdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80cf9a0 con 0x7feca80b0130 2023-08-10T10:33:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80cf560 0x7feca806d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7feca80cf560 0x7feca806d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45568/0 (socket says 172.21.15.88:45568) 2023-08-10T10:33:26.310 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 -- 172.21.15.88:0/2520502690 learned_addr learned my addr 172.21.15.88:0/2520502690 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecad39a700 1 --2- 172.21.15.88:0/2520502690 >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 0x7feca80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 -- 172.21.15.88:0/2520502690 >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 msgr2=0x7feca80cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 --2- 172.21.15.88:0/2520502690 >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 0x7feca80cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 -- 172.21.15.88:0/2520502690 >> v1:172.21.15.187:6789/0 conn(0x7feca80afd50 legacy=0x7feca815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.311 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 -- 172.21.15.88:0/2520502690 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca806c2d0 con 0x7feca80cf560 2023-08-10T10:33:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecad39a700 1 --2- 172.21.15.88:0/2520502690 >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 0x7feca80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.307+0000 7fecae39c700 1 --2- 172.21.15.88:0/2520502690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca806d090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feca80701a0 tx=0x7feca000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275cc5a059f2abec server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecacb99700 1 -- 172.21.15.88:0/2520502690 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000e070 con 0x7feca80cf560 2023-08-10T10:33:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecacb99700 1 -- 172.21.15.88:0/2520502690 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca000b9c0 con 0x7feca80cf560 2023-08-10T10:33:26.312 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecacb99700 1 -- 172.21.15.88:0/2520502690 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca000bd70 con 0x7feca80cf560 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 -- 172.21.15.88:0/2520502690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 msgr2=0x7feca806d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 --2- 172.21.15.88:0/2520502690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca806d090 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7feca80701a0 tx=0x7feca000b330 comp rx=0 tx=0).stop 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 -- 172.21.15.88:0/2520502690 shutdown_connections 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 --2- 172.21.15.88:0/2520502690 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca806d090 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 --2- 172.21.15.88:0/2520502690 >> v2:172.21.15.187:3300/0 conn(0x7feca80b0130 0x7feca80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.313 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 -- 172.21.15.88:0/2520502690 >> 172.21.15.88:0/2520502690 conn(0x7feca806f200 msgr2=0x7feca806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 -- 172.21.15.88:0/2520502690 shutdown_connections 2023-08-10T10:33:26.314 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.308+0000 7fecafdff700 1 -- 172.21.15.88:0/2520502690 wait complete. 2023-08-10T10:33:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.310+0000 7fecafdff700 1 Processor -- start 2023-08-10T10:33:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.310+0000 7fecafdff700 1 -- start start 2023-08-10T10:33:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feca80afd50 0x7feca81f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 0x7feca81f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.316 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca81e6c90 con 0x7feca80cf560 2023-08-10T10:33:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca81e8b80 con 0x7feca80b0130 2023-08-10T10:33:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecafdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca81e9140 con 0x7feca80afd50 2023-08-10T10:33:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecae39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.317 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecae39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45576/0 (socket says 172.21.15.88:45576) 2023-08-10T10:33:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.311+0000 7fecae39c700 1 -- 172.21.15.88:0/1797053233 learned_addr learned my addr 172.21.15.88:0/1797053233 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 -- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feca80afd50 msgr2=0x7feca81f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feca80afd50 0x7feca81f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecad39a700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 0x7feca81f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.318 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 -- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 msgr2=0x7feca81f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 0x7feca81f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 -- 172.21.15.88:0/1797053233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca0009b30 con 0x7feca80cf560 2023-08-10T10:33:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecad39a700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 0x7feca81f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecae39c700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feca000b730 tx=0x7feca0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.319 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca00099b0 con 0x7feca80cf560 2023-08-10T10:33:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00092e0 con 0x7feca80cf560 2023-08-10T10:33:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecafdff700 1 -- 172.21.15.88:0/1797053233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80b64a0 con 0x7feca80cf560 2023-08-10T10:33:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca001b630 con 0x7feca80cf560 2023-08-10T10:33:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.312+0000 7fecafdff700 1 -- 172.21.15.88:0/1797053233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca81e8dd0 con 0x7feca80cf560 2023-08-10T10:33:26.320 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.314+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec840052f0 con 0x7feca80cf560 2023-08-10T10:33:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.314+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7feca001b790 con 0x7feca80cf560 2023-08-10T10:33:26.321 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.315+0000 7fec9e7fc700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 0x7fec8c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.315+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7feca008b110 con 0x7feca80cf560 2023-08-10T10:33:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.315+0000 7fecadb9b700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 0x7fec8c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.316+0000 7fecadb9b700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 0x7fec8c06d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f60 tx=0x7feca4007a40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.322 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.320+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7feca0055e80 con 0x7feca80cf560 2023-08-10T10:33:26.524 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.523+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fec84000bc0 con 0x7fec8c06ace0 2023-08-10T10:33:26.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.524+0000 7fec9e7fc700 1 -- 172.21.15.88:0/1797053233 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fec84000bc0 con 0x7fec8c06ace0 2023-08-10T10:33:26.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 msgr2=0x7fec8c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 0x7fec8c06d1a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7feca4000f60 tx=0x7feca4007a40 comp rx=0 tx=0).stop 2023-08-10T10:33:26.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 msgr2=0x7feca81f6ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7feca000b730 tx=0x7feca0004ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.528 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 shutdown_connections 2023-08-10T10:33:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feca80cf560 0x7feca81f6ae0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fec8c06ace0 0x7fec8c06d1a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feca80afd50 0x7feca81f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 --2- 172.21.15.88:0/1797053233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feca80b0130 0x7feca81f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.529 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 >> 172.21.15.88:0/1797053233 conn(0x7feca806f200 msgr2=0x7feca806d330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 shutdown_connections 2023-08-10T10:33:26.530 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.526+0000 7fec8bfff700 1 -- 172.21.15.88:0/1797053233 wait complete. 2023-08-10T10:33:26.530 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 3 to deep-scrub 2023-08-10T10:33:26.545 INFO:tasks.ceph:Scrubbing osd.4 2023-08-10T10:33:26.546 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:26.580 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:26.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:26.750 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.749+0000 7fcffcdff700 1 Processor -- start 2023-08-10T10:33:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.749+0000 7fcffcdff700 1 -- start start 2023-08-10T10:33:26.751 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcffcdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcff8156f70 0x7fcff815a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcffcdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcff806b110 0x7fcff80c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcffcdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcff815a820 con 0x7fcff80cd560 2023-08-10T10:33:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcffcdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff806d480 con 0x7fcff8156f70 2023-08-10T10:33:26.752 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcffcdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcff8157350 con 0x7fcff806b110 2023-08-10T10:33:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.750+0000 7fcff659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcff8156f70 0x7fcff815a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff5d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fcff80cd560 0x7fcff806aa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45896/0 (socket says 172.21.15.88:45896) 2023-08-10T10:33:26.754 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff5d9b700 1 -- 172.21.15.88:0/2565444461 learned_addr learned my addr 172.21.15.88:0/2565444461 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff6d9d700 1 --2- 172.21.15.88:0/2565444461 >> v2:172.21.15.187:3300/0 conn(0x7fcff806b110 0x7fcff80c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff659c700 1 -- 172.21.15.88:0/2565444461 >> v2:172.21.15.187:3300/0 conn(0x7fcff806b110 msgr2=0x7fcff80c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff659c700 1 --2- 172.21.15.88:0/2565444461 >> v2:172.21.15.187:3300/0 conn(0x7fcff806b110 0x7fcff80c3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.755 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff659c700 1 -- 172.21.15.88:0/2565444461 >> v1:172.21.15.88:6789/0 conn(0x7fcff80cd560 legacy=0x7fcff806aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff659c700 1 -- 172.21.15.88:0/2565444461 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff80cdab0 con 0x7fcff8156f70 2023-08-10T10:33:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff559a700 1 -- 172.21.15.88:0/2565444461 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137152730 0 0) 0x7fcff815a820 con 0x7fcff80cd560 2023-08-10T10:33:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff659c700 1 --2- 172.21.15.88:0/2565444461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff8156f70 0x7fcff815a2e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcff80cc590 tx=0x7fcfe8009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48b936cf4c971607 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff559a700 1 -- 172.21.15.88:0/2565444461 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011830 con 0x7fcff8156f70 2023-08-10T10:33:26.756 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff559a700 1 -- 172.21.15.88:0/2565444461 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe8011990 con 0x7fcff8156f70 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.751+0000 7fcff559a700 1 -- 172.21.15.88:0/2565444461 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8011d20 con 0x7fcff8156f70 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 -- 172.21.15.88:0/2565444461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff8156f70 msgr2=0x7fcff815a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 --2- 172.21.15.88:0/2565444461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff8156f70 0x7fcff815a2e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fcff80cc590 tx=0x7fcfe8009b50 comp rx=0 tx=0).stop 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 -- 172.21.15.88:0/2565444461 shutdown_connections 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 --2- 172.21.15.88:0/2565444461 >> v2:172.21.15.187:3300/0 conn(0x7fcff806b110 0x7fcff80c3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.757 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 --2- 172.21.15.88:0/2565444461 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff8156f70 0x7fcff815a2e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 -- 172.21.15.88:0/2565444461 >> 172.21.15.88:0/2565444461 conn(0x7fcff80cb570 msgr2=0x7fcff80cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 -- 172.21.15.88:0/2565444461 shutdown_connections 2023-08-10T10:33:26.758 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.752+0000 7fcffcdff700 1 -- 172.21.15.88:0/2565444461 wait complete. 2023-08-10T10:33:26.760 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.754+0000 7fcffcdff700 1 Processor -- start 2023-08-10T10:33:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.754+0000 7fcffcdff700 1 -- start start 2023-08-10T10:33:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 0x7fcff81ef2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff80cd560 0x7fcff80c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff8156f70 0x7fcff806d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.761 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81ef7f0 con 0x7fcff806b110 2023-08-10T10:33:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcff8141030 con 0x7fcff80cd560 2023-08-10T10:33:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcffcdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcff81f2cd0 con 0x7fcff8156f70 2023-08-10T10:33:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 0x7fcff81ef2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff659c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 0x7fcff81ef2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45596/0 (socket says 172.21.15.88:45596) 2023-08-10T10:33:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff659c700 1 -- 172.21.15.88:0/4281516369 learned_addr learned my addr 172.21.15.88:0/4281516369 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff5d9b700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff80cd560 0x7fcff80c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff6d9d700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff8156f70 0x7fcff806d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff659c700 1 -- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff8156f70 msgr2=0x7fcff806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.755+0000 7fcff659c700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff8156f70 0x7fcff806d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.763 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcff659c700 1 -- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff80cd560 msgr2=0x7fcff80c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcff659c700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcff80cd560 0x7fcff80c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcff659c700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80094a0 con 0x7fcff806b110 2023-08-10T10:33:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcff6d9d700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcff8156f70 0x7fcff806d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:26.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcff659c700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 0x7fcff81ef2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097c0 tx=0x7fcfe8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe80036a0 con 0x7fcff806b110 2023-08-10T10:33:26.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe801e070 con 0x7fcff806b110 2023-08-10T10:33:26.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe8003a20 con 0x7fcff806b110 2023-08-10T10:33:26.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcff81f2150 con 0x7fcff806b110 2023-08-10T10:33:26.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.756+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff81f29f0 con 0x7fcff806b110 2023-08-10T10:33:26.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.757+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcff80ce070 con 0x7fcff806b110 2023-08-10T10:33:26.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.758+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fcfe8003b80 con 0x7fcff806b110 2023-08-10T10:33:26.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcfe6ffd700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcfd806ace0 0x7fcfd806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fcfe808a790 con 0x7fcff806b110 2023-08-10T10:33:26.766 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcff5d9b700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcfd806ace0 0x7fcfd806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcfe6ffd700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7fcfd8074a00 0x7fcfd8076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.767 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcfd8077550 con 0x7fcfd8074a00 2023-08-10T10:33:26.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.759+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfe808cd10 con 0x7fcff806b110 2023-08-10T10:33:26.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.760+0000 7fcff5d9b700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcfd806ace0 0x7fcfd806d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcff8152350 tx=0x7fcfec007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.760+0000 7fcff6d9d700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7fcfd8074a00 0x7fcfd8076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.761+0000 7fcff6d9d700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7fcfd8074a00 0x7fcfd8076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:26.768 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.761+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== osd.4 v2:172.21.15.187:6800/2556306423 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fcfd8077550 con 0x7fcfd8074a00 2023-08-10T10:33:26.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.776+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 --> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcff80cdd90 con 0x7fcfd8074a00 2023-08-10T10:33:26.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcfe6ffd700 1 -- 172.21.15.88:0/4281516369 <== osd.4 v2:172.21.15.187:6800/2556306423 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fcff0010040 con 0x7fcfd8074a00 2023-08-10T10:33:26.779 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:26.779 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:26.779 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:26.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7fcfd8074a00 msgr2=0x7fcfd8076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.187:6800/2556306423,v1:172.21.15.187:6801/2556306423] conn(0x7fcfd8074a00 0x7fcfd8076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcfd806ace0 msgr2=0x7fcfd806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fcfd806ace0 0x7fcfd806d1a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcff8152350 tx=0x7fcfec007de0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 msgr2=0x7fcff81ef2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcffcdff700 1 --2- 172.21.15.88:0/4281516369 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcff806b110 0x7fcff81ef2b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fcfe80097c0 tx=0x7fcfe8004750 comp rx=0 tx=0).stop 2023-08-10T10:33:26.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.777+0000 7fcff6d9d700 1 -- 172.21.15.88:0/4281516369 reap_dead start 2023-08-10T10:33:26.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.778+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 shutdown_connections 2023-08-10T10:33:26.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.778+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 >> 172.21.15.88:0/4281516369 conn(0x7fcff80cb570 msgr2=0x7fcff8152800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:26.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.778+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 shutdown_connections 2023-08-10T10:33:26.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.778+0000 7fcffcdff700 1 -- 172.21.15.88:0/4281516369 wait complete. 2023-08-10T10:33:26.796 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-10T10:33:26.992 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.991+0000 7f9d2299d700 1 Processor -- start 2023-08-10T10:33:26.993 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.991+0000 7f9d2299d700 1 -- start start 2023-08-10T10:33:26.994 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2299d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 0x7f9d1c0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2299d700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d1c0b6710 0x7f9d1c0b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2299d700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d1c0d1b50 con 0x7f9d1c160450 2023-08-10T10:33:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2299d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0b51c0 con 0x7f9d1c0b47f0 2023-08-10T10:33:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2299d700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d1c0d1da0 con 0x7f9d1c0b6710 2023-08-10T10:33:26.995 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2119a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 0x7f9d1c0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2219c700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9d1c0b6710 0x7f9d1c0b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2199b700 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9d1c160450 0x7f9d1c0cddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:46142/0 (socket says 172.21.15.88:46142) 2023-08-10T10:33:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2119a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 0x7f9d1c0b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45610/0 (socket says 172.21.15.88:45610) 2023-08-10T10:33:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.992+0000 7f9d2199b700 1 -- 172.21.15.88:0/3079512328 learned_addr learned my addr 172.21.15.88:0/3079512328 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:26.996 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d2219c700 1 -- 172.21.15.88:0/3079512328 >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 msgr2=0x7f9d1c0b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d2219c700 1 --2- 172.21.15.88:0/3079512328 >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 0x7f9d1c0b4c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d2219c700 1 -- 172.21.15.88:0/3079512328 >> v1:172.21.15.187:6789/0 conn(0x7f9d1c160450 legacy=0x7f9d1c0cddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d2219c700 1 -- 172.21.15.88:0/3079512328 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0d2080 con 0x7f9d1c0b6710 2023-08-10T10:33:26.997 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d20999700 1 -- 172.21.15.88:0/3079512328 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633400809 0 0) 0x7f9d1c0d1b50 con 0x7f9d1c160450 2023-08-10T10:33:26.998 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d2219c700 1 --2- 172.21.15.88:0/3079512328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0b6ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0b5890 tx=0x7f9d1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff7a624f79c5ebb server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d20999700 1 -- 172.21.15.88:0/3079512328 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e070 con 0x7f9d1c0b6710 2023-08-10T10:33:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d20999700 1 -- 172.21.15.88:0/3079512328 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400bb20 con 0x7f9d1c0b6710 2023-08-10T10:33:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.993+0000 7f9d20999700 1 -- 172.21.15.88:0/3079512328 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d14012430 con 0x7f9d1c0b6710 2023-08-10T10:33:27.000 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 -- 172.21.15.88:0/3079512328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 msgr2=0x7f9d1c0b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3079512328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0b6ba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0b5890 tx=0x7f9d1400b330 comp rx=0 tx=0).stop 2023-08-10T10:33:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 -- 172.21.15.88:0/3079512328 shutdown_connections 2023-08-10T10:33:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3079512328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0b6ba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3079512328 >> v2:172.21.15.88:3300/0 conn(0x7f9d1c0b47f0 0x7f9d1c0b4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.001 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 -- 172.21.15.88:0/3079512328 >> 172.21.15.88:0/3079512328 conn(0x7f9d1c0cf7f0 msgr2=0x7f9d1c0cfbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 -- 172.21.15.88:0/3079512328 shutdown_connections 2023-08-10T10:33:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.994+0000 7f9d2299d700 1 -- 172.21.15.88:0/3079512328 wait complete. 2023-08-10T10:33:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.996+0000 7f9d2299d700 1 Processor -- start 2023-08-10T10:33:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.996+0000 7f9d2299d700 1 -- start start 2023-08-10T10:33:27.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0ca380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d1c160450 0x7f9d1c0cbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c150c30 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c1f29d0 con 0x7f9d1c0b6710 2023-08-10T10:33:27.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2299d700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c0c75f0 con 0x7f9d1c160450 2023-08-10T10:33:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2199b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45626/0 (socket says 172.21.15.88:45626) 2023-08-10T10:33:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2199b700 1 -- 172.21.15.88:0/3200520078 learned_addr learned my addr 172.21.15.88:0/3200520078 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2119a700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0ca380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.004 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.997+0000 7f9d2219c700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d1c160450 0x7f9d1c0cbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 -- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d1c160450 msgr2=0x7f9d1c0cbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d1c160450 0x7f9d1c0cbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 -- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 msgr2=0x7f9d1c0ca380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0ca380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.005 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 -- 172.21.15.88:0/3200520078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14009a70 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2199b700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c5b0 tx=0x7f9d1800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18004c80 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d18004e00 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d18007310 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c150950 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.006 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.998+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c0c7280 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.007 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:26.999+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c04ecc0 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.000+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f9d18007470 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.001+0000 7f9d127fc700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 0x7f9d0006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.001+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f9d180894a0 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.001+0000 7f9d2119a700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 0x7f9d0006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.008 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.002+0000 7f9d2119a700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 0x7f9d0006d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c150e80 tx=0x7f9d0c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.009 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.006+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f9d180540f0 con 0x7f9d1c0b47f0 2023-08-10T10:33:27.203 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.202+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f9d1c0c6e20 con 0x7f9d0006ace0 2023-08-10T10:33:27.204 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.202+0000 7f9d127fc700 1 -- 172.21.15.88:0/3200520078 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f9d0c0118e0 con 0x7f9d0006ace0 2023-08-10T10:33:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.204+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 msgr2=0x7f9d0006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.204+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 0x7f9d0006d1a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c150e80 tx=0x7f9d0c009210 comp rx=0 tx=0).stop 2023-08-10T10:33:27.206 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.204+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 msgr2=0x7f9d1c0c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.204+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f9d1800c5b0 tx=0x7f9d1800c8c0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 shutdown_connections 2023-08-10T10:33:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f9d0006ace0 0x7f9d0006d1a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d1c160450 0x7f9d1c0cbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.207 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9d1c0b47f0 0x7f9d1c0c9e40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 --2- 172.21.15.88:0/3200520078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d1c0b6710 0x7f9d1c0ca380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 >> 172.21.15.88:0/3200520078 conn(0x7f9d1c0cf7f0 msgr2=0x7f9d1c0d35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 shutdown_connections 2023-08-10T10:33:27.208 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.205+0000 7f9d2299d700 1 -- 172.21.15.88:0/3200520078 wait complete. 2023-08-10T10:33:27.209 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 4 to deep-scrub 2023-08-10T10:33:27.224 INFO:tasks.ceph:Scrubbing osd.5 2023-08-10T10:33:27.225 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.425+0000 7f592fbff700 1 Processor -- start 2023-08-10T10:33:27.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.425+0000 7f592fbff700 1 -- start start 2023-08-10T10:33:27.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5928143810 0x7f59280c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 0x7f59280cde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59280ce3c0 0x7f59280c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280c43a0 con 0x7f59280ce3c0 2023-08-10T10:33:27.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280c4960 con 0x7f5928143810 2023-08-10T10:33:27.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592fbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592806e8c0 con 0x7f59280cc6c0 2023-08-10T10:33:27.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592e19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59280ce3c0 0x7f59280c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592e19c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f59280ce3c0 0x7f59280c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45640/0 (socket says 172.21.15.88:45640) 2023-08-10T10:33:27.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.426+0000 7f592e19c700 1 -- 172.21.15.88:0/2765372479 learned_addr learned my addr 172.21.15.88:0/2765372479 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:27.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592d99b700 1 --2- 172.21.15.88:0/2765372479 >> v2:172.21.15.187:3300/0 conn(0x7f5928143810 0x7f59280c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592d19a700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 0x7f59280cde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 -- 172.21.15.88:0/2765372479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 msgr2=0x7f59280cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:27.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 0x7f59280cde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 -- 172.21.15.88:0/2765372479 >> v2:172.21.15.187:3300/0 conn(0x7f5928143810 msgr2=0x7f59280c4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:27.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 --2- 172.21.15.88:0/2765372479 >> v2:172.21.15.187:3300/0 conn(0x7f5928143810 0x7f59280c4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 -- 172.21.15.88:0/2765372479 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592806eba0 con 0x7f59280ce3c0 2023-08-10T10:33:27.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592d19a700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 0x7f59280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:33:27.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592e19c700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280c9140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5928072970 tx=0x7f592000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b276487e1d4c32ab server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.427+0000 7f592c999700 1 -- 172.21.15.88:0/2765372479 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000e070 con 0x7f59280ce3c0 2023-08-10T10:33:27.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592c999700 1 -- 172.21.15.88:0/2765372479 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592000b910 con 0x7f59280ce3c0 2023-08-10T10:33:27.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592c999700 1 -- 172.21.15.88:0/2765372479 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592000bcc0 con 0x7f59280ce3c0 2023-08-10T10:33:27.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 -- 172.21.15.88:0/2765372479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 msgr2=0x7f59280c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280c9140 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5928072970 tx=0x7f592000b330 comp rx=0 tx=0).stop 2023-08-10T10:33:27.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 -- 172.21.15.88:0/2765372479 shutdown_connections 2023-08-10T10:33:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 --2- 172.21.15.88:0/2765372479 >> v2:172.21.15.187:3300/0 conn(0x7f5928143810 0x7f59280c4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280c9140 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 --2- 172.21.15.88:0/2765372479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59280cc6c0 0x7f59280cde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 -- 172.21.15.88:0/2765372479 >> 172.21.15.88:0/2765372479 conn(0x7f59280cb570 msgr2=0x7f59280cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 -- 172.21.15.88:0/2765372479 shutdown_connections 2023-08-10T10:33:27.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.428+0000 7f592fbff700 1 -- 172.21.15.88:0/2765372479 wait complete. 2023-08-10T10:33:27.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.430+0000 7f592fbff700 1 Processor -- start 2023-08-10T10:33:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.430+0000 7f592fbff700 1 -- start start 2023-08-10T10:33:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59280cc6c0 0x7f59281598e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5928143810 0x7f59281f2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.437 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5928159e20 con 0x7f59280ce3c0 2023-08-10T10:33:27.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b2040 con 0x7f59280cc6c0 2023-08-10T10:33:27.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592fbff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280b2320 con 0x7f5928143810 2023-08-10T10:33:27.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592d19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592d19a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45654/0 (socket says 172.21.15.88:45654) 2023-08-10T10:33:27.438 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592d19a700 1 -- 172.21.15.88:0/3591482188 learned_addr learned my addr 172.21.15.88:0/3591482188 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592d99b700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59280cc6c0 0x7f59281598e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.431+0000 7f592e19c700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5928143810 0x7f59281f2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 -- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5928143810 msgr2=0x7f59281f2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5928143810 0x7f59281f2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.439 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 -- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59280cc6c0 msgr2=0x7f59281598e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59280cc6c0 0x7f59281598e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009b30 con 0x7f59280ce3c0 2023-08-10T10:33:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592d19a700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280b17f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f591800d7d0 tx=0x7f591800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918004030 con 0x7f59280ce3c0 2023-08-10T10:33:27.440 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918004190 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918004500 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59280b2600 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.432+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280b2bc0 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.433+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f59280c5330 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.434+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f59180036a0 con 0x7f59280ce3c0 2023-08-10T10:33:27.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.435+0000 7f591e7fc700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f590c06ace0 0x7f590c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.435+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f5918089460 con 0x7f59280ce3c0 2023-08-10T10:33:27.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.435+0000 7f592d99b700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f590c06ace0 0x7f590c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.435+0000 7f591e7fc700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f590c074a00 0x7f590c076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.436+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f590c077550 con 0x7f590c074a00 2023-08-10T10:33:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.436+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f591808ba40 con 0x7f59280ce3c0 2023-08-10T10:33:27.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.436+0000 7f592e19c700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f590c074a00 0x7f590c076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.436+0000 7f592d99b700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f590c06ace0 0x7f590c06d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5924009b40 tx=0x7f5924009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.437+0000 7f592e19c700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f590c074a00 0x7f590c076e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.437+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== osd.5 v2:172.21.15.187:6824/70482310 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f590c077550 con 0x7f590c074a00 2023-08-10T10:33:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.452+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 --> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f59280c45f0 con 0x7f590c074a00 2023-08-10T10:33:27.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.453+0000 7f591e7fc700 1 -- 172.21.15.88:0/3591482188 <== osd.5 v2:172.21.15.187:6824/70482310 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f59200099b0 con 0x7f590c074a00 2023-08-10T10:33:27.455 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:27.455 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:27.455 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.453+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f590c074a00 msgr2=0x7f590c076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.453+0000 7f592fbff700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.187:6824/70482310,v1:172.21.15.187:6825/70482310] conn(0x7f590c074a00 0x7f590c076e80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f590c06ace0 msgr2=0x7f590c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f590c06ace0 0x7f590c06d1a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5924009b40 tx=0x7f5924009210 comp rx=0 tx=0).stop 2023-08-10T10:33:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 msgr2=0x7f59280b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 --2- 172.21.15.88:0/3591482188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f59280ce3c0 0x7f59280b17f0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f591800d7d0 tx=0x7f591800dae0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592e19c700 1 -- 172.21.15.88:0/3591482188 reap_dead start 2023-08-10T10:33:27.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 shutdown_connections 2023-08-10T10:33:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 >> 172.21.15.88:0/3591482188 conn(0x7f59280cb570 msgr2=0x7f59281e8620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 shutdown_connections 2023-08-10T10:33:27.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.454+0000 7f592fbff700 1 -- 172.21.15.88:0/3591482188 wait complete. 2023-08-10T10:33:27.472 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-10T10:33:27.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.669+0000 7f109fdff700 1 Processor -- start 2023-08-10T10:33:27.671 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.670+0000 7f109fdff700 1 -- start start 2023-08-10T10:33:27.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109fdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1098071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109fdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10980cb410 con 0x7f1098159790 2023-08-10T10:33:27.672 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109fdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f109806af70 con 0x7f10980ca630 2023-08-10T10:33:27.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109fdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10980cab70 con 0x7f10981593b0 2023-08-10T10:33:27.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109d39a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f1098159790 0x7f10980c9f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45912/0 (socket says 172.21.15.88:45912) 2023-08-10T10:33:27.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109d39a700 1 -- 172.21.15.88:0/862951514 learned_addr learned my addr 172.21.15.88:0/862951514 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:27.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2342987743 0 0) 0x7f10980cb410 con 0x7f1098159790 2023-08-10T10:33:27.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109db9b700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1098071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.671+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10840035b0 con 0x7f1098159790 2023-08-10T10:33:27.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 299755052 0 0) 0x7f10840035b0 con 0x7f1098159790 2023-08-10T10:33:27.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 msgr2=0x7f1098071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:27.676 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1098071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 >> v1:172.21.15.187:6789/0 conn(0x7f10980ca630 legacy=0x7f10980ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980cae50 con 0x7f1098159790 2023-08-10T10:33:27.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f1088001670 con 0x7f1098159790 2023-08-10T10:33:27.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 >> v1:172.21.15.88:6789/0 conn(0x7f1098159790 legacy=0x7f10980c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.677 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f1084003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1084004850 0x7f1084004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1084005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980cab70 con 0x7f1084003a30 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108400bb40 con 0x7f1084004850 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108400df10 con 0x7f10981593b0 2023-08-10T10:33:27.678 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109db9b700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f1084003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109d39a700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1084004850 0x7f1084004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.672+0000 7f109e39c700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1084005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 -- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 msgr2=0x7f1084005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:27.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981593b0 0x7f1084005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.679 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 -- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1084004850 msgr2=0x7f1084004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1084004850 0x7f1084004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 -- 172.21.15.88:0/862951514 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10840035b0 con 0x7f1084003a30 2023-08-10T10:33:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109db9b700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f1084003e50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1094009b60 tx=0x7f1084005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e194e5b4e6997d33 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400e6c0 con 0x7f1084003a30 2023-08-10T10:33:27.680 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f109400e820 con 0x7f1084003a30 2023-08-10T10:33:27.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.673+0000 7f109cb99700 1 -- 172.21.15.88:0/862951514 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400eb90 con 0x7f1084003a30 2023-08-10T10:33:27.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 -- 172.21.15.88:0/862951514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 msgr2=0x7f1084003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 --2- 172.21.15.88:0/862951514 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f1084003e50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1094009b60 tx=0x7f1084005880 comp rx=0 tx=0).stop 2023-08-10T10:33:27.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109e39c700 1 -- 172.21.15.88:0/862951514 reap_dead start 2023-08-10T10:33:27.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 -- 172.21.15.88:0/862951514 shutdown_connections 2023-08-10T10:33:27.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 -- 172.21.15.88:0/862951514 >> 172.21.15.88:0/862951514 conn(0x7f10980ced50 msgr2=0x7f10980cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 -- 172.21.15.88:0/862951514 shutdown_connections 2023-08-10T10:33:27.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.674+0000 7f109fdff700 1 -- 172.21.15.88:0/862951514 wait complete. 2023-08-10T10:33:27.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.676+0000 7f109fdff700 1 Processor -- start 2023-08-10T10:33:27.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.676+0000 7f109fdff700 1 -- start start 2023-08-10T10:33:27.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981ee5e0 0x7f1098152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f109813fe50 0x7f10981402d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1098152cf0 con 0x7f1084003a30 2023-08-10T10:33:27.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10980c4ff0 con 0x7f109813fe50 2023-08-10T10:33:27.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109fdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1098140810 con 0x7f10981ee5e0 2023-08-10T10:33:27.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45678/0 (socket says 172.21.15.88:45678) 2023-08-10T10:33:27.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 -- 172.21.15.88:0/2616941848 learned_addr learned my addr 172.21.15.88:0/2616941848 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:27.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 -- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981ee5e0 msgr2=0x7f1098152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981ee5e0 0x7f1098152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 -- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f109813fe50 msgr2=0x7f10981402d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f109813fe50 0x7f10981402d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.677+0000 7f109db9b700 1 -- 172.21.15.88:0/2616941848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098152a50 con 0x7f1084003a30 2023-08-10T10:33:27.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f109db9b700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f108400bb10 tx=0x7f10940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.687 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f109400e6c0 con 0x7f1084003a30 2023-08-10T10:33:27.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10940038b0 con 0x7f1084003a30 2023-08-10T10:33:27.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1094003c60 con 0x7f1084003a30 2023-08-10T10:33:27.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f109fdff700 1 -- 172.21.15.88:0/2616941848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1098152cf0 con 0x7f1084003a30 2023-08-10T10:33:27.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.678+0000 7f109fdff700 1 -- 172.21.15.88:0/2616941848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10980c4510 con 0x7f1084003a30 2023-08-10T10:33:27.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.679+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10740052f0 con 0x7f1084003a30 2023-08-10T10:33:27.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.680+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f1094013470 con 0x7f1084003a30 2023-08-10T10:33:27.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.681+0000 7f108e7fc700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 0x7f107c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:27.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.681+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f109408b0a0 con 0x7f1084003a30 2023-08-10T10:33:27.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.682+0000 7f109d39a700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 0x7f107c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:27.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.682+0000 7f109d39a700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 0x7f107c06d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1088001b40 tx=0x7f1088001110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:27.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.686+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f1094055f30 con 0x7f1084003a30 2023-08-10T10:33:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.879+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f1074000bc0 con 0x7f107c06ace0 2023-08-10T10:33:27.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.880+0000 7f108e7fc700 1 -- 172.21.15.88:0/2616941848 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1074000bc0 con 0x7f107c06ace0 2023-08-10T10:33:27.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 msgr2=0x7f107c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 0x7f107c06d1a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1088001b40 tx=0x7f1088001110 comp rx=0 tx=0).stop 2023-08-10T10:33:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 msgr2=0x7f10980c6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f108400bb10 tx=0x7f10940047c0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 shutdown_connections 2023-08-10T10:33:27.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f109813fe50 0x7f10981402d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1084003a30 0x7f10980c6280 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f107c06ace0 0x7f107c06d1a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 --2- 172.21.15.88:0/2616941848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10981ee5e0 0x7f1098152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 >> 172.21.15.88:0/2616941848 conn(0x7f10980ced50 msgr2=0x7f1098158550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:27.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 shutdown_connections 2023-08-10T10:33:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:27.882+0000 7f107bfff700 1 -- 172.21.15.88:0/2616941848 wait complete. 2023-08-10T10:33:27.886 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 5 to deep-scrub 2023-08-10T10:33:27.901 INFO:tasks.ceph:Scrubbing osd.6 2023-08-10T10:33:27.901 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:28.101 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.100+0000 7fdd573ff700 1 Processor -- start 2023-08-10T10:33:28.102 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.100+0000 7fdd573ff700 1 -- start start 2023-08-10T10:33:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.101+0000 7fdd573ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 0x7fdd50165b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.101+0000 7fdd573ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5006ad80 con 0x7fdd5006a880 2023-08-10T10:33:28.103 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.101+0000 7fdd573ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5006b060 con 0x7fdd500ccf90 2023-08-10T10:33:28.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.101+0000 7fdd573ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5015b600 con 0x7fdd500cb0e0 2023-08-10T10:33:28.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5499a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fdd5006a880 0x7fdd500ca9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45920/0 (socket says 172.21.15.88:45920) 2023-08-10T10:33:28.104 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5499a700 1 -- 172.21.15.88:0/392037354 learned_addr learned my addr 172.21.15.88:0/392037354 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:28.105 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5599c700 1 --2- 172.21.15.88:0/392037354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 0x7fdd50165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960812560 0 0) 0x7fdd5006ad80 con 0x7fdd5006a880 2023-08-10T10:33:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd3c0035b0 con 0x7fdd5006a880 2023-08-10T10:33:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936444534 0 0) 0x7fdd5006b060 con 0x7fdd500ccf90 2023-08-10T10:33:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd5006ad80 con 0x7fdd500ccf90 2023-08-10T10:33:28.106 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5599c700 1 -- 172.21.15.88:0/392037354 >> v1:172.21.15.187:6789/0 conn(0x7fdd500ccf90 legacy=0x7fdd5006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5599c700 1 -- 172.21.15.88:0/392037354 >> v1:172.21.15.88:6789/0 conn(0x7fdd5006a880 legacy=0x7fdd500ca9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3889821450 0 0) 0x7fdd3c0035b0 con 0x7fdd5006a880 2023-08-10T10:33:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.102+0000 7fdd5599c700 1 -- 172.21.15.88:0/392037354 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd5006b340 con 0x7fdd500cb0e0 2023-08-10T10:33:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.103+0000 7fdd5599c700 1 --2- 172.21.15.88:0/392037354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 0x7fdd50165b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009dc0 tx=0x7fdd4800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a06ada930cdb4e9 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.107 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.103+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800e070 con 0x7fdd500cb0e0 2023-08-10T10:33:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.103+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48003a20 con 0x7fdd500cb0e0 2023-08-10T10:33:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.103+0000 7fdd47fff700 1 -- 172.21.15.88:0/392037354 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40001670 con 0x7fdd500cb0e0 2023-08-10T10:33:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 -- 172.21.15.88:0/392037354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 msgr2=0x7fdd50165b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 --2- 172.21.15.88:0/392037354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 0x7fdd50165b60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd48009dc0 tx=0x7fdd4800b330 comp rx=0 tx=0).stop 2023-08-10T10:33:28.108 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 -- 172.21.15.88:0/392037354 shutdown_connections 2023-08-10T10:33:28.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 --2- 172.21.15.88:0/392037354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd500cb0e0 0x7fdd50165b60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 -- 172.21.15.88:0/392037354 >> 172.21.15.88:0/392037354 conn(0x7fdd500cb570 msgr2=0x7fdd500cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 -- 172.21.15.88:0/392037354 shutdown_connections 2023-08-10T10:33:28.109 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.104+0000 7fdd573ff700 1 -- 172.21.15.88:0/392037354 wait complete. 2023-08-10T10:33:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.105+0000 7fdd573ff700 1 Processor -- start 2023-08-10T10:33:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 -- start start 2023-08-10T10:33:28.111 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5006a880 0x7fdd500c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd500cb0e0 0x7fdd501e1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 0x7fdd50146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50147460 con 0x7fdd500ccf90 2023-08-10T10:33:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c8280 con 0x7fdd500cb0e0 2023-08-10T10:33:28.112 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.106+0000 7fdd573ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c7fa0 con 0x7fdd5006a880 2023-08-10T10:33:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 0x7fdd50146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 0x7fdd50146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45680/0 (socket says 172.21.15.88:45680) 2023-08-10T10:33:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 -- 172.21.15.88:0/3062425456 learned_addr learned my addr 172.21.15.88:0/3062425456 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5499a700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd500cb0e0 0x7fdd501e1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.113 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5519b700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5006a880 0x7fdd500c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 -- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5006a880 msgr2=0x7fdd500c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5006a880 0x7fdd500c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 -- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd500cb0e0 msgr2=0x7fdd501e1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd500cb0e0 0x7fdd501e1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.114 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48009a70 con 0x7fdd500ccf90 2023-08-10T10:33:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.107+0000 7fdd5599c700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 0x7fdd50146f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004000 tx=0x7fdd48004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.108+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd480044c0 con 0x7fdd500ccf90 2023-08-10T10:33:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.108+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd48004620 con 0x7fdd500ccf90 2023-08-10T10:33:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.108+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4801d470 con 0x7fdd500ccf90 2023-08-10T10:33:28.115 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.108+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd50156be0 con 0x7fdd500ccf90 2023-08-10T10:33:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.108+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd501571a0 con 0x7fdd500ccf90 2023-08-10T10:33:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.109+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdd5006b900 con 0x7fdd500ccf90 2023-08-10T10:33:28.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.110+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fdd4801d5d0 con 0x7fdd500ccf90 2023-08-10T10:33:28.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd45ffb700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdd3406ace0 0x7fdd3406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fdd4808b370 con 0x7fdd500ccf90 2023-08-10T10:33:28.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd5519b700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdd3406ace0 0x7fdd3406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd45ffb700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fdd34074a00 0x7fdd34076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdd34077550 con 0x7fdd34074a00 2023-08-10T10:33:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.111+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4808da30 con 0x7fdd500ccf90 2023-08-10T10:33:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.112+0000 7fdd5519b700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdd3406ace0 0x7fdd3406d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c001790 tx=0x7fdd4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.118 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.112+0000 7fdd5499a700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fdd34074a00 0x7fdd34076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.112+0000 7fdd5499a700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fdd34074a00 0x7fdd34076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.113+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== osd.6 v2:172.21.15.187:6816/2271687941 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fdd34077550 con 0x7fdd34074a00 2023-08-10T10:33:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.128+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 --> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdd5006b620 con 0x7fdd34074a00 2023-08-10T10:33:28.129 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.128+0000 7fdd45ffb700 1 -- 172.21.15.88:0/3062425456 <== osd.6 v2:172.21.15.187:6816/2271687941 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdd40004b70 con 0x7fdd34074a00 2023-08-10T10:33:28.130 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:28.130 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:28.130 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:28.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.128+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fdd34074a00 msgr2=0x7fdd34076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.187:6816/2271687941,v1:172.21.15.187:6817/2271687941] conn(0x7fdd34074a00 0x7fdd34076e80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.131 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdd3406ace0 msgr2=0x7fdd3406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fdd3406ace0 0x7fdd3406d1a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c001790 tx=0x7fdd4c009040 comp rx=0 tx=0).stop 2023-08-10T10:33:28.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 msgr2=0x7fdd50146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 --2- 172.21.15.88:0/3062425456 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdd500ccf90 0x7fdd50146f20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004000 tx=0x7fdd48004ad0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd5599c700 1 -- 172.21.15.88:0/3062425456 reap_dead start 2023-08-10T10:33:28.132 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 shutdown_connections 2023-08-10T10:33:28.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 >> 172.21.15.88:0/3062425456 conn(0x7fdd500cb570 msgr2=0x7fdd50158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 shutdown_connections 2023-08-10T10:33:28.133 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.129+0000 7fdd573ff700 1 -- 172.21.15.88:0/3062425456 wait complete. 2023-08-10T10:33:28.147 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-10T10:33:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.343+0000 7f51c1dff700 1 Processor -- start 2023-08-10T10:33:28.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.343+0000 7f51c1dff700 1 -- start start 2023-08-10T10:33:28.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.344+0000 7f51c1dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51bc0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51c1dff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f51bc0cd6c0 0x7f51bc0cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51c1dff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0cf830 con 0x7f51bc15af00 2023-08-10T10:33:28.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51c1dff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0ce090 con 0x7f51bc0cd6c0 2023-08-10T10:33:28.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51c1dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0cc470 con 0x7f51bc0b3f40 2023-08-10T10:33:28.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51bb7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f51bc15af00 0x7f51bc15f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:45924/0 (socket says 172.21.15.88:45924) 2023-08-10T10:33:28.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51bb7fe700 1 -- 172.21.15.88:0/1192031787 learned_addr learned my addr 172.21.15.88:0/1192031787 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:33:28.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51baffd700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51bc0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> v2:172.21.15.187:3300/0 conn(0x7f51bc0cd6c0 0x7f51bc0cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462741253 0 0) 0x7f51bc0cf830 con 0x7f51bc15af00 2023-08-10T10:33:28.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a40035b0 con 0x7f51bc15af00 2023-08-10T10:33:28.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645207682 0 0) 0x7f51a40035b0 con 0x7f51bc15af00 2023-08-10T10:33:28.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 msgr2=0x7f51bc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51bc0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 >> v2:172.21.15.187:3300/0 conn(0x7f51bc0cd6c0 msgr2=0x7f51bc0cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 --2- 172.21.15.88:0/1192031787 >> v2:172.21.15.187:3300/0 conn(0x7f51bc0cd6c0 0x7f51bc0cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.345+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0cef00 con 0x7f51bc15af00 2023-08-10T10:33:28.351 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f51ac001670 con 0x7f51bc15af00 2023-08-10T10:33:28.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> v2:172.21.15.187:3300/0 conn(0x7f51bc0cd6c0 0x7f51bc0cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:33:28.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 >> v1:172.21.15.88:6789/0 conn(0x7f51bc15af00 legacy=0x7f51bc15f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4003a00 0x7f51a4003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51a4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.352 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51a4004d90 0x7f51a4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0ce090 con 0x7f51a4004d90 2023-08-10T10:33:28.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0cc470 con 0x7f51a4003a00 2023-08-10T10:33:28.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a400ba10 con 0x7f51bc0b3f40 2023-08-10T10:33:28.353 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51a4004d90 0x7f51a4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bb7fe700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4003a00 0x7f51a4003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51baffd700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51a4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 -- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 msgr2=0x7f51a4004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b3f40 0x7f51a4004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 -- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4003a00 msgr2=0x7f51a4003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4003a00 0x7f51a4003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.355 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.346+0000 7f51bbfff700 1 -- 172.21.15.88:0/1192031787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a40035b0 con 0x7f51a4004d90 2023-08-10T10:33:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.347+0000 7f51bbfff700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51a4004d90 0x7f51a4005210 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51b400e350 tx=0x7f51a4005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181ffc7a5772054f server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.348+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400edf0 con 0x7f51a4004d90 2023-08-10T10:33:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.348+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b400f040 con 0x7f51a4004d90 2023-08-10T10:33:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.348+0000 7f51ba7fc700 1 -- 172.21.15.88:0/1192031787 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b40146a0 con 0x7f51a4004d90 2023-08-10T10:33:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 -- 172.21.15.88:0/1192031787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51a4004d90 msgr2=0x7f51a4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 --2- 172.21.15.88:0/1192031787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51a4004d90 0x7f51a4005210 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f51b400e350 tx=0x7f51a4005880 comp rx=0 tx=0).stop 2023-08-10T10:33:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51bbfff700 1 -- 172.21.15.88:0/1192031787 reap_dead start 2023-08-10T10:33:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 -- 172.21.15.88:0/1192031787 shutdown_connections 2023-08-10T10:33:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 -- 172.21.15.88:0/1192031787 >> 172.21.15.88:0/1192031787 conn(0x7f51bc06f200 msgr2=0x7f51bc06f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 -- 172.21.15.88:0/1192031787 shutdown_connections 2023-08-10T10:33:28.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.349+0000 7f51c1dff700 1 -- 172.21.15.88:0/1192031787 wait complete. 2023-08-10T10:33:28.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.351+0000 7f51c1dff700 1 Processor -- start 2023-08-10T10:33:28.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.351+0000 7f51c1dff700 1 -- start start 2023-08-10T10:33:28.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4004d90 0x7f51bc14fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b5330 0x7f51bc0b57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.361 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0b5cf0 con 0x7f51bc15b2e0 2023-08-10T10:33:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15c050 con 0x7f51a4004d90 2023-08-10T10:33:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51c1dff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15c330 con 0x7f51bc0b5330 2023-08-10T10:33:28.362 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51bbfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45704/0 (socket says 172.21.15.88:45704) 2023-08-10T10:33:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.352+0000 7f51bbfff700 1 -- 172.21.15.88:0/866821356 learned_addr learned my addr 172.21.15.88:0/866821356 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bb7fe700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4004d90 0x7f51bc14fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51baffd700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b5330 0x7f51bc0b57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.363 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 -- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b5330 msgr2=0x7f51bc0b57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b5330 0x7f51bc0b57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 -- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4004d90 msgr2=0x7f51bc14fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4004d90 0x7f51bc14fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 -- 172.21.15.88:0/866821356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc15c610 con 0x7f51bc15b2e0 2023-08-10T10:33:28.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51bbfff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51b4017040 tx=0x7f51b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4009490 con 0x7f51bc15b2e0 2023-08-10T10:33:28.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b4004490 con 0x7f51bc15b2e0 2023-08-10T10:33:28.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b4007000 con 0x7f51bc15b2e0 2023-08-10T10:33:28.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.353+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc15c8f0 con 0x7f51bc15b2e0 2023-08-10T10:33:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.354+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc1501e0 con 0x7f51bc15b2e0 2023-08-10T10:33:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.355+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc15ce10 con 0x7f51bc15b2e0 2023-08-10T10:33:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.355+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f51b4024070 con 0x7f51bc15b2e0 2023-08-10T10:33:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.356+0000 7f51a3fff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.356+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f51b408aff0 con 0x7f51bc15b2e0 2023-08-10T10:33:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.356+0000 7f51bb7fe700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.357+0000 7f51bb7fe700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51ac000c00 tx=0x7f51ac007980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.361+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f51bc15ce10 con 0x7f51bc15b2e0 2023-08-10T10:33:28.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.555+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f51bc0cf4c0 con 0x7f51a806ace0 2023-08-10T10:33:28.557 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.555+0000 7f51a3fff700 1 -- 172.21.15.88:0/866821356 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f51ac007de0 con 0x7f51a806ace0 2023-08-10T10:33:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 msgr2=0x7f51a806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.559 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f51ac000c00 tx=0x7f51ac007980 comp rx=0 tx=0).stop 2023-08-10T10:33:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 msgr2=0x7f51bc15b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f51b4017040 tx=0x7f51b4009750 comp rx=0 tx=0).stop 2023-08-10T10:33:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 shutdown_connections 2023-08-10T10:33:28.560 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc15b2e0 0x7f51bc15b770 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f51a4004d90 0x7f51bc14fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f51a806ace0 0x7f51a806d1a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 --2- 172.21.15.88:0/866821356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f51bc0b5330 0x7f51bc0b57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.561 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 >> 172.21.15.88:0/866821356 conn(0x7f51bc06f200 msgr2=0x7f51bc06f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 shutdown_connections 2023-08-10T10:33:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.558+0000 7f51c1dff700 1 -- 172.21.15.88:0/866821356 wait complete. 2023-08-10T10:33:28.562 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 6 to deep-scrub 2023-08-10T10:33:28.578 INFO:tasks.ceph:Scrubbing osd.7 2023-08-10T10:33:28.578 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-10T10:33:28.777 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.776+0000 7fce7c5ff700 1 Processor -- start 2023-08-10T10:33:28.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.776+0000 7fce7c5ff700 1 -- start start 2023-08-10T10:33:28.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce740d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce740d1060 0x7fce740b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fce740b4e90 0x7fce740b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce7415d5c0 con 0x7fce740d1060 2023-08-10T10:33:28.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce740b5300 con 0x7fce740b4e90 2023-08-10T10:33:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.777+0000 7fce7c5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce740d1840 con 0x7fce7415d1e0 2023-08-10T10:33:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce740d1060 0x7fce740b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fce740d1060 0x7fce740b4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45708/0 (socket says 172.21.15.88:45708) 2023-08-10T10:33:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 -- 172.21.15.88:0/350561517 learned_addr learned my addr 172.21.15.88:0/350561517 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:28.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce7ab9c700 1 --2- 172.21.15.88:0/350561517 >> v2:172.21.15.187:3300/0 conn(0x7fce740b4e90 0x7fce740b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce7a39b700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce740d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 -- 172.21.15.88:0/350561517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 msgr2=0x7fce740d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce740d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 -- 172.21.15.88:0/350561517 >> v2:172.21.15.187:3300/0 conn(0x7fce740b4e90 msgr2=0x7fce740b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:28.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 --2- 172.21.15.88:0/350561517 >> v2:172.21.15.187:3300/0 conn(0x7fce740b4e90 0x7fce740b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 -- 172.21.15.88:0/350561517 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce740d1b20 con 0x7fce740d1060 2023-08-10T10:33:28.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce7a39b700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce740d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:28.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79b9a700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740d1060 0x7fce740b4950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce740b5a70 tx=0x7fce64009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=948fa5e9f36f1792 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.778+0000 7fce79399700 1 -- 172.21.15.88:0/350561517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400b860 con 0x7fce740d1060 2023-08-10T10:33:28.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce79399700 1 -- 172.21.15.88:0/350561517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6400b9c0 con 0x7fce740d1060 2023-08-10T10:33:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce79399700 1 -- 172.21.15.88:0/350561517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6400bd50 con 0x7fce740d1060 2023-08-10T10:33:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 -- 172.21.15.88:0/350561517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740d1060 msgr2=0x7fce740b4950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740d1060 0x7fce740b4950 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fce740b5a70 tx=0x7fce64009c00 comp rx=0 tx=0).stop 2023-08-10T10:33:28.786 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 -- 172.21.15.88:0/350561517 shutdown_connections 2023-08-10T10:33:28.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/350561517 >> v2:172.21.15.187:3300/0 conn(0x7fce740b4e90 0x7fce740b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce740d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/350561517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740d1060 0x7fce740b4950 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 -- 172.21.15.88:0/350561517 >> 172.21.15.88:0/350561517 conn(0x7fce740cf950 msgr2=0x7fce740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.787 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 -- 172.21.15.88:0/350561517 shutdown_connections 2023-08-10T10:33:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.779+0000 7fce7c5ff700 1 -- 172.21.15.88:0/350561517 wait complete. 2023-08-10T10:33:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.781+0000 7fce7c5ff700 1 Processor -- start 2023-08-10T10:33:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.781+0000 7fce7c5ff700 1 -- start start 2023-08-10T10:33:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 0x7fce741561c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.788 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce740d1060 0x7fce741f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce7415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce740cb3b0 con 0x7fce740b4e90 2023-08-10T10:33:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce741f6980 con 0x7fce740d1060 2023-08-10T10:33:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7c5ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce741f6c60 con 0x7fce7415d1e0 2023-08-10T10:33:28.789 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7a39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 0x7fce741561c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7a39b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 0x7fce741561c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45710/0 (socket says 172.21.15.88:45710) 2023-08-10T10:33:28.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7a39b700 1 -- 172.21.15.88:0/957587433 learned_addr learned my addr 172.21.15.88:0/957587433 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:28.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce79b9a700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce740d1060 0x7fce741f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.782+0000 7fce7ab9c700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce7415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.790 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 -- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 msgr2=0x7fce7415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fce7415d1e0 0x7fce7415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 -- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce740d1060 msgr2=0x7fce741f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fce740d1060 0x7fce741f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce64009550 con 0x7fce740b4e90 2023-08-10T10:33:28.791 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7a39b700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 0x7fce741561c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c750 tx=0x7fce7000cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011800 con 0x7fce740b4e90 2023-08-10T10:33:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce70011960 con 0x7fce740b4e90 2023-08-10T10:33:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce740cb670 con 0x7fce740b4e90 2023-08-10T10:33:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce70011cd0 con 0x7fce740b4e90 2023-08-10T10:33:28.792 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.783+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce74156700 con 0x7fce740b4e90 2023-08-10T10:33:28.793 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.784+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fce74159bf0 con 0x7fce740b4e90 2023-08-10T10:33:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.785+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fce70021350 con 0x7fce740b4e90 2023-08-10T10:33:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce6affd700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fce5806ace0 0x7fce5806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fce70089710 con 0x7fce740b4e90 2023-08-10T10:33:28.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce79b9a700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fce5806ace0 0x7fce5806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce6affd700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7fce58074a00 0x7fce58076e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:28.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fce58077550 con 0x7fce58074a00 2023-08-10T10:33:28.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.786+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce7008bcf0 con 0x7fce740b4e90 2023-08-10T10:33:28.795 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.787+0000 7fce79b9a700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fce5806ace0 0x7fce5806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce64000c00 tx=0x7fce64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.787+0000 7fce7ab9c700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7fce58074a00 0x7fce58076e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:28.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.788+0000 7fce7ab9c700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7fce58074a00 0x7fce58076e80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:28.796 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.789+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== osd.7 v2:172.21.15.187:6808/4116934694 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fce58077550 con 0x7fce58074a00 2023-08-10T10:33:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.804+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 --> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fce740cb230 con 0x7fce58074a00 2023-08-10T10:33:28.805 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.804+0000 7fce6affd700 1 -- 172.21.15.88:0/957587433 <== osd.7 v2:172.21.15.187:6808/4116934694 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fce6c009ad0 con 0x7fce58074a00 2023-08-10T10:33:28.806 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2023-08-10T10:33:28.806 INFO:teuthology.orchestra.run.smithi088.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-10T10:33:28.806 INFO:teuthology.orchestra.run.smithi088.stdout:} 2023-08-10T10:33:28.807 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7fce58074a00 msgr2=0x7fce58076e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.187:6808/4116934694,v1:172.21.15.187:6809/4116934694] conn(0x7fce58074a00 0x7fce58076e80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fce5806ace0 msgr2=0x7fce5806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fce5806ace0 0x7fce5806d1a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fce64000c00 tx=0x7fce64008030 comp rx=0 tx=0).stop 2023-08-10T10:33:28.808 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 msgr2=0x7fce741561c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 --2- 172.21.15.88:0/957587433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fce740b4e90 0x7fce741561c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fce7000c750 tx=0x7fce7000cb10 comp rx=0 tx=0).stop 2023-08-10T10:33:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7ab9c700 1 -- 172.21.15.88:0/957587433 reap_dead start 2023-08-10T10:33:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 shutdown_connections 2023-08-10T10:33:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 >> 172.21.15.88:0/957587433 conn(0x7fce740cf950 msgr2=0x7fce740cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:28.809 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 shutdown_connections 2023-08-10T10:33:28.810 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:28.805+0000 7fce7c5ff700 1 -- 172.21.15.88:0/957587433 wait complete. 2023-08-10T10:33:28.823 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-10T10:33:29.019 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.018+0000 7f38289ff700 1 Processor -- start 2023-08-10T10:33:29.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.018+0000 7f38289ff700 1 -- start start 2023-08-10T10:33:29.020 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f38289ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f382415ad10 0x7f382406b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f38289ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382406b770 0x7f38240b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f38289ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38240c9890 con 0x7f38240b23f0 2023-08-10T10:33:29.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f38289ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38240b2800 con 0x7f382406b770 2023-08-10T10:33:29.021 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f38289ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382415f820 con 0x7f382415ad10 2023-08-10T10:33:29.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.019+0000 7f3821d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382406b770 0x7f38240b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f382406b770 0x7f38240b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45716/0 (socket says 172.21.15.88:45716) 2023-08-10T10:33:29.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 -- 172.21.15.88:0/2808531426 learned_addr learned my addr 172.21.15.88:0/2808531426 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:29.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f382259c700 1 --2- 172.21.15.88:0/2808531426 >> v2:172.21.15.187:3300/0 conn(0x7f382415ad10 0x7f382406b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 -- 172.21.15.88:0/2808531426 >> v2:172.21.15.187:3300/0 conn(0x7f382415ad10 msgr2=0x7f382406b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:29.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 --2- 172.21.15.88:0/2808531426 >> v2:172.21.15.187:3300/0 conn(0x7f382415ad10 0x7f382406b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 -- 172.21.15.88:0/2808531426 >> v1:172.21.15.187:6789/0 conn(0x7f38240b23f0 legacy=0x7f3824070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:29.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 -- 172.21.15.88:0/2808531426 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382415f540 con 0x7f382406b770 2023-08-10T10:33:29.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f3821d9b700 1 --2- 172.21.15.88:0/2808531426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f38240b1eb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f38240cea90 tx=0x7f3818009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7464b92d3018f36 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.020+0000 7f382159a700 1 -- 172.21.15.88:0/2808531426 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818004230 con 0x7f382406b770 2023-08-10T10:33:29.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f382159a700 1 -- 172.21.15.88:0/2808531426 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3818004390 con 0x7f382406b770 2023-08-10T10:33:29.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f382159a700 1 -- 172.21.15.88:0/2808531426 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180036a0 con 0x7f382406b770 2023-08-10T10:33:29.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 -- 172.21.15.88:0/2808531426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 msgr2=0x7f38240b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 --2- 172.21.15.88:0/2808531426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f38240b1eb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f38240cea90 tx=0x7f3818009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 -- 172.21.15.88:0/2808531426 shutdown_connections 2023-08-10T10:33:29.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 --2- 172.21.15.88:0/2808531426 >> v2:172.21.15.187:3300/0 conn(0x7f382415ad10 0x7f382406b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 --2- 172.21.15.88:0/2808531426 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f38240b1eb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 -- 172.21.15.88:0/2808531426 >> 172.21.15.88:0/2808531426 conn(0x7f38240ced50 msgr2=0x7f38240cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:29.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 -- 172.21.15.88:0/2808531426 shutdown_connections 2023-08-10T10:33:29.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.021+0000 7f38289ff700 1 -- 172.21.15.88:0/2808531426 wait complete. 2023-08-10T10:33:29.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.023+0000 7f38289ff700 1 Processor -- start 2023-08-10T10:33:29.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.023+0000 7f38289ff700 1 -- start start 2023-08-10T10:33:29.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38240b23f0 0x7f38240c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 0x7f382415e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c6ff0 con 0x7f382406b770 2023-08-10T10:33:29.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38240ae470 con 0x7f38240b23f0 2023-08-10T10:33:29.030 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f38289ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38240c6a20 con 0x7f382415ad10 2023-08-10T10:33:29.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45732/0 (socket says 172.21.15.88:45732) 2023-08-10T10:33:29.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 -- 172.21.15.88:0/3905578583 learned_addr learned my addr 172.21.15.88:0/3905578583 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:29.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f3821d9b700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38240b23f0 0x7f38240c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.031 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f3822d9d700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 0x7f382415e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 -- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 msgr2=0x7f382415e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 0x7f382415e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 -- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38240b23f0 msgr2=0x7f38240c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.032 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38240b23f0 0x7f38240c7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f382259c700 1 -- 172.21.15.88:0/3905578583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3818009550 con 0x7f382406b770 2023-08-10T10:33:29.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.024+0000 7f3822d9d700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 0x7f382415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:29.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f382259c700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f381400e840 tx=0x7f381400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814013610 con 0x7f382406b770 2023-08-10T10:33:29.033 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3814013770 con 0x7f382406b770 2023-08-10T10:33:29.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38240c7240 con 0x7f382406b770 2023-08-10T10:33:29.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3814013b20 con 0x7f382406b770 2023-08-10T10:33:29.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.025+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38240c7800 con 0x7f382406b770 2023-08-10T10:33:29.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.026+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38240c79f0 con 0x7f382406b770 2023-08-10T10:33:29.034 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.027+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3814013c80 con 0x7f382406b770 2023-08-10T10:33:29.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.028+0000 7f3812ffd700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 0x7f380406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.028+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3814089520 con 0x7f382406b770 2023-08-10T10:33:29.035 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.028+0000 7f3821d9b700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 0x7f380406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.029+0000 7f3821d9b700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 0x7f380406d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3818009130 tx=0x7f3818008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.036 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.032+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3814054200 con 0x7f382406b770 2023-08-10T10:33:29.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.227+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f382406aa30 con 0x7f380406ace0 2023-08-10T10:33:29.229 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.228+0000 7f3812ffd700 1 -- 172.21.15.88:0/3905578583 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3818020070 con 0x7f380406ace0 2023-08-10T10:33:29.231 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 msgr2=0x7f380406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 0x7f380406d1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3818009130 tx=0x7f3818008030 comp rx=0 tx=0).stop 2023-08-10T10:33:29.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 msgr2=0x7f3824157a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f381400e840 tx=0x7f381400ec00 comp rx=0 tx=0).stop 2023-08-10T10:33:29.232 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 shutdown_connections 2023-08-10T10:33:29.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f380406ace0 0x7f380406d1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f382415ad10 0x7f382415e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f382406b770 0x7f3824157a20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.233 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 --2- 172.21.15.88:0/3905578583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38240b23f0 0x7f38240c7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 >> 172.21.15.88:0/3905578583 conn(0x7f38240ced50 msgr2=0x7f38240ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:29.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 shutdown_connections 2023-08-10T10:33:29.234 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.230+0000 7f38289ff700 1 -- 172.21.15.88:0/3905578583 wait complete. 2023-08-10T10:33:29.234 INFO:teuthology.orchestra.run.smithi088.stderr:instructed osd(s) 7 to deep-scrub 2023-08-10T10:33:29.249 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:33:29.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.447+0000 7f7fabdff700 1 Processor -- start 2023-08-10T10:33:29.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.447+0000 7f7fabdff700 1 -- start start 2023-08-10T10:33:29.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7fabdff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 0x7f7fa4070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7fabdff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fa4071b80 0x7f7fa4070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7fabdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa406a170 con 0x7f7fa4159d00 2023-08-10T10:33:29.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7fabdff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa415dfe0 con 0x7f7fa4071b80 2023-08-10T10:33:29.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7fabdff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa40cdeb0 con 0x7f7fa40716d0 2023-08-10T10:33:29.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7faa39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fa4071b80 0x7f7fa4070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7faa39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7fa4071b80 0x7f7fa4070ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45742/0 (socket says 172.21.15.88:45742) 2023-08-10T10:33:29.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.448+0000 7f7faa39c700 1 -- 172.21.15.88:0/2996881653 learned_addr learned my addr 172.21.15.88:0/2996881653 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:29.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7fa939a700 1 --2- 172.21.15.88:0/2996881653 >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 0x7f7fa4070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7faa39c700 1 -- 172.21.15.88:0/2996881653 >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 msgr2=0x7f7fa4070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:29.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7faa39c700 1 --2- 172.21.15.88:0/2996881653 >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 0x7f7fa4070990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7faa39c700 1 -- 172.21.15.88:0/2996881653 >> v1:172.21.15.187:6789/0 conn(0x7f7fa4159d00 legacy=0x7f7fa415d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:29.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7faa39c700 1 -- 172.21.15.88:0/2996881653 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa40ce190 con 0x7f7fa4071b80 2023-08-10T10:33:29.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7fa939a700 1 --2- 172.21.15.88:0/2996881653 >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 0x7f7fa4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:29.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7faa39c700 1 --2- 172.21.15.88:0/2996881653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa4070ed0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ae660 tx=0x7f7f9c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fe29eb60ef6e03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7fa8b99700 1 -- 172.21.15.88:0/2996881653 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00e070 con 0x7f7fa4071b80 2023-08-10T10:33:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7fa8b99700 1 -- 172.21.15.88:0/2996881653 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9c003a20 con 0x7f7fa4071b80 2023-08-10T10:33:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.449+0000 7f7fa8b99700 1 -- 172.21.15.88:0/2996881653 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c003dd0 con 0x7f7fa4071b80 2023-08-10T10:33:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 -- 172.21.15.88:0/2996881653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 msgr2=0x7f7fa4070ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 --2- 172.21.15.88:0/2996881653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa4070ed0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7fa40ae660 tx=0x7f7f9c00b330 comp rx=0 tx=0).stop 2023-08-10T10:33:29.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 -- 172.21.15.88:0/2996881653 shutdown_connections 2023-08-10T10:33:29.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 --2- 172.21.15.88:0/2996881653 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa4070ed0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 --2- 172.21.15.88:0/2996881653 >> v2:172.21.15.187:3300/0 conn(0x7f7fa40716d0 0x7f7fa4070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 -- 172.21.15.88:0/2996881653 >> 172.21.15.88:0/2996881653 conn(0x7f7fa40ced50 msgr2=0x7f7fa40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 -- 172.21.15.88:0/2996881653 shutdown_connections 2023-08-10T10:33:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.450+0000 7f7fabdff700 1 -- 172.21.15.88:0/2996881653 wait complete. 2023-08-10T10:33:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.452+0000 7f7fabdff700 1 Processor -- start 2023-08-10T10:33:29.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.452+0000 7f7fabdff700 1 -- start start 2023-08-10T10:33:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fa40716d0 0x7f7fa414e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fa4159d00 0x7f7fa415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa414e5d0 con 0x7f7fa4071b80 2023-08-10T10:33:29.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa415a2f0 con 0x7f7fa4159d00 2023-08-10T10:33:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fabdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa40c6180 con 0x7f7fa40716d0 2023-08-10T10:33:29.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:45756/0 (socket says 172.21.15.88:45756) 2023-08-10T10:33:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 -- 172.21.15.88:0/3042929045 learned_addr learned my addr 172.21.15.88:0/3042929045 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:29.463 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa9b9b700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fa40716d0 0x7f7fa414e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7faa39c700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fa4159d00 0x7f7fa415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 -- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fa40716d0 msgr2=0x7f7fa414e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fa40716d0 0x7f7fa414e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 -- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fa4159d00 msgr2=0x7f7fa415bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fa4159d00 0x7f7fa415bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.453+0000 7f7fa939a700 1 -- 172.21.15.88:0/3042929045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f9c009b30 con 0x7f7fa4071b80 2023-08-10T10:33:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7fa939a700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c750 tx=0x7f7f9400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94011800 con 0x7f7fa4071b80 2023-08-10T10:33:29.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f94011960 con 0x7f7fa4071b80 2023-08-10T10:33:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa40c6420 con 0x7f7fa4071b80 2023-08-10T10:33:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94011cd0 con 0x7f7fa4071b80 2023-08-10T10:33:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.454+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa40c69e0 con 0x7f7fa4071b80 2023-08-10T10:33:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.455+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa404ecc0 con 0x7f7fa4071b80 2023-08-10T10:33:29.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.456+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7f94021350 con 0x7f7fa4071b80 2023-08-10T10:33:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.457+0000 7f7f9a7fc700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.457+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f7f940895c0 con 0x7f7fa4071b80 2023-08-10T10:33:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.457+0000 7f7fa9b9b700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:29.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.458+0000 7f7fa9b9b700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 0x7f7f8806d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009960 tx=0x7f7fa00090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:29.468 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.461+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7f94057dc0 con 0x7f7fa4071b80 2023-08-10T10:33:29.655 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.654+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7fa40ce750 con 0x7f7f8806ace0 2023-08-10T10:33:29.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.665+0000 7f7f9a7fc700 1 -- 172.21.15.88:0/3042929045 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391275 (secure 0 0 0) 0x7f7fa0009e30 con 0x7f7f8806ace0 2023-08-10T10:33:29.670 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:29.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.669+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 msgr2=0x7f7f8806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.669+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 0x7f7f8806d1a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009960 tx=0x7f7fa00090e0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.673 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.669+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 msgr2=0x7f7fa40c5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.669+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7f9400c750 tx=0x7f7f9400ca60 comp rx=0 tx=0).stop 2023-08-10T10:33:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 shutdown_connections 2023-08-10T10:33:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fa4159d00 0x7f7fa415bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.674 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7f8806ace0 0x7f7f8806d1a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fa40716d0 0x7f7fa414e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 --2- 172.21.15.88:0/3042929045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7fa4071b80 0x7f7fa40c5c40 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 >> 172.21.15.88:0/3042929045 conn(0x7f7fa40ced50 msgr2=0x7f7fa406d450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 shutdown_connections 2023-08-10T10:33:29.675 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:29.670+0000 7f7fabdff700 1 -- 172.21.15.88:0/3042929045 wait complete. 2023-08-10T10:33:29.676 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:33:29.690 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2023-08-10T10:33:29.604281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113831152,"num_objects":53,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":1356,"num_write_kb":1081169,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17732,"ondisk_log_size":17732,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":490132,"kb_used_data":224852,"kb_used_omap":13,"kb_used_meta":265202,"kb_avail":754484588,"statfs":{"total":773094113280,"available":772592218112,"internally_reserved":0,"allocated":230248448,"data_stored":228734685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":271566936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":68,"apply_latency_ms":68,"commit_latency_ns":68000000,"apply_latency_ns":68000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-436087823,"num_objects":-106,"num_object_clones":0,"num_object_copies":-424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-106,"num_whiteouts":0,"num_read":3,"num_read_kb":4,"num_write":189,"num_write_kb":57495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002327"},"pg_stats":[{"pgid":"4.3f","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.980365+0000","last_change":"2023-08-10T10:30:34.336098+0000","last_active":"2023-08-10T10:33:19.980365+0000","last_peered":"2023-08-10T10:33:19.980365+0000","last_clean":"2023-08-10T10:33:19.980365+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:19.980365+0000","last_undegraded":"2023-08-10T10:33:19.980365+0000","last_fullsized":"2023-08-10T10:33:19.980365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:38:54.211672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975666+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:19.975666+0000","last_peered":"2023-08-10T10:33:19.975666+0000","last_clean":"2023-08-10T10:33:19.975666+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:19.975666+0000","last_undegraded":"2023-08-10T10:33:19.975666+0000","last_fullsized":"2023-08-10T10:33:19.975666+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:38.140479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'42","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989781+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:19.989781+0000","last_peered":"2023-08-10T10:33:19.989781+0000","last_clean":"2023-08-10T10:33:19.989781+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:19.989781+0000","last_undegraded":"2023-08-10T10:33:19.989781+0000","last_fullsized":"2023-08-10T10:33:19.989781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:38:55.075290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979553+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:33:19.979553+0000","last_peered":"2023-08-10T10:33:19.979553+0000","last_clean":"2023-08-10T10:33:19.979553+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:19.979553+0000","last_undegraded":"2023-08-10T10:33:19.979553+0000","last_fullsized":"2023-08-10T10:33:19.979553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:12:59.927282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'33","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.985393+0000","last_change":"2023-08-10T10:30:34.338376+0000","last_active":"2023-08-10T10:33:19.985393+0000","last_peered":"2023-08-10T10:33:19.985393+0000","last_clean":"2023-08-10T10:33:19.985393+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:19.985393+0000","last_undegraded":"2023-08-10T10:33:19.985393+0000","last_fullsized":"2023-08-10T10:33:19.985393+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'38","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991027+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:19.991027+0000","last_peered":"2023-08-10T10:33:19.991027+0000","last_clean":"2023-08-10T10:33:19.991027+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:19.991027+0000","last_undegraded":"2023-08-10T10:33:19.991027+0000","last_fullsized":"2023-08-10T10:33:19.991027+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:08:45.385568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971328+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:33:19.971328+0000","last_peered":"2023-08-10T10:33:19.971328+0000","last_clean":"2023-08-10T10:33:19.971328+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:19.971328+0000","last_undegraded":"2023-08-10T10:33:19.971328+0000","last_fullsized":"2023-08-10T10:33:19.971328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:22.895395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978947+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:19.978947+0000","last_peered":"2023-08-10T10:33:19.978947+0000","last_clean":"2023-08-10T10:33:19.978947+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:19.978947+0000","last_undegraded":"2023-08-10T10:33:19.978947+0000","last_fullsized":"2023-08-10T10:33:19.978947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979468+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:19.979468+0000","last_peered":"2023-08-10T10:33:19.979468+0000","last_clean":"2023-08-10T10:33:19.979468+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:19.979468+0000","last_undegraded":"2023-08-10T10:33:19.979468+0000","last_fullsized":"2023-08-10T10:33:19.979468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'44","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.981931+0000","last_change":"2023-08-10T10:30:34.339363+0000","last_active":"2023-08-10T10:33:19.981931+0000","last_peered":"2023-08-10T10:33:19.981931+0000","last_clean":"2023-08-10T10:33:19.981931+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:19.981931+0000","last_undegraded":"2023-08-10T10:33:19.981931+0000","last_fullsized":"2023-08-10T10:33:19.981931+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'25","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989845+0000","last_change":"2023-08-10T10:30:34.336876+0000","last_active":"2023-08-10T10:33:19.989845+0000","last_peered":"2023-08-10T10:33:19.989845+0000","last_clean":"2023-08-10T10:33:19.989845+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:19.989845+0000","last_undegraded":"2023-08-10T10:33:19.989845+0000","last_fullsized":"2023-08-10T10:33:19.989845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:32:54.096841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978514+0000","last_change":"2023-08-10T10:30:34.330079+0000","last_active":"2023-08-10T10:33:19.978514+0000","last_peered":"2023-08-10T10:33:19.978514+0000","last_clean":"2023-08-10T10:33:19.978514+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:19.978514+0000","last_undegraded":"2023-08-10T10:33:19.978514+0000","last_fullsized":"2023-08-10T10:33:19.978514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:30.591913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978634+0000","last_change":"2023-08-10T10:30:34.333658+0000","last_active":"2023-08-10T10:33:19.978634+0000","last_peered":"2023-08-10T10:33:19.978634+0000","last_clean":"2023-08-10T10:33:19.978634+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:19.978634+0000","last_undegraded":"2023-08-10T10:33:19.978634+0000","last_fullsized":"2023-08-10T10:33:19.978634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:46.268861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975088+0000","last_change":"2023-08-10T10:30:34.341672+0000","last_active":"2023-08-10T10:33:19.975088+0000","last_peered":"2023-08-10T10:33:19.975088+0000","last_clean":"2023-08-10T10:33:19.975088+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:19.975088+0000","last_undegraded":"2023-08-10T10:33:19.975088+0000","last_fullsized":"2023-08-10T10:33:19.975088+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:45.102687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971119+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:33:19.971119+0000","last_peered":"2023-08-10T10:33:19.971119+0000","last_clean":"2023-08-10T10:33:19.971119+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:33:19.971119+0000","last_undegraded":"2023-08-10T10:33:19.971119+0000","last_fullsized":"2023-08-10T10:33:19.971119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:07.252972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'38","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.992199+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:19.992199+0000","last_peered":"2023-08-10T10:33:19.992199+0000","last_clean":"2023-08-10T10:33:19.992199+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:19.992199+0000","last_undegraded":"2023-08-10T10:33:19.992199+0000","last_fullsized":"2023-08-10T10:33:19.992199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:02:54.252670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'36","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982407+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:33:19.982407+0000","last_peered":"2023-08-10T10:33:19.982407+0000","last_clean":"2023-08-10T10:33:19.982407+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:33:19.982407+0000","last_undegraded":"2023-08-10T10:33:19.982407+0000","last_fullsized":"2023-08-10T10:33:19.982407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'29","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.987533+0000","last_change":"2023-08-10T10:30:34.335285+0000","last_active":"2023-08-10T10:33:19.987533+0000","last_peered":"2023-08-10T10:33:19.987533+0000","last_clean":"2023-08-10T10:33:19.987533+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:19.987533+0000","last_undegraded":"2023-08-10T10:33:19.987533+0000","last_fullsized":"2023-08-10T10:33:19.987533+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:41.704636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.973573+0000","last_change":"2023-08-10T10:30:34.338697+0000","last_active":"2023-08-10T10:33:19.973573+0000","last_peered":"2023-08-10T10:33:19.973573+0000","last_clean":"2023-08-10T10:33:19.973573+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:19.973573+0000","last_undegraded":"2023-08-10T10:33:19.973573+0000","last_fullsized":"2023-08-10T10:33:19.973573+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:46.253304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991443+0000","last_change":"2023-08-10T10:30:34.352771+0000","last_active":"2023-08-10T10:33:19.991443+0000","last_peered":"2023-08-10T10:33:19.991443+0000","last_clean":"2023-08-10T10:33:19.991443+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:19.991443+0000","last_undegraded":"2023-08-10T10:33:19.991443+0000","last_fullsized":"2023-08-10T10:33:19.991443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:21:28.531313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'41","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978389+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:19.978389+0000","last_peered":"2023-08-10T10:33:19.978389+0000","last_clean":"2023-08-10T10:33:19.978389+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:19.978389+0000","last_undegraded":"2023-08-10T10:33:19.978389+0000","last_fullsized":"2023-08-10T10:33:19.978389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.981897+0000","last_change":"2023-08-10T10:30:34.336417+0000","last_active":"2023-08-10T10:33:19.981897+0000","last_peered":"2023-08-10T10:33:19.981897+0000","last_clean":"2023-08-10T10:33:19.981897+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:19.981897+0000","last_undegraded":"2023-08-10T10:33:19.981897+0000","last_fullsized":"2023-08-10T10:33:19.981897+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'35","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.985171+0000","last_change":"2023-08-10T10:30:34.334203+0000","last_active":"2023-08-10T10:33:19.985171+0000","last_peered":"2023-08-10T10:33:19.985171+0000","last_clean":"2023-08-10T10:33:19.985171+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:19.985171+0000","last_undegraded":"2023-08-10T10:33:19.985171+0000","last_fullsized":"2023-08-10T10:33:19.985171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:15.309059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.981492+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:19.981492+0000","last_peered":"2023-08-10T10:33:19.981492+0000","last_clean":"2023-08-10T10:33:19.981492+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:19.981492+0000","last_undegraded":"2023-08-10T10:33:19.981492+0000","last_fullsized":"2023-08-10T10:33:19.981492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.973587+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:33:19.973587+0000","last_peered":"2023-08-10T10:33:19.973587+0000","last_clean":"2023-08-10T10:33:19.973587+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:19.973587+0000","last_undegraded":"2023-08-10T10:33:19.973587+0000","last_fullsized":"2023-08-10T10:33:19.973587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:56.368315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'37","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975512+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:33:19.975512+0000","last_peered":"2023-08-10T10:33:19.975512+0000","last_clean":"2023-08-10T10:33:19.975512+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:19.975512+0000","last_undegraded":"2023-08-10T10:33:19.975512+0000","last_fullsized":"2023-08-10T10:33:19.975512+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:18.325059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972005+0000","last_change":"2023-08-10T10:30:34.341887+0000","last_active":"2023-08-10T10:33:19.972005+0000","last_peered":"2023-08-10T10:33:19.972005+0000","last_clean":"2023-08-10T10:33:19.972005+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:19.972005+0000","last_undegraded":"2023-08-10T10:33:19.972005+0000","last_fullsized":"2023-08-10T10:33:19.972005+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'444","reported_seq":462,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.662392+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:16.662392+0000","last_peered":"2023-08-10T10:33:16.662392+0000","last_clean":"2023-08-10T10:33:16.662392+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:16.662392+0000","last_undegraded":"2023-08-10T10:33:16.662392+0000","last_fullsized":"2023-08-10T10:33:16.662392+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:11:32.547675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296882+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:31:15.296882+0000","last_peered":"2023-08-10T10:31:15.296882+0000","last_clean":"2023-08-10T10:31:15.296882+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:31:15.296882+0000","last_undegraded":"2023-08-10T10:31:15.296882+0000","last_fullsized":"2023-08-10T10:31:15.296882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:35:24.254384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'39","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982216+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:19.982216+0000","last_peered":"2023-08-10T10:33:19.982216+0000","last_clean":"2023-08-10T10:33:19.982216+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:19.982216+0000","last_undegraded":"2023-08-10T10:33:19.982216+0000","last_fullsized":"2023-08-10T10:33:19.982216+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:46.466667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'473","reported_seq":491,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.611376+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:33:20.611376+0000","last_peered":"2023-08-10T10:33:20.611376+0000","last_clean":"2023-08-10T10:33:20.611376+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:33:20.611376+0000","last_undegraded":"2023-08-10T10:33:20.611376+0000","last_fullsized":"2023-08-10T10:33:20.611376+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:02:28.669274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558123+0000","last_change":"2023-08-10T10:30:33.321605+0000","last_active":"2023-08-10T10:31:15.558123+0000","last_peered":"2023-08-10T10:31:15.558123+0000","last_clean":"2023-08-10T10:31:15.558123+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:31:15.558123+0000","last_undegraded":"2023-08-10T10:31:15.558123+0000","last_fullsized":"2023-08-10T10:31:15.558123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:58:06.099809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.980936+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:33:19.980936+0000","last_peered":"2023-08-10T10:33:19.980936+0000","last_clean":"2023-08-10T10:33:19.980936+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:19.980936+0000","last_undegraded":"2023-08-10T10:33:19.980936+0000","last_fullsized":"2023-08-10T10:33:19.980936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'477","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.606501+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:20.606501+0000","last_peered":"2023-08-10T10:33:20.606501+0000","last_clean":"2023-08-10T10:33:20.606501+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:20.606501+0000","last_undegraded":"2023-08-10T10:33:20.606501+0000","last_fullsized":"2023-08-10T10:33:20.606501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297997+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:31:15.297997+0000","last_peered":"2023-08-10T10:31:15.297997+0000","last_clean":"2023-08-10T10:31:15.297997+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:31:15.297997+0000","last_undegraded":"2023-08-10T10:31:15.297997+0000","last_fullsized":"2023-08-10T10:31:15.297997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971988+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:33:19.971988+0000","last_peered":"2023-08-10T10:33:19.971988+0000","last_clean":"2023-08-10T10:33:19.971988+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:19.971988+0000","last_undegraded":"2023-08-10T10:33:19.971988+0000","last_fullsized":"2023-08-10T10:33:19.971988+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:06:33.491533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":479,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.640017+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:33:16.640017+0000","last_peered":"2023-08-10T10:33:16.640017+0000","last_clean":"2023-08-10T10:33:16.640017+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:33:16.640017+0000","last_undegraded":"2023-08-10T10:33:16.640017+0000","last_fullsized":"2023-08-10T10:33:16.640017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:26:11.329930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.632333+0000","last_change":"2023-08-10T10:30:33.326260+0000","last_active":"2023-08-10T10:32:59.632333+0000","last_peered":"2023-08-10T10:32:59.632333+0000","last_clean":"2023-08-10T10:32:59.632333+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:32:59.632333+0000","last_undegraded":"2023-08-10T10:32:59.632333+0000","last_fullsized":"2023-08-10T10:32:59.632333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'27","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.980038+0000","last_change":"2023-08-10T10:30:34.332980+0000","last_active":"2023-08-10T10:33:19.980038+0000","last_peered":"2023-08-10T10:33:19.980038+0000","last_clean":"2023-08-10T10:33:19.980038+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:19.980038+0000","last_undegraded":"2023-08-10T10:33:19.980038+0000","last_fullsized":"2023-08-10T10:33:19.980038+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:47.535819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'465","reported_seq":483,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.592882+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:20.592882+0000","last_peered":"2023-08-10T10:33:20.592882+0000","last_clean":"2023-08-10T10:33:20.592882+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:20.592882+0000","last_undegraded":"2023-08-10T10:33:20.592882+0000","last_fullsized":"2023-08-10T10:33:20.592882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:49.157469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.644932+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:32:59.644932+0000","last_peered":"2023-08-10T10:32:59.644932+0000","last_clean":"2023-08-10T10:32:59.644932+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:32:59.644932+0000","last_undegraded":"2023-08-10T10:32:59.644932+0000","last_fullsized":"2023-08-10T10:32:59.644932+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'36","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979785+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:19.979785+0000","last_peered":"2023-08-10T10:33:19.979785+0000","last_clean":"2023-08-10T10:33:19.979785+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:19.979785+0000","last_undegraded":"2023-08-10T10:33:19.979785+0000","last_fullsized":"2023-08-10T10:33:19.979785+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:01.800450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.681597+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.681597+0000","last_peered":"2023-08-10T10:33:16.681597+0000","last_clean":"2023-08-10T10:33:16.681597+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.681597+0000","last_undegraded":"2023-08-10T10:33:16.681597+0000","last_fullsized":"2023-08-10T10:33:16.681597+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:52:55.391226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'12","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.695565+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:33:16.695565+0000","last_peered":"2023-08-10T10:33:16.695565+0000","last_clean":"2023-08-10T10:33:16.695565+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:16.695565+0000","last_undegraded":"2023-08-10T10:33:16.695565+0000","last_fullsized":"2023-08-10T10:33:16.695565+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:22:37.133803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'42","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.963467+0000","last_change":"2023-08-10T10:30:34.350087+0000","last_active":"2023-08-10T10:33:19.963467+0000","last_peered":"2023-08-10T10:33:19.963467+0000","last_clean":"2023-08-10T10:33:19.963467+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:19.963467+0000","last_undegraded":"2023-08-10T10:33:19.963467+0000","last_fullsized":"2023-08-10T10:33:19.963467+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:40:31.121005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'455","reported_seq":473,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.596020+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:20.596020+0000","last_peered":"2023-08-10T10:33:20.596020+0000","last_clean":"2023-08-10T10:33:20.596020+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:20.596020+0000","last_undegraded":"2023-08-10T10:33:20.596020+0000","last_fullsized":"2023-08-10T10:33:20.596020+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:22:35.104002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'599","reported_seq":625,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:23.523349+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:33:23.523349+0000","last_peered":"2023-08-10T10:33:23.523349+0000","last_clean":"2023-08-10T10:33:23.523349+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:23.523349+0000","last_undegraded":"2023-08-10T10:33:23.523349+0000","last_fullsized":"2023-08-10T10:33:23.523349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":599,"log_dups_size":0,"ondisk_log_size":599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:01:21.332327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2083178,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":598,"num_write_kb":2478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993786+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:19.993786+0000","last_peered":"2023-08-10T10:33:19.993786+0000","last_clean":"2023-08-10T10:33:19.993786+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:19.993786+0000","last_undegraded":"2023-08-10T10:33:19.993786+0000","last_fullsized":"2023-08-10T10:33:19.993786+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:09:17.491868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":507,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.672394+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:16.672394+0000","last_peered":"2023-08-10T10:33:16.672394+0000","last_clean":"2023-08-10T10:33:16.672394+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:16.672394+0000","last_undegraded":"2023-08-10T10:33:16.672394+0000","last_fullsized":"2023-08-10T10:33:16.672394+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:30.844193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297505+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:31:15.297505+0000","last_peered":"2023-08-10T10:31:15.297505+0000","last_clean":"2023-08-10T10:31:15.297505+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:31:15.297505+0000","last_undegraded":"2023-08-10T10:31:15.297505+0000","last_fullsized":"2023-08-10T10:31:15.297505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:45:00.793774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'29","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.977457+0000","last_change":"2023-08-10T10:31:15.344082+0000","last_active":"2023-08-10T10:33:19.977457+0000","last_peered":"2023-08-10T10:33:19.977457+0000","last_clean":"2023-08-10T10:33:19.977457+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:19.977457+0000","last_undegraded":"2023-08-10T10:33:19.977457+0000","last_fullsized":"2023-08-10T10:33:19.977457+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:16.251149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'456","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.611642+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:20.611642+0000","last_peered":"2023-08-10T10:33:20.611642+0000","last_clean":"2023-08-10T10:33:20.611642+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:20.611642+0000","last_undegraded":"2023-08-10T10:33:20.611642+0000","last_fullsized":"2023-08-10T10:33:20.611642+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:47.531875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.631666+0000","last_change":"2023-08-10T10:30:33.321722+0000","last_active":"2023-08-10T10:32:54.631666+0000","last_peered":"2023-08-10T10:32:54.631666+0000","last_clean":"2023-08-10T10:32:54.631666+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:32:54.631666+0000","last_undegraded":"2023-08-10T10:32:54.631666+0000","last_fullsized":"2023-08-10T10:32:54.631666+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972719+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:33:19.972719+0000","last_peered":"2023-08-10T10:33:19.972719+0000","last_clean":"2023-08-10T10:33:19.972719+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:33:19.972719+0000","last_undegraded":"2023-08-10T10:33:19.972719+0000","last_fullsized":"2023-08-10T10:33:19.972719+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:39.485653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:12.657216+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:12.657216+0000","last_peered":"2023-08-10T10:33:12.657216+0000","last_clean":"2023-08-10T10:33:12.657216+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:12.657216+0000","last_undegraded":"2023-08-10T10:33:12.657216+0000","last_fullsized":"2023-08-10T10:33:12.657216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:28:55.194057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.649027+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:32:54.649027+0000","last_peered":"2023-08-10T10:32:54.649027+0000","last_clean":"2023-08-10T10:32:54.649027+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:32:54.649027+0000","last_undegraded":"2023-08-10T10:32:54.649027+0000","last_fullsized":"2023-08-10T10:32:54.649027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.985505+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:33:19.985505+0000","last_peered":"2023-08-10T10:33:19.985505+0000","last_clean":"2023-08-10T10:33:19.985505+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:33:19.985505+0000","last_undegraded":"2023-08-10T10:33:19.985505+0000","last_fullsized":"2023-08-10T10:33:19.985505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'510","reported_seq":528,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.596044+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:20.596044+0000","last_peered":"2023-08-10T10:33:20.596044+0000","last_clean":"2023-08-10T10:33:20.596044+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:20.596044+0000","last_undegraded":"2023-08-10T10:33:20.596044+0000","last_fullsized":"2023-08-10T10:33:20.596044+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:26.950178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'9","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.644202+0000","last_change":"2023-08-10T10:30:33.317332+0000","last_active":"2023-08-10T10:32:54.644202+0000","last_peered":"2023-08-10T10:32:54.644202+0000","last_clean":"2023-08-10T10:32:54.644202+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:32:54.644202+0000","last_undegraded":"2023-08-10T10:32:54.644202+0000","last_fullsized":"2023-08-10T10:32:54.644202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:03:28.578497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978459+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:19.978459+0000","last_peered":"2023-08-10T10:33:19.978459+0000","last_clean":"2023-08-10T10:33:19.978459+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:19.978459+0000","last_undegraded":"2023-08-10T10:33:19.978459+0000","last_fullsized":"2023-08-10T10:33:19.978459+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:53.894741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661711+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:16.661711+0000","last_peered":"2023-08-10T10:33:16.661711+0000","last_clean":"2023-08-10T10:33:16.661711+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:16.661711+0000","last_undegraded":"2023-08-10T10:33:16.661711+0000","last_fullsized":"2023-08-10T10:33:16.661711+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:51.590601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297435+0000","last_change":"2023-08-10T10:30:33.324056+0000","last_active":"2023-08-10T10:31:15.297435+0000","last_peered":"2023-08-10T10:31:15.297435+0000","last_clean":"2023-08-10T10:31:15.297435+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:31:15.297435+0000","last_undegraded":"2023-08-10T10:31:15.297435+0000","last_fullsized":"2023-08-10T10:31:15.297435+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:14.302383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'29","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971902+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:19.971902+0000","last_peered":"2023-08-10T10:33:19.971902+0000","last_clean":"2023-08-10T10:33:19.971902+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:19.971902+0000","last_undegraded":"2023-08-10T10:33:19.971902+0000","last_fullsized":"2023-08-10T10:33:19.971902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:26.140601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":515,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637975+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:33:16.637975+0000","last_peered":"2023-08-10T10:33:16.637975+0000","last_clean":"2023-08-10T10:33:16.637975+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:16.637975+0000","last_undegraded":"2023-08-10T10:33:16.637975+0000","last_fullsized":"2023-08-10T10:33:16.637975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:31:50.363460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298234+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:31:15.298234+0000","last_peered":"2023-08-10T10:31:15.298234+0000","last_clean":"2023-08-10T10:31:15.298234+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:31:15.298234+0000","last_undegraded":"2023-08-10T10:31:15.298234+0000","last_fullsized":"2023-08-10T10:31:15.298234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:03.007876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991030+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:19.991030+0000","last_peered":"2023-08-10T10:33:19.991030+0000","last_clean":"2023-08-10T10:33:19.991030+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:19.991030+0000","last_undegraded":"2023-08-10T10:33:19.991030+0000","last_fullsized":"2023-08-10T10:33:19.991030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:35.261347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'473","reported_seq":491,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.600410+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:33:20.600410+0000","last_peered":"2023-08-10T10:33:20.600410+0000","last_clean":"2023-08-10T10:33:20.600410+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:20.600410+0000","last_undegraded":"2023-08-10T10:33:20.600410+0000","last_fullsized":"2023-08-10T10:33:20.600410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:03:33.019525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297852+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:31:15.297852+0000","last_peered":"2023-08-10T10:31:15.297852+0000","last_clean":"2023-08-10T10:31:15.297852+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:31:15.297852+0000","last_undegraded":"2023-08-10T10:31:15.297852+0000","last_fullsized":"2023-08-10T10:31:15.297852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'33","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.970337+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:33:19.970337+0000","last_peered":"2023-08-10T10:33:19.970337+0000","last_clean":"2023-08-10T10:33:19.970337+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:19.970337+0000","last_undegraded":"2023-08-10T10:33:19.970337+0000","last_fullsized":"2023-08-10T10:33:19.970337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:39:38.087817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686298+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:33:16.686298+0000","last_peered":"2023-08-10T10:33:16.686298+0000","last_clean":"2023-08-10T10:33:16.686298+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:16.686298+0000","last_undegraded":"2023-08-10T10:33:16.686298+0000","last_fullsized":"2023-08-10T10:33:16.686298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:52:00.714870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340760+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:31:15.340760+0000","last_peered":"2023-08-10T10:31:15.340760+0000","last_clean":"2023-08-10T10:31:15.340760+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:31:15.340760+0000","last_undegraded":"2023-08-10T10:31:15.340760+0000","last_fullsized":"2023-08-10T10:31:15.340760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:16.221080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'30","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.985586+0000","last_change":"2023-08-10T10:30:34.335906+0000","last_active":"2023-08-10T10:33:19.985586+0000","last_peered":"2023-08-10T10:33:19.985586+0000","last_clean":"2023-08-10T10:33:19.985586+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:19.985586+0000","last_undegraded":"2023-08-10T10:33:19.985586+0000","last_fullsized":"2023-08-10T10:33:19.985586+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":459,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603945+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:33:16.603945+0000","last_peered":"2023-08-10T10:33:16.603945+0000","last_clean":"2023-08-10T10:33:16.603945+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:16.603945+0000","last_undegraded":"2023-08-10T10:33:16.603945+0000","last_fullsized":"2023-08-10T10:33:16.603945+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:22:29.585039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.564548+0000","last_change":"2023-08-10T10:30:33.319115+0000","last_active":"2023-08-10T10:32:59.564548+0000","last_peered":"2023-08-10T10:32:59.564548+0000","last_clean":"2023-08-10T10:32:59.564548+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:32:59.564548+0000","last_undegraded":"2023-08-10T10:32:59.564548+0000","last_fullsized":"2023-08-10T10:32:59.564548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:19.074943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'26","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.992914+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:19.992914+0000","last_peered":"2023-08-10T10:33:19.992914+0000","last_clean":"2023-08-10T10:33:19.992914+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:19.992914+0000","last_undegraded":"2023-08-10T10:33:19.992914+0000","last_fullsized":"2023-08-10T10:33:19.992914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:07:41.250265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'479","reported_seq":497,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.839197+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:19.839197+0000","last_peered":"2023-08-10T10:33:19.839197+0000","last_clean":"2023-08-10T10:33:19.839197+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:19.839197+0000","last_undegraded":"2023-08-10T10:33:19.839197+0000","last_fullsized":"2023-08-10T10:33:19.839197+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:11:23.334412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132118+0000","last_change":"2023-08-10T10:30:33.326595+0000","last_active":"2023-08-10T10:31:16.132118+0000","last_peered":"2023-08-10T10:31:16.132118+0000","last_clean":"2023-08-10T10:31:16.132118+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:31:16.132118+0000","last_undegraded":"2023-08-10T10:31:16.132118+0000","last_fullsized":"2023-08-10T10:31:16.132118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:18:48.763588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'30","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.990970+0000","last_change":"2023-08-10T10:30:34.336044+0000","last_active":"2023-08-10T10:33:19.990970+0000","last_peered":"2023-08-10T10:33:19.990970+0000","last_clean":"2023-08-10T10:33:19.990970+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:19.990970+0000","last_undegraded":"2023-08-10T10:33:19.990970+0000","last_fullsized":"2023-08-10T10:33:19.990970+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:28:23.266001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'458","reported_seq":476,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.854080+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:19.854080+0000","last_peered":"2023-08-10T10:33:19.854080+0000","last_clean":"2023-08-10T10:33:19.854080+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:19.854080+0000","last_undegraded":"2023-08-10T10:33:19.854080+0000","last_fullsized":"2023-08-10T10:33:19.854080+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:36.596785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.647488+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:32:44.647488+0000","last_peered":"2023-08-10T10:32:44.647488+0000","last_clean":"2023-08-10T10:32:44.647488+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:32:44.647488+0000","last_undegraded":"2023-08-10T10:32:44.647488+0000","last_fullsized":"2023-08-10T10:32:44.647488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:19:17.232518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'17","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993637+0000","last_change":"2023-08-10T10:30:34.345564+0000","last_active":"2023-08-10T10:33:19.993637+0000","last_peered":"2023-08-10T10:33:19.993637+0000","last_clean":"2023-08-10T10:33:19.993637+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:19.993637+0000","last_undegraded":"2023-08-10T10:33:19.993637+0000","last_fullsized":"2023-08-10T10:33:19.993637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:54:47.483257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.618747+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.618747+0000","last_peered":"2023-08-10T10:33:16.618747+0000","last_clean":"2023-08-10T10:33:16.618747+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.618747+0000","last_undegraded":"2023-08-10T10:33:16.618747+0000","last_fullsized":"2023-08-10T10:33:16.618747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:01:58.041993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297869+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:31:15.297869+0000","last_peered":"2023-08-10T10:31:15.297869+0000","last_clean":"2023-08-10T10:31:15.297869+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:31:15.297869+0000","last_undegraded":"2023-08-10T10:31:15.297869+0000","last_fullsized":"2023-08-10T10:31:15.297869+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:11:21.888719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'28","reported_seq":52,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979686+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:33:19.979686+0000","last_peered":"2023-08-10T10:33:19.979686+0000","last_clean":"2023-08-10T10:33:19.979686+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:19.979686+0000","last_undegraded":"2023-08-10T10:33:19.979686+0000","last_fullsized":"2023-08-10T10:33:19.979686+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:17.227756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686870+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:16.686870+0000","last_peered":"2023-08-10T10:33:16.686870+0000","last_clean":"2023-08-10T10:33:16.686870+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:16.686870+0000","last_undegraded":"2023-08-10T10:33:16.686870+0000","last_fullsized":"2023-08-10T10:33:16.686870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558794+0000","last_change":"2023-08-10T10:30:28.302224+0000","last_active":"2023-08-10T10:31:15.558794+0000","last_peered":"2023-08-10T10:31:15.558794+0000","last_clean":"2023-08-10T10:31:15.558794+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:31:15.558794+0000","last_undegraded":"2023-08-10T10:31:15.558794+0000","last_fullsized":"2023-08-10T10:31:15.558794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:16:20.114056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.521825+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:33:04.521825+0000","last_peered":"2023-08-10T10:33:04.521825+0000","last_clean":"2023-08-10T10:33:04.521825+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:04.521825+0000","last_undegraded":"2023-08-10T10:33:04.521825+0000","last_fullsized":"2023-08-10T10:33:04.521825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:26:46.529142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'29","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.974647+0000","last_change":"2023-08-10T10:30:34.341891+0000","last_active":"2023-08-10T10:33:19.974647+0000","last_peered":"2023-08-10T10:33:19.974647+0000","last_clean":"2023-08-10T10:33:19.974647+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:19.974647+0000","last_undegraded":"2023-08-10T10:33:19.974647+0000","last_fullsized":"2023-08-10T10:33:19.974647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:54:33.490533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.595509+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:20.595509+0000","last_peered":"2023-08-10T10:33:20.595509+0000","last_clean":"2023-08-10T10:33:20.595509+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:20.595509+0000","last_undegraded":"2023-08-10T10:33:20.595509+0000","last_fullsized":"2023-08-10T10:33:20.595509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340578+0000","last_change":"2023-08-10T10:30:28.287264+0000","last_active":"2023-08-10T10:31:15.340578+0000","last_peered":"2023-08-10T10:31:15.340578+0000","last_clean":"2023-08-10T10:31:15.340578+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:31:15.340578+0000","last_undegraded":"2023-08-10T10:31:15.340578+0000","last_fullsized":"2023-08-10T10:31:15.340578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:50.341770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298059+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:31:15.298059+0000","last_peered":"2023-08-10T10:31:15.298059+0000","last_clean":"2023-08-10T10:31:15.298059+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:31:15.298059+0000","last_undegraded":"2023-08-10T10:31:15.298059+0000","last_fullsized":"2023-08-10T10:31:15.298059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:59:07.488469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.976035+0000","last_change":"2023-08-10T10:30:34.339643+0000","last_active":"2023-08-10T10:33:19.976035+0000","last_peered":"2023-08-10T10:33:19.976035+0000","last_clean":"2023-08-10T10:33:19.976035+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:19.976035+0000","last_undegraded":"2023-08-10T10:33:19.976035+0000","last_fullsized":"2023-08-10T10:33:19.976035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:20:35.281409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":436,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637941+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:33:16.637941+0000","last_peered":"2023-08-10T10:33:16.637941+0000","last_clean":"2023-08-10T10:33:16.637941+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:16.637941+0000","last_undegraded":"2023-08-10T10:33:16.637941+0000","last_fullsized":"2023-08-10T10:33:16.637941+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:47:37.499897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.295972+0000","last_change":"2023-08-10T10:30:28.305883+0000","last_active":"2023-08-10T10:31:15.295972+0000","last_peered":"2023-08-10T10:31:15.295972+0000","last_clean":"2023-08-10T10:31:15.295972+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:31:15.295972+0000","last_undegraded":"2023-08-10T10:31:15.295972+0000","last_fullsized":"2023-08-10T10:31:15.295972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:59:02.669208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:34.627598+0000","last_change":"2023-08-10T10:30:33.318613+0000","last_active":"2023-08-10T10:32:34.627598+0000","last_peered":"2023-08-10T10:32:34.627598+0000","last_clean":"2023-08-10T10:32:34.627598+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:32:34.627598+0000","last_undegraded":"2023-08-10T10:32:34.627598+0000","last_fullsized":"2023-08-10T10:32:34.627598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:07:24.427296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'29","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.974744+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:33:19.974744+0000","last_peered":"2023-08-10T10:33:19.974744+0000","last_clean":"2023-08-10T10:33:19.974744+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:19.974744+0000","last_undegraded":"2023-08-10T10:33:19.974744+0000","last_fullsized":"2023-08-10T10:33:19.974744+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:39.555970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.596480+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.596480+0000","last_peered":"2023-08-10T10:33:16.596480+0000","last_clean":"2023-08-10T10:33:16.596480+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.596480+0000","last_undegraded":"2023-08-10T10:33:16.596480+0000","last_fullsized":"2023-08-10T10:33:16.596480+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:43.540436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340660+0000","last_change":"2023-08-10T10:30:28.289419+0000","last_active":"2023-08-10T10:31:15.340660+0000","last_peered":"2023-08-10T10:31:15.340660+0000","last_clean":"2023-08-10T10:31:15.340660+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:31:15.340660+0000","last_undegraded":"2023-08-10T10:31:15.340660+0000","last_fullsized":"2023-08-10T10:31:15.340660+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:42:12.298514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296544+0000","last_change":"2023-08-10T10:30:21.352492+0000","last_active":"2023-08-10T10:31:15.296544+0000","last_peered":"2023-08-10T10:31:15.296544+0000","last_clean":"2023-08-10T10:31:15.296544+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:31:15.296544+0000","last_undegraded":"2023-08-10T10:31:15.296544+0000","last_fullsized":"2023-08-10T10:31:15.296544+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:19.762092+0000","last_clean_scrub_stamp":"2023-08-10T10:30:19.762092+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:42:42.837063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298242+0000","last_change":"2023-08-10T10:30:33.324735+0000","last_active":"2023-08-10T10:31:15.298242+0000","last_peered":"2023-08-10T10:31:15.298242+0000","last_clean":"2023-08-10T10:31:15.298242+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:31:15.298242+0000","last_undegraded":"2023-08-10T10:31:15.298242+0000","last_fullsized":"2023-08-10T10:31:15.298242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:50:38.478977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.996109+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:33:19.996109+0000","last_peered":"2023-08-10T10:33:19.996109+0000","last_clean":"2023-08-10T10:33:19.996109+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:19.996109+0000","last_undegraded":"2023-08-10T10:33:19.996109+0000","last_fullsized":"2023-08-10T10:33:19.996109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:37:07.362708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'427","reported_seq":445,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.861087+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:19.861087+0000","last_peered":"2023-08-10T10:33:19.861087+0000","last_clean":"2023-08-10T10:33:19.861087+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:19.861087+0000","last_undegraded":"2023-08-10T10:33:19.861087+0000","last_fullsized":"2023-08-10T10:33:19.861087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:51:19.363842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.296820+0000","last_change":"2023-08-10T10:30:28.284062+0000","last_active":"2023-08-10T10:31:15.296820+0000","last_peered":"2023-08-10T10:31:15.296820+0000","last_clean":"2023-08-10T10:31:15.296820+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:31:15.296820+0000","last_undegraded":"2023-08-10T10:31:15.296820+0000","last_fullsized":"2023-08-10T10:31:15.296820+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:31:11.201211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'16","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.587446+0000","last_change":"2023-08-10T10:30:33.324386+0000","last_active":"2023-08-10T10:33:20.587446+0000","last_peered":"2023-08-10T10:33:20.587446+0000","last_clean":"2023-08-10T10:33:20.587446+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:20.587446+0000","last_undegraded":"2023-08-10T10:33:20.587446+0000","last_fullsized":"2023-08-10T10:33:20.587446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'29","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.984918+0000","last_change":"2023-08-10T10:30:34.335660+0000","last_active":"2023-08-10T10:33:19.984918+0000","last_peered":"2023-08-10T10:33:19.984918+0000","last_clean":"2023-08-10T10:33:19.984918+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:19.984918+0000","last_undegraded":"2023-08-10T10:33:19.984918+0000","last_fullsized":"2023-08-10T10:33:19.984918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":490,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.661787+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:33:16.661787+0000","last_peered":"2023-08-10T10:33:16.661787+0000","last_clean":"2023-08-10T10:33:16.661787+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:33:16.661787+0000","last_undegraded":"2023-08-10T10:33:16.661787+0000","last_fullsized":"2023-08-10T10:33:16.661787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:01:25.203845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.297805+0000","last_change":"2023-08-10T10:30:28.302213+0000","last_active":"2023-08-10T10:31:15.297805+0000","last_peered":"2023-08-10T10:31:15.297805+0000","last_clean":"2023-08-10T10:31:15.297805+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:31:15.297805+0000","last_undegraded":"2023-08-10T10:31:15.297805+0000","last_fullsized":"2023-08-10T10:31:15.297805+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:59:40.440122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.628271+0000","last_change":"2023-08-10T10:30:33.318426+0000","last_active":"2023-08-10T10:32:39.628271+0000","last_peered":"2023-08-10T10:32:39.628271+0000","last_clean":"2023-08-10T10:32:39.628271+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:32:39.628271+0000","last_undegraded":"2023-08-10T10:32:39.628271+0000","last_fullsized":"2023-08-10T10:32:39.628271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'34","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982758+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:33:19.982758+0000","last_peered":"2023-08-10T10:33:19.982758+0000","last_clean":"2023-08-10T10:33:19.982758+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:19.982758+0000","last_undegraded":"2023-08-10T10:33:19.982758+0000","last_fullsized":"2023-08-10T10:33:19.982758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'511","reported_seq":529,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.630545+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:16.630545+0000","last_peered":"2023-08-10T10:33:16.630545+0000","last_clean":"2023-08-10T10:33:16.630545+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:16.630545+0000","last_undegraded":"2023-08-10T10:33:16.630545+0000","last_fullsized":"2023-08-10T10:33:16.630545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:29:24.347845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'3","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.638107+0000","last_change":"2023-08-10T10:30:33.323099+0000","last_active":"2023-08-10T10:32:44.638107+0000","last_peered":"2023-08-10T10:32:44.638107+0000","last_clean":"2023-08-10T10:32:44.638107+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:32:44.638107+0000","last_undegraded":"2023-08-10T10:32:44.638107+0000","last_fullsized":"2023-08-10T10:32:44.638107+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:06:37.634596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.558852+0000","last_change":"2023-08-10T10:30:28.287805+0000","last_active":"2023-08-10T10:31:15.558852+0000","last_peered":"2023-08-10T10:31:15.558852+0000","last_clean":"2023-08-10T10:31:15.558852+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:31:15.558852+0000","last_undegraded":"2023-08-10T10:31:15.558852+0000","last_fullsized":"2023-08-10T10:31:15.558852+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:50:39.076142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979971+0000","last_change":"2023-08-10T10:30:34.334552+0000","last_active":"2023-08-10T10:33:19.979971+0000","last_peered":"2023-08-10T10:33:19.979971+0000","last_clean":"2023-08-10T10:33:19.979971+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:19.979971+0000","last_undegraded":"2023-08-10T10:33:19.979971+0000","last_fullsized":"2023-08-10T10:33:19.979971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:41.589758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.637452+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.637452+0000","last_peered":"2023-08-10T10:33:16.637452+0000","last_clean":"2023-08-10T10:33:16.637452+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.637452+0000","last_undegraded":"2023-08-10T10:33:16.637452+0000","last_fullsized":"2023-08-10T10:33:16.637452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:11.307754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:16.132519+0000","last_change":"2023-08-10T10:30:28.288575+0000","last_active":"2023-08-10T10:31:16.132519+0000","last_peered":"2023-08-10T10:31:16.132519+0000","last_clean":"2023-08-10T10:31:16.132519+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:31:16.132519+0000","last_undegraded":"2023-08-10T10:31:16.132519+0000","last_fullsized":"2023-08-10T10:31:16.132519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:27.266799+0000","last_clean_scrub_stamp":"2023-08-10T10:30:27.266799+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:17:08.866697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'13","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:23.522471+0000","last_change":"2023-08-10T10:30:33.322724+0000","last_active":"2023-08-10T10:33:23.522471+0000","last_peered":"2023-08-10T10:33:23.522471+0000","last_clean":"2023-08-10T10:33:23.522471+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:23.522471+0000","last_undegraded":"2023-08-10T10:33:23.522471+0000","last_fullsized":"2023-08-10T10:33:23.522471+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'22","reported_seq":46,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.987761+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:19.987761+0000","last_peered":"2023-08-10T10:33:19.987761+0000","last_clean":"2023-08-10T10:33:19.987761+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:19.987761+0000","last_undegraded":"2023-08-10T10:33:19.987761+0000","last_fullsized":"2023-08-10T10:33:19.987761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:56:22.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'436","reported_seq":454,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.819538+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:33:19.819538+0000","last_peered":"2023-08-10T10:33:19.819538+0000","last_clean":"2023-08-10T10:33:19.819538+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:19.819538+0000","last_undegraded":"2023-08-10T10:33:19.819538+0000","last_fullsized":"2023-08-10T10:33:19.819538+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:29:14.330929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.634322+0000","last_change":"2023-08-10T10:30:33.323794+0000","last_active":"2023-08-10T10:33:04.634322+0000","last_peered":"2023-08-10T10:33:04.634322+0000","last_clean":"2023-08-10T10:33:04.634322+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:33:04.634322+0000","last_undegraded":"2023-08-10T10:33:04.634322+0000","last_fullsized":"2023-08-10T10:33:04.634322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.974595+0000","last_change":"2023-08-10T10:30:34.332359+0000","last_active":"2023-08-10T10:33:19.974595+0000","last_peered":"2023-08-10T10:33:19.974595+0000","last_clean":"2023-08-10T10:33:19.974595+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:19.974595+0000","last_undegraded":"2023-08-10T10:33:19.974595+0000","last_fullsized":"2023-08-10T10:33:19.974595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:31:24.648299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.625704+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:16.625704+0000","last_peered":"2023-08-10T10:33:16.625704+0000","last_clean":"2023-08-10T10:33:16.625704+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:16.625704+0000","last_undegraded":"2023-08-10T10:33:16.625704+0000","last_fullsized":"2023-08-10T10:33:16.625704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.340816+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:31:15.340816+0000","last_peered":"2023-08-10T10:31:15.340816+0000","last_clean":"2023-08-10T10:31:15.340816+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:31:15.340816+0000","last_undegraded":"2023-08-10T10:31:15.340816+0000","last_fullsized":"2023-08-10T10:31:15.340816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:04:06.246295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'24","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993575+0000","last_change":"2023-08-10T10:30:34.336510+0000","last_active":"2023-08-10T10:33:19.993575+0000","last_peered":"2023-08-10T10:33:19.993575+0000","last_clean":"2023-08-10T10:33:19.993575+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:19.993575+0000","last_undegraded":"2023-08-10T10:33:19.993575+0000","last_fullsized":"2023-08-10T10:33:19.993575+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:13:37.002252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":502,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664108+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:16.664108+0000","last_peered":"2023-08-10T10:33:16.664108+0000","last_clean":"2023-08-10T10:33:16.664108+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:16.664108+0000","last_undegraded":"2023-08-10T10:33:16.664108+0000","last_fullsized":"2023-08-10T10:33:16.664108+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:48:43.610752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":30,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.646564+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:33:04.646564+0000","last_peered":"2023-08-10T10:33:04.646564+0000","last_clean":"2023-08-10T10:33:04.646564+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:04.646564+0000","last_undegraded":"2023-08-10T10:33:04.646564+0000","last_fullsized":"2023-08-10T10:33:04.646564+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:03:40.583082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'23","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993957+0000","last_change":"2023-08-10T10:30:34.341421+0000","last_active":"2023-08-10T10:33:19.993957+0000","last_peered":"2023-08-10T10:33:19.993957+0000","last_clean":"2023-08-10T10:33:19.993957+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:19.993957+0000","last_undegraded":"2023-08-10T10:33:19.993957+0000","last_fullsized":"2023-08-10T10:33:19.993957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:15:13.451737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'470","reported_seq":488,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686859+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:16.686859+0000","last_peered":"2023-08-10T10:33:16.686859+0000","last_clean":"2023-08-10T10:33:16.686859+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:16.686859+0000","last_undegraded":"2023-08-10T10:33:16.686859+0000","last_fullsized":"2023-08-10T10:33:16.686859+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:26:55.702996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:31:15.298977+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:31:15.298977+0000","last_peered":"2023-08-10T10:31:15.298977+0000","last_clean":"2023-08-10T10:31:15.298977+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:31:15.298977+0000","last_undegraded":"2023-08-10T10:31:15.298977+0000","last_fullsized":"2023-08-10T10:31:15.298977+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:23:25.782734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'32","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979852+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:19.979852+0000","last_peered":"2023-08-10T10:33:19.979852+0000","last_clean":"2023-08-10T10:33:19.979852+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:19.979852+0000","last_undegraded":"2023-08-10T10:33:19.979852+0000","last_fullsized":"2023-08-10T10:33:19.979852+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:04:04.014553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'462","reported_seq":480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.663160+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:33:16.663160+0000","last_peered":"2023-08-10T10:33:16.663160+0000","last_clean":"2023-08-10T10:33:16.663160+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:16.663160+0000","last_undegraded":"2023-08-10T10:33:16.663160+0000","last_fullsized":"2023-08-10T10:33:16.663160+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:40:59.704514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'5","reported_seq":32,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.574842+0000","last_change":"2023-08-10T10:30:33.326455+0000","last_active":"2023-08-10T10:32:59.574842+0000","last_peered":"2023-08-10T10:32:59.574842+0000","last_clean":"2023-08-10T10:32:59.574842+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:32:59.574842+0000","last_undegraded":"2023-08-10T10:32:59.574842+0000","last_fullsized":"2023-08-10T10:32:59.574842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991957+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:33:19.991957+0000","last_peered":"2023-08-10T10:33:19.991957+0000","last_clean":"2023-08-10T10:33:19.991957+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:19.991957+0000","last_undegraded":"2023-08-10T10:33:19.991957+0000","last_fullsized":"2023-08-10T10:33:19.991957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:34:36.250911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'48","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.976637+0000","last_change":"2023-08-10T10:30:34.346989+0000","last_active":"2023-08-10T10:33:19.976637+0000","last_peered":"2023-08-10T10:33:19.976637+0000","last_clean":"2023-08-10T10:33:19.976637+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:19.976637+0000","last_undegraded":"2023-08-10T10:33:19.976637+0000","last_fullsized":"2023-08-10T10:33:19.976637+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:11:38.929183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'46","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982684+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:19.982684+0000","last_peered":"2023-08-10T10:33:19.982684+0000","last_clean":"2023-08-10T10:33:19.982684+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:19.982684+0000","last_undegraded":"2023-08-10T10:33:19.982684+0000","last_fullsized":"2023-08-10T10:33:19.982684+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:51:32.542002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'34","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.990948+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:19.990948+0000","last_peered":"2023-08-10T10:33:19.990948+0000","last_clean":"2023-08-10T10:33:19.990948+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:19.990948+0000","last_undegraded":"2023-08-10T10:33:19.990948+0000","last_fullsized":"2023-08-10T10:33:19.990948+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:36:09.195453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975937+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:19.975937+0000","last_peered":"2023-08-10T10:33:19.975937+0000","last_clean":"2023-08-10T10:33:19.975937+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:19.975937+0000","last_undegraded":"2023-08-10T10:33:19.975937+0000","last_fullsized":"2023-08-10T10:33:19.975937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:14:40.885396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'31","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.970391+0000","last_change":"2023-08-10T10:30:34.345046+0000","last_active":"2023-08-10T10:33:19.970391+0000","last_peered":"2023-08-10T10:33:19.970391+0000","last_clean":"2023-08-10T10:33:19.970391+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:19.970391+0000","last_undegraded":"2023-08-10T10:33:19.970391+0000","last_fullsized":"2023-08-10T10:33:19.970391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:28:50.315476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":111149056,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":1076224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222298112,"data_stored":222298112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14883,"ondisk_log_size":14883,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2091728,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":686,"num_write_kb":2529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4243456,"data_stored":4183456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":684,"ondisk_log_size":684,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76556,"kb_used_data":41348,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94295284,"statfs":{"total":96636764160,"available":96558370816,"internally_reserved":0,"allocated":42340352,"data_stored":42129537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.6759999999999999,"5min":0.83999999999999997,"15min":0.69999999999999996},"min":{"1min":0.40300000000000002,"5min":0.375,"15min":0.375},"max":{"1min":9.3949999999999996,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.66400000000000003},{"interface":"front","average":{"1min":2.4889999999999999,"5min":0.96499999999999997,"15min":0.71099999999999997},"min":{"1min":0.41399999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":22.190999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5209999999999999,"5min":0.78800000000000003,"15min":0.66600000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":9.5,"5min":9.5,"15min":9.5},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.3129999999999999,"5min":0.82099999999999995,"15min":0.73899999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":11.577999999999999,"5min":11.577999999999999,"15min":11.577999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":2.0950000000000002,"5min":1.03,"15min":0.85199999999999998},"min":{"1min":0.50700000000000001,"5min":0.502,"15min":0.502},"max":{"1min":21.042999999999999,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":2.4300000000000002,"5min":1.0609999999999999,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":22.148,"5min":22.148,"15min":22.148},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":0.84699999999999998,"15min":0.73299999999999998},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":10.237,"5min":10.237,"15min":10.237},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.8240000000000001,"5min":0.98799999999999999,"15min":0.84899999999999998},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":9.4320000000000004,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":0.81899999999999995,"15min":0.72499999999999998},"min":{"1min":0.46200000000000002,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":7.4500000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.911,"5min":0.93300000000000005,"15min":0.77000000000000002},"min":{"1min":0.45600000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.779,"5min":11.779,"15min":11.779},"last":0.75}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":0.83999999999999997,"15min":0.80300000000000005},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":7.3700000000000001,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.441},{"interface":"front","average":{"1min":1.5309999999999999,"5min":0.93100000000000005,"15min":0.83099999999999996},"min":{"1min":0.53300000000000003,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":9.1950000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.50800000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.4830000000000001,"5min":0.93600000000000005,"15min":0.84499999999999997},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":7.5129999999999999,"5min":7.5129999999999999,"15min":7.5129999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.389,"5min":0.85099999999999998,"15min":0.76100000000000001},"min":{"1min":0.56399999999999995,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":7.3460000000000001,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.47999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":17616896,"data_stored":17435679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.0510000000000002,"5min":0.98699999999999999,"15min":0.80900000000000005},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":9.5030000000000001,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":2.569,"5min":1.1259999999999999,"15min":0.88600000000000001},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":10.914,"5min":10.914,"15min":10.914},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.1200000000000001,"5min":1.2130000000000001,"15min":0.89500000000000002},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":14.93,"5min":14.93,"15min":14.93},"last":0.78900000000000003},{"interface":"front","average":{"1min":2.6419999999999999,"5min":1.1299999999999999,"15min":0.878},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":10.957000000000001,"5min":10.957000000000001,"15min":10.957000000000001},"last":0.495}]},{"osd":2,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":3.266,"5min":1.218,"15min":0.877},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":19.654,"5min":19.654,"15min":19.654},"last":0.626},{"interface":"front","average":{"1min":2.6139999999999999,"5min":1.1060000000000001,"15min":0.85399999999999998},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":12.848000000000001,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.751}]},{"osd":3,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":1.206,"15min":0.91300000000000003},"min":{"1min":0.50800000000000001,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":10.987,"5min":10.987,"15min":10.987},"last":0.59599999999999997},{"interface":"front","average":{"1min":3.7080000000000002,"5min":1.3680000000000001,"15min":0.97799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":19.907,"5min":19.907,"15min":19.907},"last":0.66700000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":0.88500000000000001,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.433,"15min":0.433},"max":{"1min":5.9630000000000001,"5min":5.9630000000000001,"15min":5.9630000000000001},"last":0.81299999999999994},{"interface":"front","average":{"1min":1.421,"5min":0.84899999999999998,"15min":0.754},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":6.7199999999999998,"5min":6.7199999999999998,"15min":6.7199999999999998},"last":0.71299999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.8140000000000001,"5min":0.91800000000000004,"15min":0.76800000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":6.0510000000000002,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.524,"5min":0.90300000000000002,"15min":0.79900000000000004},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.83699999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:32:22 2023","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":0.93300000000000005,"15min":0.81899999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":5.577,"5min":5.577,"15min":5.577},"last":0.77000000000000002},{"interface":"front","average":{"1min":2.0739999999999998,"5min":1.026,"15min":0.85099999999999998},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":8.1639999999999997,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.73299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66748,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94305092,"statfs":{"total":96636764160,"available":96568414208,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.70199999999999996,"5min":0.47699999999999998,"15min":0.439},"min":{"1min":0.34899999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":2.2709999999999999,"5min":2.2709999999999999,"15min":2.2709999999999999},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.50900000000000001,"15min":0.46300000000000002},"min":{"1min":0.40200000000000002,"5min":0.308,"15min":0.308},"max":{"1min":2.012,"5min":2.012,"15min":2.012},"last":0.43099999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":0.58799999999999997,"15min":0.499},"min":{"1min":0.371,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":8.016,"5min":8.016,"15min":8.016},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.59099999999999997,"15min":0.54800000000000004},"min":{"1min":0.435,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.8979999999999999,"5min":1.8979999999999999,"15min":1.8979999999999999},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.60499999999999998,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.8959999999999999,"5min":1.8959999999999999,"15min":1.8959999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.56599999999999995,"15min":0.52200000000000002},"min":{"1min":0.42399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.55700000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":0.88,"15min":0.77600000000000002},"min":{"1min":0.56499999999999995,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":10.734,"5min":10.734,"15min":10.734},"last":0.60299999999999998},{"interface":"front","average":{"1min":1.194,"5min":0.83799999999999997,"15min":0.77900000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":5.9059999999999997,"5min":5.9059999999999997,"15min":5.9059999999999997},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":0.88600000000000001,"15min":0.77800000000000002},"min":{"1min":0.59099999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":10.444000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":2.1619999999999999,"5min":1.0669999999999999,"15min":0.88500000000000001},"min":{"1min":0.60899999999999999,"5min":0.505,"15min":0.505},"max":{"1min":21.681999999999999,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":0.91300000000000003,"15min":0.83999999999999997},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":10.516,"5min":10.516,"15min":10.516},"last":0.73499999999999999},{"interface":"front","average":{"1min":1.4339999999999999,"5min":0.94199999999999995,"15min":0.85999999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":9.2629999999999999,"5min":9.2629999999999999,"15min":9.2629999999999999},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:32:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.873,"15min":0.84099999999999997},"min":{"1min":0.65200000000000002,"5min":0.622,"15min":0.622},"max":{"1min":3.6040000000000001,"5min":3.6040000000000001,"15min":3.6040000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.7,"5min":0.98199999999999998,"15min":0.86199999999999999},"min":{"1min":0.67900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":10.481,"5min":10.481,"15min":10.481},"last":0.78400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62216,"kb_used_data":27008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94309624,"statfs":{"total":96636764160,"available":96573054976,"internally_reserved":0,"allocated":27656192,"data_stored":27470546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.84499999999999997,"15min":0.67100000000000004},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":5.7590000000000003,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.317},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.35999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.8530000000000002,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.44}]},{"osd":2,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":0.96499999999999997,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.98199999999999998,"15min":0.91000000000000003},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0890000000000004,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.232,"15min":0.89100000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":19.68,"5min":19.68,"15min":19.68},"last":0.503},{"interface":"front","average":{"1min":1.681,"5min":1.0349999999999999,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.0579999999999998,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.3780000000000001,"5min":1.8560000000000001,"15min":1.4610000000000001},"min":{"1min":0.53800000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":44.292000000000002,"5min":44.292000000000002,"15min":44.292000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":4.6150000000000002,"5min":1.8740000000000001,"15min":1.238},"min":{"1min":0.48499999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":49.887999999999998,"5min":49.887999999999998,"15min":49.887999999999998},"last":0.69099999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":9.3859999999999992,"5min":2.516,"15min":1.3109999999999999},"min":{"1min":0.58399999999999996,"5min":0.434,"15min":0.434},"max":{"1min":127.655,"5min":127.655,"15min":127.655},"last":0.71099999999999997},{"interface":"front","average":{"1min":5.2610000000000001,"5min":1.895,"15min":1.3540000000000001},"min":{"1min":0.59799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":65.376000000000005,"5min":65.376000000000005,"15min":65.376000000000005},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":1.6000000000000001,"15min":1.1699999999999999},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":16.510000000000002,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":2.6019999999999999,"5min":1.429,"15min":0.97499999999999998},"min":{"1min":0.59399999999999997,"5min":0.499,"15min":0.499},"max":{"1min":16.331,"5min":16.331,"15min":16.331},"last":0.752}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":1.4770000000000001,"15min":1.216},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":8.9670000000000005,"5min":8.9670000000000005,"15min":8.9670000000000005},"last":0.75900000000000001},{"interface":"front","average":{"1min":2.4399999999999999,"5min":1.5509999999999999,"15min":1.1879999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":16.478000000000002,"5min":17.032,"15min":17.032},"last":0.80600000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":28468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":29151232,"data_stored":28970015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":0.83299999999999996,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":2.2269999999999999,"5min":0.88400000000000001,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":13.456,"5min":13.456,"15min":13.456},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.131,"15min":0.70999999999999996},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.066000000000001,"5min":15.066000000000001,"15min":15.066000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":1.8560000000000001,"5min":0.88,"15min":0.65200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.2029999999999994,"5min":9.2029999999999994,"15min":9.2029999999999994},"last":0.42199999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83699999999999997,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.7030000000000001,"5min":11.715,"15min":11.715},"last":0.47999999999999998},{"interface":"front","average":{"1min":2.2919999999999998,"5min":1.024,"15min":0.73799999999999999},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":15.997999999999999,"5min":15.997999999999999,"15min":15.997999999999999},"last":0.53300000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.0880000000000001,"5min":1.5840000000000001,"15min":0.99199999999999999},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":19.811,"5min":19.811,"15min":19.811},"last":0.58299999999999996},{"interface":"front","average":{"1min":1.659,"5min":1.1799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53600000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.002000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.71399999999999997}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":1.4219999999999999,"15min":0.97499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":16.045000000000002,"5min":16.045000000000002,"15min":16.045000000000002},"last":0.73099999999999998},{"interface":"front","average":{"1min":3.52,"5min":1.5960000000000001,"15min":1.04},"min":{"1min":0.63600000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":13.414999999999999,"5min":13.414999999999999,"15min":13.414999999999999},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":1.6339999999999999,"15min":1.042},"min":{"1min":0.54200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":20.692,"5min":20.692,"15min":20.692},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.2130000000000001,"5min":1.5109999999999999,"15min":1.0229999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.1519999999999992,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.9670000000000001,"5min":1.498,"15min":1.0369999999999999},"min":{"1min":0.54000000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":13.516,"5min":13.516,"15min":13.516},"last":0.69399999999999995},{"interface":"front","average":{"1min":2.6920000000000002,"5min":1.4119999999999999,"15min":0.98799999999999999},"min":{"1min":0.59599999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":20.757999999999999,"5min":20.757999999999999,"15min":20.757999999999999},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55488,"kb_used_data":24376,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94316352,"statfs":{"total":96636764160,"available":96579944448,"internally_reserved":0,"allocated":24961024,"data_stored":24775801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.629,"15min":0.59299999999999997},"min":{"1min":0.30099999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":4.2830000000000004,"5min":4.2830000000000004,"15min":4.2830000000000004},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.94599999999999995,"5min":0.62,"15min":0.56599999999999995},"min":{"1min":0.32500000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":0.375}]},{"osd":1,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":0.70499999999999996,"15min":0.59299999999999997},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.143000000000001,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2010000000000001,"15min":1.181},"min":{"1min":0.379,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":11.923,"5min":12.754,"15min":12.754},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":0.86399999999999999,"15min":0.73999999999999999},"min":{"1min":0.36599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":14.169,"5min":14.169,"15min":14.169},"last":0.32800000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":0.93500000000000005,"15min":0.79600000000000004},"min":{"1min":0.39200000000000002,"5min":0.377,"15min":0.377},"max":{"1min":16.927,"5min":16.927,"15min":16.927},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.659,"5min":0.93200000000000005,"15min":0.81100000000000005},"min":{"1min":0.51500000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.89000000000000001},{"interface":"front","average":{"1min":2.1579999999999999,"5min":1.014,"15min":0.82399999999999995},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":12.465999999999999,"5min":12.465999999999999,"15min":12.465999999999999},"last":0.63100000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.581,"5min":0.92000000000000004,"15min":0.81000000000000005},"min":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":11.050000000000001,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":2.2370000000000001,"5min":1.0940000000000001,"15min":0.90400000000000003},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":17.664000000000001,"5min":17.664000000000001,"15min":17.664000000000001},"last":0.73699999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":1.111,"15min":0.90600000000000003},"min":{"1min":0.58399999999999996,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":16.919,"5min":16.919,"15min":16.919},"last":0.84999999999999998},{"interface":"front","average":{"1min":2.1139999999999999,"5min":1.0580000000000001,"15min":0.88200000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":12.504,"5min":12.504,"15min":12.504},"last":0.67300000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:32:24 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":0.93799999999999994,"15min":0.86199999999999999},"min":{"1min":0.57499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":6.2969999999999997,"5min":6.2969999999999997,"15min":6.2969999999999997},"last":0.82799999999999996},{"interface":"front","average":{"1min":2.4390000000000001,"5min":1.1459999999999999,"15min":0.93000000000000005},"min":{"1min":0.64100000000000001,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":16.977,"5min":16.977,"15min":16.977},"last":0.95799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64712,"kb_used_data":29504,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94307128,"statfs":{"total":96636764160,"available":96570499072,"internally_reserved":0,"allocated":30212096,"data_stored":30012425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0110000000000001,"5min":0.94299999999999995,"15min":0.76500000000000001},"min":{"1min":0.49199999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":19.064,"5min":19.064,"15min":19.064},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.109,"15min":0.94999999999999996},"min":{"1min":0.41999999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":11.238,"5min":11.238,"15min":11.238},"last":0.81399999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1099999999999999,"5min":1.0629999999999999,"15min":0.88900000000000001},"min":{"1min":0.60099999999999998,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":12.042999999999999,"5min":12.042999999999999,"15min":12.042999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":2.722,"5min":1.242,"15min":0.996},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":19.033999999999999,"5min":19.033999999999999,"15min":19.033999999999999},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":2.1760000000000002,"5min":1.014,"15min":0.81999999999999995},"min":{"1min":0.52300000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":18.948,"5min":18.948,"15min":18.948},"last":0.746},{"interface":"front","average":{"1min":1.8300000000000001,"5min":1.1879999999999999,"15min":1.081},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":11.000999999999999,"5min":11.000999999999999,"15min":11.000999999999999},"last":0.89300000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.966,"5min":1.0189999999999999,"15min":0.86099999999999999},"min":{"1min":0.46200000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":11.279,"5min":11.279,"15min":11.279},"last":0.875},{"interface":"front","average":{"1min":1.5960000000000001,"5min":0.96799999999999997,"15min":0.86299999999999999},"min":{"1min":0.64100000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":10.962999999999999,"5min":10.962999999999999,"15min":10.962999999999999},"last":0.73099999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8240000000000001,"5min":1.073,"15min":0.94799999999999995},"min":{"1min":0.45900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":19,"5min":19,"15min":19},"last":0.46600000000000003},{"interface":"front","average":{"1min":1.0009999999999999,"5min":0.84899999999999998,"15min":0.82399999999999995},"min":{"1min":0.52500000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.4100000000000001,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.446,"15min":1.458},"min":{"1min":0.505,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":11.029,"5min":12.381,"15min":12.381},"last":0.67600000000000005},{"interface":"front","average":{"1min":1.5369999999999999,"5min":0.96099999999999997,"15min":0.86499999999999999},"min":{"1min":0.54700000000000004,"5min":0.441,"15min":0.441},"max":{"1min":8.5950000000000006,"5min":8.5950000000000006,"15min":8.5950000000000006},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:32:23 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":0.91600000000000004,"15min":0.89400000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":2.448,"5min":2.6920000000000002,"15min":2.6920000000000002},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1479999999999999,"5min":0.89200000000000002,"15min":0.84999999999999998},"min":{"1min":0.56499999999999995,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":5.9619999999999997,"5min":5.9619999999999997,"15min":5.9619999999999997},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56516,"kb_used_data":25404,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94315324,"statfs":{"total":96636764160,"available":96578891776,"internally_reserved":0,"allocated":26013696,"data_stored":25824939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2729999999999997,"5min":1.6970000000000001,"15min":1.2410000000000001},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":2.4340000000000002,"5min":1.3720000000000001,"15min":1.133},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":12.596,"5min":12.596,"15min":12.596},"last":0.56599999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.8919999999999999,"5min":1.764,"15min":1.3680000000000001},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":20.193999999999999,"5min":20.193999999999999,"15min":20.193999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":3.552,"5min":1.6240000000000001,"15min":1.202},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.708,"5min":15.708,"15min":15.708},"last":0.64100000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1890000000000001,"5min":1.4470000000000001,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.949,"5min":10.949,"15min":10.949},"last":0.68600000000000005},{"interface":"front","average":{"1min":4.1619999999999999,"5min":1.5960000000000001,"15min":1.198},"min":{"1min":0.499,"5min":0.435,"15min":0.435},"max":{"1min":20.224,"5min":20.224,"15min":20.224},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.242,"15min":1.1379999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.83699999999999997},{"interface":"front","average":{"1min":5.1600000000000001,"5min":1.968,"15min":1.514},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":20.114999999999998,"5min":20.114999999999998,"15min":20.114999999999998},"last":0.61799999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3250000000000002,"5min":0.97499999999999998,"15min":0.73099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":15.784000000000001,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.84499999999999997,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.77400000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":0.92800000000000005,"15min":0.73199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.67400000000000004},{"interface":"front","average":{"1min":2.3149999999999999,"5min":1.0109999999999999,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":15.815,"5min":15.815,"15min":15.815},"last":0.753}]},{"osd":7,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.012,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":3.456,"5min":1.3120000000000001,"15min":0.94599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":20.161000000000001,"5min":20.161000000000001,"15min":20.161000000000001},"last":0.85999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2109440,"data_stored":2090986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2109440,"data_stored":2083394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26738688,"data_stored":26738688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28835840,"data_stored":28835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24641536,"data_stored":24641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27787264,"data_stored":27787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25690112,"data_stored":25690112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17301504,"data_stored":17301504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":39321600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:33:29.701 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.702 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.702 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.703 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.703 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.703 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.704 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.704 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.704 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.705 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.705 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.705 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.705 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.706 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.706 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.706 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.707 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.707 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.707 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.708 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.708 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.708 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.709 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.709 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.709 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.709 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.710 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.710 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.710 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.711 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.711 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.711 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.712 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.712 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.712 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.712 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.713 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.713 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.713 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.714 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.714 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.714 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.715 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.715 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.715 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.715 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.716 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.716 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.716 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.717 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.717 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.717 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.718 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.718 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.718 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.719 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.719 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.719 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.719 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.720 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.720 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.720 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.721 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.721 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.721 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.722 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.722 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.722 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.722 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.723 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.723 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.723 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.724 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.724 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.724 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.725 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.725 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.725 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.725 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.726 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.726 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.726 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.727 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.727 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.727 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.728 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.728 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.728 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.728 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.729 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.729 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.729 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.730 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.730 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.730 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.731 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.731 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.731 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.731 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-10T10:30:19.762092+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=19, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.732 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.732 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.732 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.733 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.733 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.733 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.734 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.734 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.734 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.735 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.735 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.735 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.735 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.736 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.736 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.736 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-10T10:30:27.266799+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=27, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.737 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.737 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.737 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.738 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.738 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.738 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.739 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.739 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.739 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.739 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.740 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.740 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.740 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.741 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.741 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.741 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.742 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.742 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.742 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.743 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.743 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.743 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:29.743 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-10T10:33:49.747 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:33:49.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.954+0000 7f748efff700 1 Processor -- start 2023-08-10T10:33:49.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.954+0000 7f748efff700 1 -- start start 2023-08-10T10:33:49.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f748815ad10 0x7f748806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f748806b770 0x7f74880b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74880b23f0 0x7f7488070990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880c9890 con 0x7f748815ad10 2023-08-10T10:33:49.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74880b2840 con 0x7f748806b770 2023-08-10T10:33:49.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.955+0000 7f748efff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f748815f820 con 0x7f74880b23f0 2023-08-10T10:33:49.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f748815ad10 0x7f748806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:49.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f748815ad10 0x7f748806b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33466/0 (socket says 172.21.15.88:33466) 2023-08-10T10:33:49.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 -- 172.21.15.88:0/3019337696 learned_addr learned my addr 172.21.15.88:0/3019337696 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:49.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 -- 172.21.15.88:0/3019337696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74880b23f0 msgr2=0x7f7488070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:49.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 --2- 172.21.15.88:0/3019337696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74880b23f0 0x7f7488070990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 -- 172.21.15.88:0/3019337696 >> v2:172.21.15.187:3300/0 conn(0x7f748806b770 msgr2=0x7f74880b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:33:49.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 --2- 172.21.15.88:0/3019337696 >> v2:172.21.15.187:3300/0 conn(0x7f748806b770 0x7f74880b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 -- 172.21.15.88:0/3019337696 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f748815f540 con 0x7f748815ad10 2023-08-10T10:33:49.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f748cd9b700 1 --2- 172.21.15.88:0/3019337696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748815ad10 0x7f748806b230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f74880cea10 tx=0x7f747c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94ed30826c653187 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:49.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f74877fe700 1 -- 172.21.15.88:0/3019337696 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00b870 con 0x7f748815ad10 2023-08-10T10:33:49.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f74877fe700 1 -- 172.21.15.88:0/3019337696 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c00b9d0 con 0x7f748815ad10 2023-08-10T10:33:49.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.956+0000 7f74877fe700 1 -- 172.21.15.88:0/3019337696 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c00bd60 con 0x7f748815ad10 2023-08-10T10:33:49.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 -- 172.21.15.88:0/3019337696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748815ad10 msgr2=0x7f748806b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:49.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 --2- 172.21.15.88:0/3019337696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748815ad10 0x7f748806b230 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f74880cea10 tx=0x7f747c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 -- 172.21.15.88:0/3019337696 shutdown_connections 2023-08-10T10:33:49.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 --2- 172.21.15.88:0/3019337696 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74880b23f0 0x7f7488070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 --2- 172.21.15.88:0/3019337696 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748815ad10 0x7f748806b230 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 --2- 172.21.15.88:0/3019337696 >> v2:172.21.15.187:3300/0 conn(0x7f748806b770 0x7f74880b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 -- 172.21.15.88:0/3019337696 >> 172.21.15.88:0/3019337696 conn(0x7f74880ced50 msgr2=0x7f74880cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:49.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 -- 172.21.15.88:0/3019337696 shutdown_connections 2023-08-10T10:33:49.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.957+0000 7f748efff700 1 -- 172.21.15.88:0/3019337696 wait complete. 2023-08-10T10:33:49.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.959+0000 7f748efff700 1 Processor -- start 2023-08-10T10:33:49.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.959+0000 7f748efff700 1 -- start start 2023-08-10T10:33:49.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 0x7f7488159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.964 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748815ad10 0x7f748815e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880af940 con 0x7f748806b770 2023-08-10T10:33:49.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74880adaf0 con 0x7f74880b23f0 2023-08-10T10:33:49.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748efff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74880addd0 con 0x7f748815ad10 2023-08-10T10:33:49.965 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:49.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:33470/0 (socket says 172.21.15.88:33470) 2023-08-10T10:33:49.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 -- 172.21.15.88:0/622836287 learned_addr learned my addr 172.21.15.88:0/622836287 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:33:49.966 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748d59c700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748815ad10 0x7f748815e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:49.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f7487fff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 0x7f7488159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:49.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 -- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748815ad10 msgr2=0x7f748815e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:49.967 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748815ad10 0x7f748815e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 -- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 msgr2=0x7f7488159fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:49.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 0x7f7488159fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:49.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f748cd9b700 1 -- 172.21.15.88:0/622836287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c009550 con 0x7f748806b770 2023-08-10T10:33:49.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.960+0000 7f7487fff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 0x7f7488159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:33:49.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f748cd9b700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f748806eda0 tx=0x7f747c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:49.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c004310 con 0x7f748806b770 2023-08-10T10:33:49.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747c01f070 con 0x7f748806b770 2023-08-10T10:33:49.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c0036a0 con 0x7f748806b770 2023-08-10T10:33:49.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74880ae0b0 con 0x7f748806b770 2023-08-10T10:33:49.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.961+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74880ae670 con 0x7f748806b770 2023-08-10T10:33:49.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.962+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7488066640 con 0x7f748806b770 2023-08-10T10:33:49.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.964+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f747c021030 con 0x7f748806b770 2023-08-10T10:33:49.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.965+0000 7f74857fa700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 0x7f746c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:33:49.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.965+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f747c08acf0 con 0x7f748806b770 2023-08-10T10:33:49.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.965+0000 7f7487fff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 0x7f746c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:33:49.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.966+0000 7f7487fff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 0x7f746c06d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74880c8520 tx=0x7f7474008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:33:49.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:49.970+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f747c055b80 con 0x7f748806b770 2023-08-10T10:33:50.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.159+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f748806a750 con 0x7f746c06ace0 2023-08-10T10:33:50.171 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.170+0000 7f74857fa700 1 -- 172.21.15.88:0/622836287 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+389169 (secure 0 0 0) 0x7f747400ad30 con 0x7f746c06ace0 2023-08-10T10:33:50.178 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:33:50.181 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 msgr2=0x7f746c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 0x7f746c06d1a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f74880c8520 tx=0x7f7474008040 comp rx=0 tx=0).stop 2023-08-10T10:33:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 msgr2=0x7f74880ce2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:33:50.182 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f748806eda0 tx=0x7f747c004750 comp rx=0 tx=0).stop 2023-08-10T10:33:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 shutdown_connections 2023-08-10T10:33:50.183 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f746c06ace0 0x7f746c06d1a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:50.184 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f748815ad10 0x7f748815e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f748806b770 0x7f74880ce2c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 --2- 172.21.15.88:0/622836287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74880b23f0 0x7f7488159fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:33:50.185 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 >> 172.21.15.88:0/622836287 conn(0x7f74880ced50 msgr2=0x7f74880b3390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:33:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 shutdown_connections 2023-08-10T10:33:50.186 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:33:50.175+0000 7f748efff700 1 -- 172.21.15.88:0/622836287 wait complete. 2023-08-10T10:33:50.187 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:33:50.194 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2023-08-10T10:33:49.609962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113890039,"num_objects":53,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":1382,"num_write_kb":1081239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17769,"ondisk_log_size":17769,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":494340,"kb_used_data":224964,"kb_used_omap":13,"kb_used_meta":269298,"kb_avail":754480380,"statfs":{"total":773094113280,"available":772587909120,"internally_reserved":0,"allocated":230363136,"data_stored":228852459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":275761240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":12377,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003513"},"pg_stats":[{"pgid":"4.3f","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.883026+0000","last_change":"2023-08-10T10:33:36.883077+0000","last_active":"2023-08-10T10:33:36.883026+0000","last_peered":"2023-08-10T10:33:36.883026+0000","last_clean":"2023-08-10T10:33:36.883026+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:36.883026+0000","last_undegraded":"2023-08-10T10:33:36.883026+0000","last_fullsized":"2023-08-10T10:33:36.883026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.882946+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:55.798064+0000","scrub_duration":0.001698803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975771+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:19.975771+0000","last_peered":"2023-08-10T10:33:19.975771+0000","last_clean":"2023-08-10T10:33:19.975771+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:19.975771+0000","last_undegraded":"2023-08-10T10:33:19.975771+0000","last_fullsized":"2023-08-10T10:33:19.975771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989909+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:19.989909+0000","last_peered":"2023-08-10T10:33:19.989909+0000","last_clean":"2023-08-10T10:33:19.989909+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:19.989909+0000","last_undegraded":"2023-08-10T10:33:19.989909+0000","last_fullsized":"2023-08-10T10:33:19.989909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'24","reported_seq":49,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979696+0000","last_change":"2023-08-10T10:30:34.345698+0000","last_active":"2023-08-10T10:33:19.979696+0000","last_peered":"2023-08-10T10:33:19.979696+0000","last_clean":"2023-08-10T10:33:19.979696+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:19.979696+0000","last_undegraded":"2023-08-10T10:33:19.979696+0000","last_fullsized":"2023-08-10T10:33:19.979696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.899724+0000","last_change":"2023-08-10T10:33:25.899769+0000","last_active":"2023-08-10T10:33:25.899724+0000","last_peered":"2023-08-10T10:33:25.899724+0000","last_clean":"2023-08-10T10:33:25.899724+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:25.899724+0000","last_undegraded":"2023-08-10T10:33:25.899724+0000","last_fullsized":"2023-08-10T10:33:25.899724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.899655+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.048352+0000","scrub_duration":0.001506755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'38","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991091+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:19.991091+0000","last_peered":"2023-08-10T10:33:19.991091+0000","last_clean":"2023-08-10T10:33:19.991091+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:19.991091+0000","last_undegraded":"2023-08-10T10:33:19.991091+0000","last_fullsized":"2023-08-10T10:33:19.991091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971430+0000","last_change":"2023-08-10T10:30:34.330023+0000","last_active":"2023-08-10T10:33:19.971430+0000","last_peered":"2023-08-10T10:33:19.971430+0000","last_clean":"2023-08-10T10:33:19.971430+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:19.971430+0000","last_undegraded":"2023-08-10T10:33:19.971430+0000","last_fullsized":"2023-08-10T10:33:19.971430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979049+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:19.979049+0000","last_peered":"2023-08-10T10:33:19.979049+0000","last_clean":"2023-08-10T10:33:19.979049+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:19.979049+0000","last_undegraded":"2023-08-10T10:33:19.979049+0000","last_fullsized":"2023-08-10T10:33:19.979049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979468+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:19.979468+0000","last_peered":"2023-08-10T10:33:19.979468+0000","last_clean":"2023-08-10T10:33:19.979468+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:19.979468+0000","last_undegraded":"2023-08-10T10:33:19.979468+0000","last_fullsized":"2023-08-10T10:33:19.979468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'44","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.066157+0000","last_change":"2023-08-10T10:33:30.066237+0000","last_active":"2023-08-10T10:33:30.066157+0000","last_peered":"2023-08-10T10:33:30.066157+0000","last_clean":"2023-08-10T10:33:30.066157+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:30.066157+0000","last_undegraded":"2023-08-10T10:33:30.066157+0000","last_fullsized":"2023-08-10T10:33:30.066157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.066062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:46.020476+0000","scrub_duration":0.0021977630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.517329+0000","last_change":"2023-08-10T10:33:33.517379+0000","last_active":"2023-08-10T10:33:33.517329+0000","last_peered":"2023-08-10T10:33:33.517329+0000","last_clean":"2023-08-10T10:33:33.517329+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:33.517329+0000","last_undegraded":"2023-08-10T10:33:33.517329+0000","last_fullsized":"2023-08-10T10:33:33.517329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.517247+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:41.342304+0000","scrub_duration":0.002340221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.902165+0000","last_change":"2023-08-10T10:33:35.902217+0000","last_active":"2023-08-10T10:33:35.902165+0000","last_peered":"2023-08-10T10:33:35.902165+0000","last_clean":"2023-08-10T10:33:35.902165+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:35.902165+0000","last_undegraded":"2023-08-10T10:33:35.902165+0000","last_fullsized":"2023-08-10T10:33:35.902165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.902089+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:01.877768+0000","scrub_duration":0.0023654119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.879384+0000","last_change":"2023-08-10T10:33:31.879433+0000","last_active":"2023-08-10T10:33:31.879384+0000","last_peered":"2023-08-10T10:33:31.879384+0000","last_clean":"2023-08-10T10:33:31.879384+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:31.879384+0000","last_undegraded":"2023-08-10T10:33:31.879384+0000","last_fullsized":"2023-08-10T10:33:31.879384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.879295+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:47.686858+0000","scrub_duration":0.001582806,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.929484+0000","last_change":"2023-08-10T10:33:36.929535+0000","last_active":"2023-08-10T10:33:36.929484+0000","last_peered":"2023-08-10T10:33:36.929484+0000","last_clean":"2023-08-10T10:33:36.929484+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:36.929484+0000","last_undegraded":"2023-08-10T10:33:36.929484+0000","last_fullsized":"2023-08-10T10:33:36.929484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.929396+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:24.773523+0000","scrub_duration":0.0025361160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.971528+0000","last_change":"2023-08-10T10:30:34.329256+0000","last_active":"2023-08-10T10:33:19.971528+0000","last_peered":"2023-08-10T10:33:19.971528+0000","last_clean":"2023-08-10T10:33:19.971528+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:33:19.971528+0000","last_undegraded":"2023-08-10T10:33:19.971528+0000","last_fullsized":"2023-08-10T10:33:19.971528+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'38","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.992262+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:19.992262+0000","last_peered":"2023-08-10T10:33:19.992262+0000","last_clean":"2023-08-10T10:33:19.992262+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:19.992262+0000","last_undegraded":"2023-08-10T10:33:19.992262+0000","last_fullsized":"2023-08-10T10:33:19.992262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'36","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982407+0000","last_change":"2023-08-10T10:30:34.341640+0000","last_active":"2023-08-10T10:33:19.982407+0000","last_peered":"2023-08-10T10:33:19.982407+0000","last_clean":"2023-08-10T10:33:19.982407+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:33:19.982407+0000","last_undegraded":"2023-08-10T10:33:19.982407+0000","last_fullsized":"2023-08-10T10:33:19.982407+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.585707+0000","last_change":"2023-08-10T10:33:27.585762+0000","last_active":"2023-08-10T10:33:27.585707+0000","last_peered":"2023-08-10T10:33:27.585707+0000","last_clean":"2023-08-10T10:33:27.585707+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:27.585707+0000","last_undegraded":"2023-08-10T10:33:27.585707+0000","last_fullsized":"2023-08-10T10:33:27.585707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.585622+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:18.903219+0000","scrub_duration":0.0017968820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.813816+0000","last_change":"2023-08-10T10:33:39.813869+0000","last_active":"2023-08-10T10:33:39.813816+0000","last_peered":"2023-08-10T10:33:39.813816+0000","last_clean":"2023-08-10T10:33:39.813816+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:39.813816+0000","last_undegraded":"2023-08-10T10:33:39.813816+0000","last_fullsized":"2023-08-10T10:33:39.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.813733+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:37.309818+0000","scrub_duration":0.0023901679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.581199+0000","last_change":"2023-08-10T10:33:31.581251+0000","last_active":"2023-08-10T10:33:31.581199+0000","last_peered":"2023-08-10T10:33:31.581199+0000","last_clean":"2023-08-10T10:33:31.581199+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:31.581199+0000","last_undegraded":"2023-08-10T10:33:31.581199+0000","last_fullsized":"2023-08-10T10:33:31.581199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.581116+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:27.046813+0000","scrub_duration":0.0015992249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'41","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978489+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:19.978489+0000","last_peered":"2023-08-10T10:33:19.978489+0000","last_clean":"2023-08-10T10:33:19.978489+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:19.978489+0000","last_undegraded":"2023-08-10T10:33:19.978489+0000","last_fullsized":"2023-08-10T10:33:19.978489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.940798+0000","last_change":"2023-08-10T10:33:39.940853+0000","last_active":"2023-08-10T10:33:39.940798+0000","last_peered":"2023-08-10T10:33:39.940798+0000","last_clean":"2023-08-10T10:33:39.940798+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:39.940798+0000","last_undegraded":"2023-08-10T10:33:39.940798+0000","last_fullsized":"2023-08-10T10:33:39.940798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.940687+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:46.721896+0000","scrub_duration":0.00155013,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'35","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.161482+0000","last_change":"2023-08-10T10:33:31.161534+0000","last_active":"2023-08-10T10:33:31.161482+0000","last_peered":"2023-08-10T10:33:31.161482+0000","last_clean":"2023-08-10T10:33:31.161482+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:31.161482+0000","last_undegraded":"2023-08-10T10:33:31.161482+0000","last_fullsized":"2023-08-10T10:33:31.161482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.161398+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:36.341462+0000","scrub_duration":0.0014948749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'33","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.981594+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:19.981594+0000","last_peered":"2023-08-10T10:33:19.981594+0000","last_clean":"2023-08-10T10:33:19.981594+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:19.981594+0000","last_undegraded":"2023-08-10T10:33:19.981594+0000","last_fullsized":"2023-08-10T10:33:19.981594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.973693+0000","last_change":"2023-08-10T10:30:34.350084+0000","last_active":"2023-08-10T10:33:19.973693+0000","last_peered":"2023-08-10T10:33:19.973693+0000","last_clean":"2023-08-10T10:33:19.973693+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:19.973693+0000","last_undegraded":"2023-08-10T10:33:19.973693+0000","last_fullsized":"2023-08-10T10:33:19.973693+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'37","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975616+0000","last_change":"2023-08-10T10:30:34.337054+0000","last_active":"2023-08-10T10:33:19.975616+0000","last_peered":"2023-08-10T10:33:19.975616+0000","last_clean":"2023-08-10T10:33:19.975616+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:19.975616+0000","last_undegraded":"2023-08-10T10:33:19.975616+0000","last_fullsized":"2023-08-10T10:33:19.975616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.042561+0000","last_change":"2023-08-10T10:33:29.042633+0000","last_active":"2023-08-10T10:33:29.042561+0000","last_peered":"2023-08-10T10:33:29.042561+0000","last_clean":"2023-08-10T10:33:29.042561+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:29.042561+0000","last_undegraded":"2023-08-10T10:33:29.042561+0000","last_fullsized":"2023-08-10T10:33:29.042561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.042483+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.511552+0000","scrub_duration":0.001545306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'444","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593004+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:20.593004+0000","last_peered":"2023-08-10T10:33:20.593004+0000","last_clean":"2023-08-10T10:33:20.593004+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:20.593004+0000","last_undegraded":"2023-08-10T10:33:20.593004+0000","last_fullsized":"2023-08-10T10:33:20.593004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.651080+0000","last_change":"2023-08-10T10:30:33.321366+0000","last_active":"2023-08-10T10:33:04.651080+0000","last_peered":"2023-08-10T10:33:04.651080+0000","last_clean":"2023-08-10T10:33:04.651080+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:33:04.651080+0000","last_undegraded":"2023-08-10T10:33:04.651080+0000","last_fullsized":"2023-08-10T10:33:04.651080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982339+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:19.982339+0000","last_peered":"2023-08-10T10:33:19.982339+0000","last_clean":"2023-08-10T10:33:19.982339+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:19.982339+0000","last_undegraded":"2023-08-10T10:33:19.982339+0000","last_fullsized":"2023-08-10T10:33:19.982339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'473","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.616865+0000","last_change":"2023-08-10T10:30:38.403817+0000","last_active":"2023-08-10T10:33:20.616865+0000","last_peered":"2023-08-10T10:33:20.616865+0000","last_clean":"2023-08-10T10:33:20.616865+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:33:20.616865+0000","last_undegraded":"2023-08-10T10:33:20.616865+0000","last_fullsized":"2023-08-10T10:33:20.616865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.715152+0000","last_change":"2023-08-10T10:33:33.715201+0000","last_active":"2023-08-10T10:33:33.715152+0000","last_peered":"2023-08-10T10:33:33.715152+0000","last_clean":"2023-08-10T10:33:33.715152+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:33:33.715152+0000","last_undegraded":"2023-08-10T10:33:33.715152+0000","last_fullsized":"2023-08-10T10:33:33.715152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.715068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:04.044108+0000","scrub_duration":0.0015745259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.980936+0000","last_change":"2023-08-10T10:30:34.331467+0000","last_active":"2023-08-10T10:33:19.980936+0000","last_peered":"2023-08-10T10:33:19.980936+0000","last_clean":"2023-08-10T10:33:19.980936+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:19.980936+0000","last_undegraded":"2023-08-10T10:33:19.980936+0000","last_fullsized":"2023-08-10T10:33:19.980936+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'477","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.606501+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:20.606501+0000","last_peered":"2023-08-10T10:33:20.606501+0000","last_clean":"2023-08-10T10:33:20.606501+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:20.606501+0000","last_undegraded":"2023-08-10T10:33:20.606501+0000","last_fullsized":"2023-08-10T10:33:20.606501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:59.639866+0000","last_change":"2023-08-10T10:30:33.319463+0000","last_active":"2023-08-10T10:32:59.639866+0000","last_peered":"2023-08-10T10:32:59.639866+0000","last_clean":"2023-08-10T10:32:59.639866+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:32:59.639866+0000","last_undegraded":"2023-08-10T10:32:59.639866+0000","last_fullsized":"2023-08-10T10:32:59.639866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'30","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972089+0000","last_change":"2023-08-10T10:30:34.340214+0000","last_active":"2023-08-10T10:33:19.972089+0000","last_peered":"2023-08-10T10:33:19.972089+0000","last_clean":"2023-08-10T10:33:19.972089+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:19.972089+0000","last_undegraded":"2023-08-10T10:33:19.972089+0000","last_fullsized":"2023-08-10T10:33:19.972089+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":480,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.646383+0000","last_change":"2023-08-10T10:30:38.398255+0000","last_active":"2023-08-10T10:33:16.646383+0000","last_peered":"2023-08-10T10:33:16.646383+0000","last_clean":"2023-08-10T10:33:16.646383+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:33:16.646383+0000","last_undegraded":"2023-08-10T10:33:16.646383+0000","last_fullsized":"2023-08-10T10:33:16.646383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.008482+0000","last_change":"2023-08-10T10:33:34.008533+0000","last_active":"2023-08-10T10:33:34.008482+0000","last_peered":"2023-08-10T10:33:34.008482+0000","last_clean":"2023-08-10T10:33:34.008482+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:33:34.008482+0000","last_undegraded":"2023-08-10T10:33:34.008482+0000","last_fullsized":"2023-08-10T10:33:34.008482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.008392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:21.852519+0000","scrub_duration":0.002546034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'27","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.171650+0000","last_change":"2023-08-10T10:33:34.171704+0000","last_active":"2023-08-10T10:33:34.171650+0000","last_peered":"2023-08-10T10:33:34.171650+0000","last_clean":"2023-08-10T10:33:34.171650+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:34.171650+0000","last_undegraded":"2023-08-10T10:33:34.171650+0000","last_fullsized":"2023-08-10T10:33:34.171650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.171561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:40.952770+0000","scrub_duration":0.001549545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'465","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.605927+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:20.605927+0000","last_peered":"2023-08-10T10:33:20.605927+0000","last_clean":"2023-08-10T10:33:20.605927+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:20.605927+0000","last_undegraded":"2023-08-10T10:33:20.605927+0000","last_fullsized":"2023-08-10T10:33:20.605927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.573829+0000","last_change":"2023-08-10T10:30:33.327670+0000","last_active":"2023-08-10T10:33:04.573829+0000","last_peered":"2023-08-10T10:33:04.573829+0000","last_clean":"2023-08-10T10:33:04.573829+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:33:04.573829+0000","last_undegraded":"2023-08-10T10:33:04.573829+0000","last_fullsized":"2023-08-10T10:33:04.573829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'36","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979918+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:19.979918+0000","last_peered":"2023-08-10T10:33:19.979918+0000","last_clean":"2023-08-10T10:33:19.979918+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:19.979918+0000","last_undegraded":"2023-08-10T10:33:19.979918+0000","last_fullsized":"2023-08-10T10:33:19.979918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.682684+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.682684+0000","last_peered":"2023-08-10T10:33:16.682684+0000","last_clean":"2023-08-10T10:33:16.682684+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.682684+0000","last_undegraded":"2023-08-10T10:33:16.682684+0000","last_fullsized":"2023-08-10T10:33:16.682684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'12","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.620648+0000","last_change":"2023-08-10T10:30:33.326065+0000","last_active":"2023-08-10T10:33:20.620648+0000","last_peered":"2023-08-10T10:33:20.620648+0000","last_clean":"2023-08-10T10:33:20.620648+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:20.620648+0000","last_undegraded":"2023-08-10T10:33:20.620648+0000","last_fullsized":"2023-08-10T10:33:20.620648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'42","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.699136+0000","last_change":"2023-08-10T10:33:40.699214+0000","last_active":"2023-08-10T10:33:40.699136+0000","last_peered":"2023-08-10T10:33:40.699136+0000","last_clean":"2023-08-10T10:33:40.699136+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:40.699136+0000","last_undegraded":"2023-08-10T10:33:40.699136+0000","last_fullsized":"2023-08-10T10:33:40.699136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.699048+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:29.397615+0000","scrub_duration":0.0021018759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'455","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.604908+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:20.604908+0000","last_peered":"2023-08-10T10:33:20.604908+0000","last_clean":"2023-08-10T10:33:20.604908+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:20.604908+0000","last_undegraded":"2023-08-10T10:33:20.604908+0000","last_fullsized":"2023-08-10T10:33:20.604908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'625","reported_seq":652,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.529258+0000","last_change":"2023-08-10T10:30:33.322049+0000","last_active":"2023-08-10T10:33:38.529258+0000","last_peered":"2023-08-10T10:33:38.529258+0000","last_clean":"2023-08-10T10:33:38.529258+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:38.529258+0000","last_undegraded":"2023-08-10T10:33:38.529258+0000","last_fullsized":"2023-08-10T10:33:38.529258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":625,"log_dups_size":0,"ondisk_log_size":625,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142065,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.995794+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:19.995794+0000","last_peered":"2023-08-10T10:33:19.995794+0000","last_clean":"2023-08-10T10:33:19.995794+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:19.995794+0000","last_undegraded":"2023-08-10T10:33:19.995794+0000","last_fullsized":"2023-08-10T10:33:19.995794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":508,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.691722+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:16.691722+0000","last_peered":"2023-08-10T10:33:16.691722+0000","last_clean":"2023-08-10T10:33:16.691722+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:16.691722+0000","last_undegraded":"2023-08-10T10:33:16.691722+0000","last_fullsized":"2023-08-10T10:33:16.691722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:54.649054+0000","last_change":"2023-08-10T10:30:33.325452+0000","last_active":"2023-08-10T10:32:54.649054+0000","last_peered":"2023-08-10T10:32:54.649054+0000","last_clean":"2023-08-10T10:32:54.649054+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:32:54.649054+0000","last_undegraded":"2023-08-10T10:32:54.649054+0000","last_fullsized":"2023-08-10T10:32:54.649054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.233719+0000","last_change":"2023-08-10T10:33:28.233783+0000","last_active":"2023-08-10T10:33:28.233719+0000","last_peered":"2023-08-10T10:33:28.233719+0000","last_clean":"2023-08-10T10:33:28.233719+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:28.233719+0000","last_undegraded":"2023-08-10T10:33:28.233719+0000","last_fullsized":"2023-08-10T10:33:28.233719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.233641+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:16.077769+0000","scrub_duration":0.0020674529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'456","reported_seq":475,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.611815+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:20.611815+0000","last_peered":"2023-08-10T10:33:20.611815+0000","last_clean":"2023-08-10T10:33:20.611815+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:20.611815+0000","last_undegraded":"2023-08-10T10:33:20.611815+0000","last_fullsized":"2023-08-10T10:33:20.611815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.007534+0000","last_change":"2023-08-10T10:33:36.007599+0000","last_active":"2023-08-10T10:33:36.007534+0000","last_peered":"2023-08-10T10:33:36.007534+0000","last_clean":"2023-08-10T10:33:36.007534+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:33:36.007534+0000","last_undegraded":"2023-08-10T10:33:36.007534+0000","last_fullsized":"2023-08-10T10:33:36.007534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.007457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:24.706023+0000","scrub_duration":0.002469873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'33","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972828+0000","last_change":"2023-08-10T10:30:34.341683+0000","last_active":"2023-08-10T10:33:19.972828+0000","last_peered":"2023-08-10T10:33:19.972828+0000","last_clean":"2023-08-10T10:33:19.972828+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:33:19.972828+0000","last_undegraded":"2023-08-10T10:33:19.972828+0000","last_fullsized":"2023-08-10T10:33:19.972828+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:16.603925+0000","last_peered":"2023-08-10T10:33:16.603925+0000","last_clean":"2023-08-10T10:33:16.603925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:16.603925+0000","last_undegraded":"2023-08-10T10:33:16.603925+0000","last_fullsized":"2023-08-10T10:33:16.603925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:02.769226+0000","last_change":"2023-08-10T10:30:33.324764+0000","last_active":"2023-08-10T10:33:02.769226+0000","last_peered":"2023-08-10T10:33:02.769226+0000","last_clean":"2023-08-10T10:33:02.769226+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:02.769226+0000","last_undegraded":"2023-08-10T10:33:02.769226+0000","last_fullsized":"2023-08-10T10:33:02.769226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.985505+0000","last_change":"2023-08-10T10:30:34.338087+0000","last_active":"2023-08-10T10:33:19.985505+0000","last_peered":"2023-08-10T10:33:19.985505+0000","last_clean":"2023-08-10T10:33:19.985505+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:33:19.985505+0000","last_undegraded":"2023-08-10T10:33:19.985505+0000","last_fullsized":"2023-08-10T10:33:19.985505+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'510","reported_seq":529,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603792+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:20.603792+0000","last_peered":"2023-08-10T10:33:20.603792+0000","last_clean":"2023-08-10T10:33:20.603792+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:20.603792+0000","last_undegraded":"2023-08-10T10:33:20.603792+0000","last_fullsized":"2023-08-10T10:33:20.603792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.909944+0000","last_change":"2023-08-10T10:33:33.910006+0000","last_active":"2023-08-10T10:33:33.909944+0000","last_peered":"2023-08-10T10:33:33.909944+0000","last_clean":"2023-08-10T10:33:33.909944+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:33:33.909944+0000","last_undegraded":"2023-08-10T10:33:33.909944+0000","last_fullsized":"2023-08-10T10:33:33.909944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.909866+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:52.137280+0000","scrub_duration":0.0047131780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978556+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:19.978556+0000","last_peered":"2023-08-10T10:33:19.978556+0000","last_clean":"2023-08-10T10:33:19.978556+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:19.978556+0000","last_undegraded":"2023-08-10T10:33:19.978556+0000","last_fullsized":"2023-08-10T10:33:19.978556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.687708+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:16.687708+0000","last_peered":"2023-08-10T10:33:16.687708+0000","last_clean":"2023-08-10T10:33:16.687708+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:16.687708+0000","last_undegraded":"2023-08-10T10:33:16.687708+0000","last_fullsized":"2023-08-10T10:33:16.687708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.286658+0000","last_change":"2023-08-10T10:33:35.286714+0000","last_active":"2023-08-10T10:33:35.286658+0000","last_peered":"2023-08-10T10:33:35.286658+0000","last_clean":"2023-08-10T10:33:35.286658+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:35.286658+0000","last_undegraded":"2023-08-10T10:33:35.286658+0000","last_fullsized":"2023-08-10T10:33:35.286658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.286568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:23.130695+0000","scrub_duration":0.0033667300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'29","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972007+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:19.972007+0000","last_peered":"2023-08-10T10:33:19.972007+0000","last_clean":"2023-08-10T10:33:19.972007+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:19.972007+0000","last_undegraded":"2023-08-10T10:33:19.972007+0000","last_fullsized":"2023-08-10T10:33:19.972007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.666852+0000","last_change":"2023-08-10T10:30:38.399334+0000","last_active":"2023-08-10T10:33:16.666852+0000","last_peered":"2023-08-10T10:33:16.666852+0000","last_clean":"2023-08-10T10:33:16.666852+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:16.666852+0000","last_undegraded":"2023-08-10T10:33:16.666852+0000","last_fullsized":"2023-08-10T10:33:16.666852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:49.648568+0000","last_change":"2023-08-10T10:30:33.325192+0000","last_active":"2023-08-10T10:32:49.648568+0000","last_peered":"2023-08-10T10:32:49.648568+0000","last_clean":"2023-08-10T10:32:49.648568+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:32:49.648568+0000","last_undegraded":"2023-08-10T10:32:49.648568+0000","last_fullsized":"2023-08-10T10:32:49.648568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991136+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:19.991136+0000","last_peered":"2023-08-10T10:33:19.991136+0000","last_clean":"2023-08-10T10:33:19.991136+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:19.991136+0000","last_undegraded":"2023-08-10T10:33:19.991136+0000","last_fullsized":"2023-08-10T10:33:19.991136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'473","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.602754+0000","last_change":"2023-08-10T10:30:38.399612+0000","last_active":"2023-08-10T10:33:20.602754+0000","last_peered":"2023-08-10T10:33:20.602754+0000","last_clean":"2023-08-10T10:33:20.602754+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:20.602754+0000","last_undegraded":"2023-08-10T10:33:20.602754+0000","last_fullsized":"2023-08-10T10:33:20.602754+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:49.648558+0000","last_change":"2023-08-10T10:30:33.328613+0000","last_active":"2023-08-10T10:32:49.648558+0000","last_peered":"2023-08-10T10:32:49.648558+0000","last_clean":"2023-08-10T10:32:49.648558+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:32:49.648558+0000","last_undegraded":"2023-08-10T10:32:49.648558+0000","last_fullsized":"2023-08-10T10:32:49.648558+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'33","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.970466+0000","last_change":"2023-08-10T10:30:34.338031+0000","last_active":"2023-08-10T10:33:19.970466+0000","last_peered":"2023-08-10T10:33:19.970466+0000","last_clean":"2023-08-10T10:33:19.970466+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:19.970466+0000","last_undegraded":"2023-08-10T10:33:19.970466+0000","last_fullsized":"2023-08-10T10:33:19.970466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.688081+0000","last_change":"2023-08-10T10:30:38.406577+0000","last_active":"2023-08-10T10:33:16.688081+0000","last_peered":"2023-08-10T10:33:16.688081+0000","last_clean":"2023-08-10T10:33:16.688081+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:16.688081+0000","last_undegraded":"2023-08-10T10:33:16.688081+0000","last_fullsized":"2023-08-10T10:33:16.688081+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:49.643379+0000","last_change":"2023-08-10T10:30:33.329206+0000","last_active":"2023-08-10T10:32:49.643379+0000","last_peered":"2023-08-10T10:32:49.643379+0000","last_clean":"2023-08-10T10:32:49.643379+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:32:49.643379+0000","last_undegraded":"2023-08-10T10:32:49.643379+0000","last_fullsized":"2023-08-10T10:32:49.643379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.950114+0000","last_change":"2023-08-10T10:33:27.950155+0000","last_active":"2023-08-10T10:33:27.950114+0000","last_peered":"2023-08-10T10:33:27.950114+0000","last_clean":"2023-08-10T10:33:27.950114+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:27.950114+0000","last_undegraded":"2023-08-10T10:33:27.950114+0000","last_fullsized":"2023-08-10T10:33:27.950114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.950050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:52.895642+0000","scrub_duration":0.0013175579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":460,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.663924+0000","last_change":"2023-08-10T10:30:38.400356+0000","last_active":"2023-08-10T10:33:16.663924+0000","last_peered":"2023-08-10T10:33:16.663924+0000","last_clean":"2023-08-10T10:33:16.663924+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:16.663924+0000","last_undegraded":"2023-08-10T10:33:16.663924+0000","last_fullsized":"2023-08-10T10:33:16.663924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.270842+0000","last_change":"2023-08-10T10:33:40.270896+0000","last_active":"2023-08-10T10:33:40.270842+0000","last_peered":"2023-08-10T10:33:40.270842+0000","last_clean":"2023-08-10T10:33:40.270842+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:33:40.270842+0000","last_undegraded":"2023-08-10T10:33:40.270842+0000","last_fullsized":"2023-08-10T10:33:40.270842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.270765+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:05.791630+0000","scrub_duration":0.0031293139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993568+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:19.993568+0000","last_peered":"2023-08-10T10:33:19.993568+0000","last_clean":"2023-08-10T10:33:19.993568+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:19.993568+0000","last_undegraded":"2023-08-10T10:33:19.993568+0000","last_fullsized":"2023-08-10T10:33:19.993568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'479","reported_seq":498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.617374+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:20.617374+0000","last_peered":"2023-08-10T10:33:20.617374+0000","last_clean":"2023-08-10T10:33:20.617374+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:20.617374+0000","last_undegraded":"2023-08-10T10:33:20.617374+0000","last_fullsized":"2023-08-10T10:33:20.617374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.952739+0000","last_change":"2023-08-10T10:33:35.952798+0000","last_active":"2023-08-10T10:33:35.952739+0000","last_peered":"2023-08-10T10:33:35.952739+0000","last_clean":"2023-08-10T10:33:35.952739+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:33:35.952739+0000","last_undegraded":"2023-08-10T10:33:35.952739+0000","last_fullsized":"2023-08-10T10:33:35.952739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.952663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.124104+0000","scrub_duration":0.0015171099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.580971+0000","last_change":"2023-08-10T10:33:30.581025+0000","last_active":"2023-08-10T10:33:30.580971+0000","last_peered":"2023-08-10T10:33:30.580971+0000","last_clean":"2023-08-10T10:33:30.580971+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:30.580971+0000","last_undegraded":"2023-08-10T10:33:30.580971+0000","last_fullsized":"2023-08-10T10:33:30.580971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.580850+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:14.483516+0000","scrub_duration":0.0024261040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.604915+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:20.604915+0000","last_peered":"2023-08-10T10:33:20.604915+0000","last_clean":"2023-08-10T10:33:20.604915+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:20.604915+0000","last_undegraded":"2023-08-10T10:33:20.604915+0000","last_fullsized":"2023-08-10T10:33:20.604915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:00.576673+0000","last_change":"2023-08-10T10:30:33.321292+0000","last_active":"2023-08-10T10:33:00.576673+0000","last_peered":"2023-08-10T10:33:00.576673+0000","last_clean":"2023-08-10T10:33:00.576673+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:33:00.576673+0000","last_undegraded":"2023-08-10T10:33:00.576673+0000","last_fullsized":"2023-08-10T10:33:00.576673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'17","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.617446+0000","last_change":"2023-08-10T10:33:29.617535+0000","last_active":"2023-08-10T10:33:29.617446+0000","last_peered":"2023-08-10T10:33:29.617446+0000","last_clean":"2023-08-10T10:33:29.617446+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:29.617446+0000","last_undegraded":"2023-08-10T10:33:29.617446+0000","last_fullsized":"2023-08-10T10:33:29.617446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.617330+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:55.138195+0000","scrub_duration":0.0018756619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.619121+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.619121+0000","last_peered":"2023-08-10T10:33:16.619121+0000","last_clean":"2023-08-10T10:33:16.619121+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.619121+0000","last_undegraded":"2023-08-10T10:33:16.619121+0000","last_fullsized":"2023-08-10T10:33:16.619121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:44.637949+0000","last_change":"2023-08-10T10:30:33.322400+0000","last_active":"2023-08-10T10:32:44.637949+0000","last_peered":"2023-08-10T10:32:44.637949+0000","last_clean":"2023-08-10T10:32:44.637949+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:32:44.637949+0000","last_undegraded":"2023-08-10T10:32:44.637949+0000","last_fullsized":"2023-08-10T10:32:44.637949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'28","reported_seq":53,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979788+0000","last_change":"2023-08-10T10:30:34.344348+0000","last_active":"2023-08-10T10:33:19.979788+0000","last_peered":"2023-08-10T10:33:19.979788+0000","last_clean":"2023-08-10T10:33:19.979788+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:19.979788+0000","last_undegraded":"2023-08-10T10:33:19.979788+0000","last_fullsized":"2023-08-10T10:33:19.979788+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686870+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:16.686870+0000","last_peered":"2023-08-10T10:33:16.686870+0000","last_clean":"2023-08-10T10:33:16.686870+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:16.686870+0000","last_undegraded":"2023-08-10T10:33:16.686870+0000","last_fullsized":"2023-08-10T10:33:16.686870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.710680+0000","last_change":"2023-08-10T10:33:30.710720+0000","last_active":"2023-08-10T10:33:30.710680+0000","last_peered":"2023-08-10T10:33:30.710680+0000","last_clean":"2023-08-10T10:33:30.710680+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:33:30.710680+0000","last_undegraded":"2023-08-10T10:33:30.710680+0000","last_fullsized":"2023-08-10T10:33:30.710680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.710529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:59.859226+0000","scrub_duration":0.0012663329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:07.888334+0000","last_change":"2023-08-10T10:30:33.328885+0000","last_active":"2023-08-10T10:33:07.888334+0000","last_peered":"2023-08-10T10:33:07.888334+0000","last_clean":"2023-08-10T10:33:07.888334+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:07.888334+0000","last_undegraded":"2023-08-10T10:33:07.888334+0000","last_fullsized":"2023-08-10T10:33:07.888334+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.696695+0000","last_change":"2023-08-10T10:33:38.696778+0000","last_active":"2023-08-10T10:33:38.696695+0000","last_peered":"2023-08-10T10:33:38.696695+0000","last_clean":"2023-08-10T10:33:38.696695+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:38.696695+0000","last_undegraded":"2023-08-10T10:33:38.696695+0000","last_fullsized":"2023-08-10T10:33:38.696695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.696559+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:26.540686+0000","scrub_duration":0.0024199579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.595509+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:20.595509+0000","last_peered":"2023-08-10T10:33:20.595509+0000","last_clean":"2023-08-10T10:33:20.595509+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:20.595509+0000","last_undegraded":"2023-08-10T10:33:20.595509+0000","last_fullsized":"2023-08-10T10:33:20.595509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:37.948632+0000","last_change":"2023-08-10T10:33:37.948688+0000","last_active":"2023-08-10T10:33:37.948632+0000","last_peered":"2023-08-10T10:33:37.948632+0000","last_clean":"2023-08-10T10:33:37.948632+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:33:37.948632+0000","last_undegraded":"2023-08-10T10:33:37.948632+0000","last_fullsized":"2023-08-10T10:33:37.948632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_clean_scrub_stamp":"2023-08-10T10:33:37.948513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:54.150578+0000","scrub_duration":0.002318966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":27,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:39.646217+0000","last_change":"2023-08-10T10:30:33.321955+0000","last_active":"2023-08-10T10:32:39.646217+0000","last_peered":"2023-08-10T10:32:39.646217+0000","last_clean":"2023-08-10T10:32:39.646217+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:32:39.646217+0000","last_undegraded":"2023-08-10T10:32:39.646217+0000","last_fullsized":"2023-08-10T10:32:39.646217+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.718634+0000","last_change":"2023-08-10T10:33:41.718685+0000","last_active":"2023-08-10T10:33:41.718634+0000","last_peered":"2023-08-10T10:33:41.718634+0000","last_clean":"2023-08-10T10:33:41.718634+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:41.718634+0000","last_undegraded":"2023-08-10T10:33:41.718634+0000","last_fullsized":"2023-08-10T10:33:41.718634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.718538+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:53.207796+0000","scrub_duration":0.001658145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":437,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.672409+0000","last_change":"2023-08-10T10:30:38.399397+0000","last_active":"2023-08-10T10:33:16.672409+0000","last_peered":"2023-08-10T10:33:16.672409+0000","last_clean":"2023-08-10T10:33:16.672409+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:16.672409+0000","last_undegraded":"2023-08-10T10:33:16.672409+0000","last_fullsized":"2023-08-10T10:33:16.672409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:26.879110+0000","last_change":"2023-08-10T10:33:26.879152+0000","last_active":"2023-08-10T10:33:26.879110+0000","last_peered":"2023-08-10T10:33:26.879110+0000","last_clean":"2023-08-10T10:33:26.879110+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:33:26.879110+0000","last_undegraded":"2023-08-10T10:33:26.879110+0000","last_fullsized":"2023-08-10T10:33:26.879110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_clean_scrub_stamp":"2023-08-10T10:33:26.879039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:12.596625+0000","scrub_duration":0.001274535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.701104+0000","last_change":"2023-08-10T10:33:34.701154+0000","last_active":"2023-08-10T10:33:34.701104+0000","last_peered":"2023-08-10T10:33:34.701104+0000","last_clean":"2023-08-10T10:33:34.701104+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:33:34.701104+0000","last_undegraded":"2023-08-10T10:33:34.701104+0000","last_fullsized":"2023-08-10T10:33:34.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.701006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:58.432269+0000","scrub_duration":0.001815002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'29","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.974843+0000","last_change":"2023-08-10T10:30:34.343975+0000","last_active":"2023-08-10T10:33:19.974843+0000","last_peered":"2023-08-10T10:33:19.974843+0000","last_clean":"2023-08-10T10:33:19.974843+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:19.974843+0000","last_undegraded":"2023-08-10T10:33:19.974843+0000","last_fullsized":"2023-08-10T10:33:19.974843+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":473,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.608391+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.608391+0000","last_peered":"2023-08-10T10:33:16.608391+0000","last_clean":"2023-08-10T10:33:16.608391+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.608391+0000","last_undegraded":"2023-08-10T10:33:16.608391+0000","last_fullsized":"2023-08-10T10:33:16.608391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.003375+0000","last_change":"2023-08-10T10:33:40.003425+0000","last_active":"2023-08-10T10:33:40.003375+0000","last_peered":"2023-08-10T10:33:40.003375+0000","last_clean":"2023-08-10T10:33:40.003375+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:33:40.003375+0000","last_undegraded":"2023-08-10T10:33:40.003375+0000","last_fullsized":"2023-08-10T10:33:40.003375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.003286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:45.183349+0000","scrub_duration":0.0025616390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.300509+0000","last_change":"2023-08-10T10:33:36.300593+0000","last_active":"2023-08-10T10:33:36.300509+0000","last_peered":"2023-08-10T10:33:36.300509+0000","last_clean":"2023-08-10T10:33:36.300509+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:33:36.300509+0000","last_undegraded":"2023-08-10T10:33:36.300509+0000","last_fullsized":"2023-08-10T10:33:36.300509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.300423+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:52.502488+0000","scrub_duration":0.0062505190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.276021+0000","last_change":"2023-08-10T10:33:38.276073+0000","last_active":"2023-08-10T10:33:38.276021+0000","last_peered":"2023-08-10T10:33:38.276021+0000","last_clean":"2023-08-10T10:33:38.276021+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:33:38.276021+0000","last_undegraded":"2023-08-10T10:33:38.276021+0000","last_fullsized":"2023-08-10T10:33:38.276021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.275922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:29.593519+0000","scrub_duration":0.002303009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.996278+0000","last_change":"2023-08-10T10:30:34.348895+0000","last_active":"2023-08-10T10:33:19.996278+0000","last_peered":"2023-08-10T10:33:19.996278+0000","last_clean":"2023-08-10T10:33:19.996278+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:19.996278+0000","last_undegraded":"2023-08-10T10:33:19.996278+0000","last_fullsized":"2023-08-10T10:33:19.996278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'427","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603654+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:20.603654+0000","last_peered":"2023-08-10T10:33:20.603654+0000","last_clean":"2023-08-10T10:33:20.603654+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:20.603654+0000","last_undegraded":"2023-08-10T10:33:20.603654+0000","last_fullsized":"2023-08-10T10:33:20.603654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.298437+0000","last_change":"2023-08-10T10:33:38.298484+0000","last_active":"2023-08-10T10:33:38.298437+0000","last_peered":"2023-08-10T10:33:38.298437+0000","last_clean":"2023-08-10T10:33:38.298437+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:33:38.298437+0000","last_undegraded":"2023-08-10T10:33:38.298437+0000","last_fullsized":"2023-08-10T10:33:38.298437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.298353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:43.478416+0000","scrub_duration":0.002283045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'16","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.996845+0000","last_change":"2023-08-10T10:33:30.996902+0000","last_active":"2023-08-10T10:33:30.996845+0000","last_peered":"2023-08-10T10:33:30.996845+0000","last_clean":"2023-08-10T10:33:30.996845+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:30.996845+0000","last_undegraded":"2023-08-10T10:33:30.996845+0000","last_fullsized":"2023-08-10T10:33:30.996845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.996769+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:14.424734+0000","scrub_duration":0.0026543970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.986781+0000","last_change":"2023-08-10T10:33:43.986851+0000","last_active":"2023-08-10T10:33:43.986781+0000","last_peered":"2023-08-10T10:33:43.986781+0000","last_clean":"2023-08-10T10:33:43.986781+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:43.986781+0000","last_undegraded":"2023-08-10T10:33:43.986781+0000","last_fullsized":"2023-08-10T10:33:43.986781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.986673+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:35.304270+0000","scrub_duration":0.001579366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":491,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.666332+0000","last_change":"2023-08-10T10:30:38.392929+0000","last_active":"2023-08-10T10:33:16.666332+0000","last_peered":"2023-08-10T10:33:16.666332+0000","last_clean":"2023-08-10T10:33:16.666332+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:33:16.666332+0000","last_undegraded":"2023-08-10T10:33:16.666332+0000","last_fullsized":"2023-08-10T10:33:16.666332+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.330743+0000","last_change":"2023-08-10T10:33:41.330818+0000","last_active":"2023-08-10T10:33:41.330743+0000","last_peered":"2023-08-10T10:33:41.330743+0000","last_clean":"2023-08-10T10:33:41.330743+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:33:41.330743+0000","last_undegraded":"2023-08-10T10:33:41.330743+0000","last_fullsized":"2023-08-10T10:33:41.330743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.330658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:48.111867+0000","scrub_duration":0.001792685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.662773+0000","last_change":"2023-08-10T10:33:35.662823+0000","last_active":"2023-08-10T10:33:35.662773+0000","last_peered":"2023-08-10T10:33:35.662773+0000","last_clean":"2023-08-10T10:33:35.662773+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:33:35.662773+0000","last_undegraded":"2023-08-10T10:33:35.662773+0000","last_fullsized":"2023-08-10T10:33:35.662773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.662682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:19.090646+0000","scrub_duration":0.0017149699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'34","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982758+0000","last_change":"2023-08-10T10:30:34.337319+0000","last_active":"2023-08-10T10:33:19.982758+0000","last_peered":"2023-08-10T10:33:19.982758+0000","last_clean":"2023-08-10T10:33:19.982758+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:19.982758+0000","last_undegraded":"2023-08-10T10:33:19.982758+0000","last_fullsized":"2023-08-10T10:33:19.982758+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'511","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593079+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:20.593079+0000","last_peered":"2023-08-10T10:33:20.593079+0000","last_clean":"2023-08-10T10:33:20.593079+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:20.593079+0000","last_undegraded":"2023-08-10T10:33:20.593079+0000","last_fullsized":"2023-08-10T10:33:20.593079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.311638+0000","last_change":"2023-08-10T10:33:41.311696+0000","last_active":"2023-08-10T10:33:41.311638+0000","last_peered":"2023-08-10T10:33:41.311638+0000","last_clean":"2023-08-10T10:33:41.311638+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:33:41.311638+0000","last_undegraded":"2023-08-10T10:33:41.311638+0000","last_fullsized":"2023-08-10T10:33:41.311638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.311549+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:25.214215+0000","scrub_duration":0.0039921610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:32.706810+0000","last_change":"2023-08-10T10:33:32.706856+0000","last_active":"2023-08-10T10:33:32.706810+0000","last_peered":"2023-08-10T10:33:32.706810+0000","last_clean":"2023-08-10T10:33:32.706810+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:33:32.706810+0000","last_undegraded":"2023-08-10T10:33:32.706810+0000","last_fullsized":"2023-08-10T10:33:32.706810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_clean_scrub_stamp":"2023-08-10T10:33:32.706726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:57.652318+0000","scrub_duration":0.002258688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.211129+0000","last_change":"2023-08-10T10:33:29.211173+0000","last_active":"2023-08-10T10:33:29.211129+0000","last_peered":"2023-08-10T10:33:29.211129+0000","last_clean":"2023-08-10T10:33:29.211129+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:29.211129+0000","last_undegraded":"2023-08-10T10:33:29.211129+0000","last_fullsized":"2023-08-10T10:33:29.211129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.211063+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:45.413129+0000","scrub_duration":0.0022425100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.644856+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.644856+0000","last_peered":"2023-08-10T10:33:16.644856+0000","last_clean":"2023-08-10T10:33:16.644856+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.644856+0000","last_undegraded":"2023-08-10T10:33:16.644856+0000","last_fullsized":"2023-08-10T10:33:16.644856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.820766+0000","last_change":"2023-08-10T10:33:29.820813+0000","last_active":"2023-08-10T10:33:29.820766+0000","last_peered":"2023-08-10T10:33:29.820766+0000","last_clean":"2023-08-10T10:33:29.820766+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:33:29.820766+0000","last_undegraded":"2023-08-10T10:33:29.820766+0000","last_fullsized":"2023-08-10T10:33:29.820766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.820682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.382461+0000","scrub_duration":0.0016165769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.024844+0000","last_change":"2023-08-10T10:33:30.024886+0000","last_active":"2023-08-10T10:33:30.024844+0000","last_peered":"2023-08-10T10:33:30.024844+0000","last_clean":"2023-08-10T10:33:30.024844+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:30.024844+0000","last_undegraded":"2023-08-10T10:33:30.024844+0000","last_fullsized":"2023-08-10T10:33:30.024844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.024779+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:53.756043+0000","scrub_duration":0.001678323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'22","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989605+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:19.989605+0000","last_peered":"2023-08-10T10:33:19.989605+0000","last_clean":"2023-08-10T10:33:19.989605+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:19.989605+0000","last_undegraded":"2023-08-10T10:33:19.989605+0000","last_fullsized":"2023-08-10T10:33:19.989605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'436","reported_seq":455,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.616963+0000","last_change":"2023-08-10T10:30:38.397188+0000","last_active":"2023-08-10T10:33:20.616963+0000","last_peered":"2023-08-10T10:33:20.616963+0000","last_clean":"2023-08-10T10:33:20.616963+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:20.616963+0000","last_undegraded":"2023-08-10T10:33:20.616963+0000","last_fullsized":"2023-08-10T10:33:20.616963+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.996535+0000","last_change":"2023-08-10T10:33:28.996619+0000","last_active":"2023-08-10T10:33:28.996535+0000","last_peered":"2023-08-10T10:33:28.996535+0000","last_clean":"2023-08-10T10:33:28.996535+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:33:28.996535+0000","last_undegraded":"2023-08-10T10:33:28.996535+0000","last_fullsized":"2023-08-10T10:33:28.996535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.996417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:59.325457+0000","scrub_duration":0.00214364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.761702+0000","last_change":"2023-08-10T10:33:43.761757+0000","last_active":"2023-08-10T10:33:43.761702+0000","last_peered":"2023-08-10T10:33:43.761702+0000","last_clean":"2023-08-10T10:33:43.761702+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:43.761702+0000","last_undegraded":"2023-08-10T10:33:43.761702+0000","last_fullsized":"2023-08-10T10:33:43.761702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.761621+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:33.933062+0000","scrub_duration":0.0016532879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686881+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:16.686881+0000","last_peered":"2023-08-10T10:33:16.686881+0000","last_clean":"2023-08-10T10:33:16.686881+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:16.686881+0000","last_undegraded":"2023-08-10T10:33:16.686881+0000","last_fullsized":"2023-08-10T10:33:16.686881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":29,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:04.646544+0000","last_change":"2023-08-10T10:30:33.326675+0000","last_active":"2023-08-10T10:33:04.646544+0000","last_peered":"2023-08-10T10:33:04.646544+0000","last_clean":"2023-08-10T10:33:04.646544+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:33:04.646544+0000","last_undegraded":"2023-08-10T10:33:04.646544+0000","last_fullsized":"2023-08-10T10:33:04.646544+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:44.471463+0000","last_change":"2023-08-10T10:33:44.471546+0000","last_active":"2023-08-10T10:33:44.471463+0000","last_peered":"2023-08-10T10:33:44.471463+0000","last_clean":"2023-08-10T10:33:44.471463+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:44.471463+0000","last_undegraded":"2023-08-10T10:33:44.471463+0000","last_fullsized":"2023-08-10T10:33:44.471463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_clean_scrub_stamp":"2023-08-10T10:33:44.471356+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:07.840953+0000","scrub_duration":0.0024103369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664437+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:16.664437+0000","last_peered":"2023-08-10T10:33:16.664437+0000","last_clean":"2023-08-10T10:33:16.664437+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:16.664437+0000","last_undegraded":"2023-08-10T10:33:16.664437+0000","last_fullsized":"2023-08-10T10:33:16.664437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'4","reported_seq":31,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:06.199399+0000","last_change":"2023-08-10T10:30:33.326614+0000","last_active":"2023-08-10T10:33:06.199399+0000","last_peered":"2023-08-10T10:33:06.199399+0000","last_clean":"2023-08-10T10:33:06.199399+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:06.199399+0000","last_undegraded":"2023-08-10T10:33:06.199399+0000","last_fullsized":"2023-08-10T10:33:06.199399+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'23","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.421729+0000","last_change":"2023-08-10T10:33:43.421786+0000","last_active":"2023-08-10T10:33:43.421729+0000","last_peered":"2023-08-10T10:33:43.421729+0000","last_clean":"2023-08-10T10:33:43.421729+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:43.421729+0000","last_undegraded":"2023-08-10T10:33:43.421729+0000","last_fullsized":"2023-08-10T10:33:43.421729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.421640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:09.069900+0000","scrub_duration":0.0020388680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'470","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.601755+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:20.601755+0000","last_peered":"2023-08-10T10:33:20.601755+0000","last_clean":"2023-08-10T10:33:20.601755+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:20.601755+0000","last_undegraded":"2023-08-10T10:33:20.601755+0000","last_fullsized":"2023-08-10T10:33:20.601755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:32:34.632341+0000","last_change":"2023-08-10T10:30:33.318057+0000","last_active":"2023-08-10T10:32:34.632341+0000","last_peered":"2023-08-10T10:32:34.632341+0000","last_clean":"2023-08-10T10:32:34.632341+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:32:34.632341+0000","last_undegraded":"2023-08-10T10:32:34.632341+0000","last_fullsized":"2023-08-10T10:32:34.632341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:32.286667+0000","last_clean_scrub_stamp":"2023-08-10T10:30:32.286667+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979982+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:19.979982+0000","last_peered":"2023-08-10T10:33:19.979982+0000","last_clean":"2023-08-10T10:33:19.979982+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:19.979982+0000","last_undegraded":"2023-08-10T10:33:19.979982+0000","last_fullsized":"2023-08-10T10:33:19.979982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.596452+0000","last_change":"2023-08-10T10:30:38.392868+0000","last_active":"2023-08-10T10:33:20.596452+0000","last_peered":"2023-08-10T10:33:20.596452+0000","last_clean":"2023-08-10T10:33:20.596452+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:20.596452+0000","last_undegraded":"2023-08-10T10:33:20.596452+0000","last_fullsized":"2023-08-10T10:33:20.596452+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'7","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.996594+0000","last_change":"2023-08-10T10:33:36.996650+0000","last_active":"2023-08-10T10:33:36.996594+0000","last_peered":"2023-08-10T10:33:36.996594+0000","last_clean":"2023-08-10T10:33:36.996594+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:33:36.996594+0000","last_undegraded":"2023-08-10T10:33:36.996594+0000","last_fullsized":"2023-08-10T10:33:36.996594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.996505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:48.485764+0000","scrub_duration":0.004534967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.992020+0000","last_change":"2023-08-10T10:30:34.344894+0000","last_active":"2023-08-10T10:33:19.992020+0000","last_peered":"2023-08-10T10:33:19.992020+0000","last_clean":"2023-08-10T10:33:19.992020+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:19.992020+0000","last_undegraded":"2023-08-10T10:33:19.992020+0000","last_fullsized":"2023-08-10T10:33:19.992020+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'48","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.879218+0000","last_change":"2023-08-10T10:33:40.879272+0000","last_active":"2023-08-10T10:33:40.879218+0000","last_peered":"2023-08-10T10:33:40.879218+0000","last_clean":"2023-08-10T10:33:40.879218+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:40.879218+0000","last_undegraded":"2023-08-10T10:33:40.879218+0000","last_fullsized":"2023-08-10T10:33:40.879218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.879137+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:38.333811+0000","scrub_duration":0.0022235739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982882+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:19.982882+0000","last_peered":"2023-08-10T10:33:19.982882+0000","last_clean":"2023-08-10T10:33:19.982882+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:19.982882+0000","last_undegraded":"2023-08-10T10:33:19.982882+0000","last_fullsized":"2023-08-10T10:33:19.982882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'34","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991199+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:19.991199+0000","last_peered":"2023-08-10T10:33:19.991199+0000","last_clean":"2023-08-10T10:33:19.991199+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:19.991199+0000","last_undegraded":"2023-08-10T10:33:19.991199+0000","last_fullsized":"2023-08-10T10:33:19.991199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.976000+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:19.976000+0000","last_peered":"2023-08-10T10:33:19.976000+0000","last_clean":"2023-08-10T10:33:19.976000+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:19.976000+0000","last_undegraded":"2023-08-10T10:33:19.976000+0000","last_fullsized":"2023-08-10T10:33:19.976000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.806229+0000","last_change":"2023-08-10T10:33:25.806268+0000","last_active":"2023-08-10T10:33:25.806229+0000","last_peered":"2023-08-10T10:33:25.806229+0000","last_clean":"2023-08-10T10:33:25.806229+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:25.806229+0000","last_undegraded":"2023-08-10T10:33:25.806229+0000","last_fullsized":"2023-08-10T10:33:25.806229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.806161+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:38.537991+0000","scrub_duration":0.0024102640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":111149056,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":1076224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222298112,"data_stored":222298112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14883,"ondisk_log_size":14883,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2150615,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":712,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4301230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":719,"ondisk_log_size":719,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574893,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76612,"kb_used_data":41404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94295228,"statfs":{"total":96636764160,"available":96558313472,"internally_reserved":0,"allocated":42397696,"data_stored":42188424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.0800000000000001,"15min":0.78000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":6.7960000000000003,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1830000000000001,"15min":0.78300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.4600000000000009,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.78100000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.085,"15min":0.76500000000000001},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":17.917000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":0.92600000000000005},{"interface":"front","average":{"1min":2.419,"5min":1.165,"15min":0.85299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":12.194000000000001,"5min":12.194000000000001,"15min":12.194000000000001},"last":0.86799999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.264,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.502},"max":{"1min":8.343,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.89500000000000002},{"interface":"front","average":{"1min":2.0209999999999999,"5min":1.321,"15min":0.91900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":9.8279999999999994,"5min":22.148,"15min":22.148},"last":0.83099999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.1160000000000001,"15min":0.82299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.2669999999999995,"5min":10.237,"15min":10.237},"last":0.878},{"interface":"front","average":{"1min":2.1800000000000002,"5min":1.268,"15min":0.94199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.1709999999999994,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.94499999999999995,"15min":0.76700000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.7560000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0069999999999999,"15min":0.79500000000000004},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.2380000000000004,"5min":11.779,"15min":11.779},"last":0.627}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.88300000000000001,"15min":0.81699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.706,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":1.196,"5min":1.014,"15min":0.85899999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.7880000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.0820000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.1850000000000001,"5min":0.94499999999999995,"15min":0.79300000000000004},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.7080000000000002,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.57499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":17616896,"data_stored":17435679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.3,"15min":0.91400000000000003},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":8.8369999999999997,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":1.774,"5min":1.3280000000000001,"15min":0.95299999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.911,"5min":11.911,"15min":11.911},"last":0.68500000000000005}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":1.5469999999999999,"15min":1.0069999999999999},"min":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.7080000000000002,"5min":14.93,"15min":14.93},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.2849999999999999,"15min":0.92900000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":11.836,"5min":11.836,"15min":11.836},"last":0.72699999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.357,"15min":0.92300000000000004},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":8.4510000000000005,"5min":19.654,"15min":19.654},"last":0.77800000000000002},{"interface":"front","average":{"1min":2.097,"5min":1.379,"15min":0.94499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":8.7379999999999995,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.6379999999999999,"5min":1.5800000000000001,"15min":1.038},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":16.934000000000001,"5min":16.934000000000001,"15min":16.934000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.4319999999999999,"15min":1},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.968,"5min":19.907,"15min":19.907},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.96499999999999997,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.984,"5min":5.984,"15min":5.984},"last":0.53100000000000003},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.0149999999999999,"15min":0.80900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":11.94,"5min":11.94,"15min":11.94},"last":0.627}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.97699999999999998,"15min":0.78800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.3780000000000001,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.66400000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.95999999999999996,"15min":0.81799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3490000000000002,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.70699999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1,"15min":0.84199999999999997},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9569999999999999,"5min":5.577,"15min":5.577},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.1140000000000001,"15min":0.88},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":4.3239999999999998,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.83899999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66748,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94305092,"statfs":{"total":96636764160,"available":96568414208,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.67700000000000005,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":10.212999999999999,"5min":10.212999999999999,"15min":10.212999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":1.5609999999999999,"5min":0.73299999999999998,"15min":0.53700000000000003},"min":{"1min":0.314,"5min":0.308,"15min":0.308},"max":{"1min":6.46,"5min":6.46,"15min":6.46},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.3069999999999999,"5min":0.95799999999999996,"15min":0.622},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":13.24,"5min":13.24,"15min":13.24},"last":0.53600000000000003},{"interface":"front","average":{"1min":1.5640000000000001,"5min":0.79900000000000004,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.0270000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.72399999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.438},"max":{"1min":5.0970000000000004,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.206,"5min":0.70699999999999996,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.84399999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":3.0649999999999999,"5min":1.3480000000000001,"15min":0.93200000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.635,"5min":11.635,"15min":11.635},"last":0.92100000000000004},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.516,"15min":1.0049999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":14.271000000000001,"5min":14.271000000000001,"15min":14.271000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.7320000000000002,"5min":1.288,"15min":0.91200000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":10.101000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":1.022},{"interface":"front","average":{"1min":4.3659999999999997,"5min":1.782,"15min":1.123},"min":{"1min":0.51600000000000001,"5min":0.505,"15min":0.505},"max":{"1min":17.66,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.1699999999999999,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":6.5410000000000004,"5min":10.516,"15min":10.516},"last":0.95699999999999996},{"interface":"front","average":{"1min":3.6080000000000001,"5min":1.5,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":14.295999999999999,"5min":14.295999999999999,"15min":14.295999999999999},"last":0.875}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":1.135,"15min":0.92900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6,"5min":6,"15min":6},"last":0.99399999999999999},{"interface":"front","average":{"1min":4.3150000000000004,"5min":1.6839999999999999,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":31.629999999999999,"5min":31.629999999999999,"15min":31.629999999999999},"last":1.0680000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62216,"kb_used_data":27008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94309624,"statfs":{"total":96636764160,"available":96573054976,"internally_reserved":0,"allocated":27656192,"data_stored":27470546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.84499999999999997,"15min":0.67100000000000004},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":5.7590000000000003,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.35999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.8530000000000002,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":0.96499999999999997,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.55800000000000005},{"interface":"front","average":{"1min":1.018,"5min":0.98199999999999998,"15min":0.91000000000000003},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0890000000000004,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.69999999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.232,"15min":0.89100000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":19.68,"5min":19.68,"15min":19.68},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.681,"5min":1.0349999999999999,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.0579999999999998,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.60899999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.3780000000000001,"5min":1.8560000000000001,"15min":1.4610000000000001},"min":{"1min":0.53800000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":44.292000000000002,"5min":44.292000000000002,"15min":44.292000000000002},"last":0.86899999999999999},{"interface":"front","average":{"1min":4.6150000000000002,"5min":1.8740000000000001,"15min":1.238},"min":{"1min":0.48499999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":49.887999999999998,"5min":49.887999999999998,"15min":49.887999999999998},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":9.3859999999999992,"5min":2.516,"15min":1.3109999999999999},"min":{"1min":0.58399999999999996,"5min":0.434,"15min":0.434},"max":{"1min":127.655,"5min":127.655,"15min":127.655},"last":0.91300000000000003},{"interface":"front","average":{"1min":5.2610000000000001,"5min":1.895,"15min":1.3540000000000001},"min":{"1min":0.59799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":65.376000000000005,"5min":65.376000000000005,"15min":65.376000000000005},"last":0.76200000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":1.6000000000000001,"15min":1.1699999999999999},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":16.510000000000002,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.752},{"interface":"front","average":{"1min":2.6019999999999999,"5min":1.429,"15min":0.97499999999999998},"min":{"1min":0.59399999999999997,"5min":0.499,"15min":0.499},"max":{"1min":16.331,"5min":16.331,"15min":16.331},"last":0.78100000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":1.4770000000000001,"15min":1.216},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":8.9670000000000005,"5min":8.9670000000000005,"15min":8.9670000000000005},"last":0.84099999999999997},{"interface":"front","average":{"1min":2.4399999999999999,"5min":1.5509999999999999,"15min":1.1879999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":16.478000000000002,"5min":17.032,"15min":17.032},"last":0.88900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574892,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":28468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":29151232,"data_stored":28970015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":0.83299999999999996,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":2.2269999999999999,"5min":0.88400000000000001,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":13.456,"5min":13.456,"15min":13.456},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.131,"15min":0.70999999999999996},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.066000000000001,"5min":15.066000000000001,"15min":15.066000000000001},"last":0.47599999999999998},{"interface":"front","average":{"1min":1.8560000000000001,"5min":0.88,"15min":0.65200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.2029999999999994,"5min":9.2029999999999994,"15min":9.2029999999999994},"last":0.40100000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83699999999999997,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.7030000000000001,"5min":11.715,"15min":11.715},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.2919999999999998,"5min":1.024,"15min":0.73799999999999999},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":15.997999999999999,"5min":15.997999999999999,"15min":15.997999999999999},"last":0.45000000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.0880000000000001,"5min":1.5840000000000001,"15min":0.99199999999999999},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":19.811,"5min":19.811,"15min":19.811},"last":0.88800000000000001},{"interface":"front","average":{"1min":1.659,"5min":1.1799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53600000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.002000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.85399999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":1.4219999999999999,"15min":0.97499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":16.045000000000002,"5min":16.045000000000002,"15min":16.045000000000002},"last":0.97199999999999998},{"interface":"front","average":{"1min":3.52,"5min":1.5960000000000001,"15min":1.04},"min":{"1min":0.63600000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":13.414999999999999,"5min":13.414999999999999,"15min":13.414999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":1.6339999999999999,"15min":1.042},"min":{"1min":0.54200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":20.692,"5min":20.692,"15min":20.692},"last":0.81100000000000005},{"interface":"front","average":{"1min":2.2130000000000001,"5min":1.5109999999999999,"15min":1.0229999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.1519999999999992,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.9670000000000001,"5min":1.498,"15min":1.0369999999999999},"min":{"1min":0.54000000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":13.516,"5min":13.516,"15min":13.516},"last":0.94799999999999995},{"interface":"front","average":{"1min":2.6920000000000002,"5min":1.4119999999999999,"15min":0.98799999999999999},"min":{"1min":0.59599999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":20.757999999999999,"5min":20.757999999999999,"15min":20.757999999999999},"last":0.91700000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55488,"kb_used_data":24376,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94316352,"statfs":{"total":96636764160,"available":96579944448,"internally_reserved":0,"allocated":24961024,"data_stored":24775801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":1.004,"15min":0.71799999999999997},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":24.925999999999998,"5min":24.925999999999998,"15min":24.925999999999998},"last":0.435},{"interface":"front","average":{"1min":2.1499999999999999,"5min":0.94199999999999995,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":19.779,"5min":19.779,"15min":19.779},"last":0.59699999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":0.94899999999999995,"15min":0.67500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.6259999999999994,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.304,"15min":1.216},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":9.4700000000000006,"5min":12.754,"15min":12.754},"last":0.54900000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.0489999999999999,"15min":0.80100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.0629999999999997,"5min":14.169,"15min":14.169},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.173,"15min":0.875},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":14.156000000000001,"5min":16.927,"15min":16.927},"last":0.71599999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.3690000000000002,"5min":1.456,"15min":0.98599999999999999},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":1.0880000000000001},{"interface":"front","average":{"1min":2.246,"5min":1.3180000000000001,"15min":0.92500000000000004},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":14.225,"5min":14.225,"15min":14.225},"last":0.90500000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0369999999999999,"5min":1.1759999999999999,"15min":0.89500000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.976,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":3.048,"5min":1.542,"15min":1.0529999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":24.853999999999999,"5min":24.853999999999999,"15min":24.853999999999999},"last":0.88700000000000001}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":1.468,"15min":1.0249999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":10.403,"5min":16.919,"15min":16.919},"last":1.0529999999999999},{"interface":"front","average":{"1min":2.3300000000000001,"5min":1.365,"15min":0.98499999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":9.6880000000000006,"5min":12.504,"15min":12.504},"last":0.875}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1559999999999999,"15min":0.93400000000000005},"min":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":9.5090000000000003,"5min":9.5090000000000003,"15min":9.5090000000000003},"last":0.98899999999999999},{"interface":"front","average":{"1min":3.427,"5min":1.667,"15min":1.1040000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":1.0049999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64768,"kb_used_data":29560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94307072,"statfs":{"total":96636764160,"available":96570441728,"internally_reserved":0,"allocated":30269440,"data_stored":30071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.1079999999999997,"5min":1.829,"15min":1.0600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":69.530000000000001,"5min":69.530000000000001,"15min":69.530000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":2.8839999999999999,"5min":1.5109999999999999,"15min":1.0840000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.388000000000002,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.626}]},{"osd":1,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.6779999999999999,"5min":1.8380000000000001,"15min":1.147},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":64.784999999999997,"5min":64.784999999999997,"15min":64.784999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":7.8789999999999996,"5min":2.6440000000000001,"15min":1.4630000000000001},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":120.05,"5min":120.05,"15min":120.05},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":7.6840000000000002,"5min":2.4060000000000001,"15min":1.284},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":119.992,"5min":119.992,"15min":119.992},"last":0.46100000000000002},{"interface":"front","average":{"1min":3.0299999999999998,"5min":1.5880000000000001,"15min":1.214},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":30.984000000000002,"5min":30.984000000000002,"15min":30.984000000000002},"last":0.76800000000000002}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.0759999999999996,"5min":1.8779999999999999,"15min":1.1479999999999999},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":64.823999999999998,"5min":64.823999999999998,"15min":64.823999999999998},"last":0.748},{"interface":"front","average":{"1min":3.0600000000000001,"5min":1.417,"15min":1.0129999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":30.940000000000001,"5min":30.940000000000001,"15min":30.940000000000001},"last":0.69599999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":9.218,"5min":2.7400000000000002,"15min":1.504},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":165.98500000000001,"5min":165.98500000000001,"15min":165.98500000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":7.6159999999999997,"5min":2.21,"15min":1.278},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":125.369,"5min":125.369,"15min":125.369},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":6.5289999999999999,"5min":2.4590000000000001,"15min":1.7949999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":113.884,"5min":113.884,"15min":113.884},"last":0.59799999999999998},{"interface":"front","average":{"1min":7.1520000000000001,"5min":2.2280000000000002,"15min":1.2869999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":124.836,"5min":124.836,"15min":124.836},"last":0.51300000000000001}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":1.6020000000000001,"15min":1.1220000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":67.281999999999996,"5min":67.281999999999996,"15min":67.281999999999996},"last":0.78500000000000003},{"interface":"front","average":{"1min":7.125,"5min":2.1520000000000001,"15min":1.27},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":125.12,"5min":125.12,"15min":125.12},"last":0.81200000000000006}]}]},{"osd":5,"up_from":13,"seq":55834574892,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60612,"kb_used_data":25404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94311228,"statfs":{"total":96636764160,"available":96574697472,"internally_reserved":0,"allocated":26013696,"data_stored":25824939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2729999999999997,"5min":1.6970000000000001,"15min":1.2410000000000001},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":2.4340000000000002,"5min":1.3720000000000001,"15min":1.133},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":12.596,"5min":12.596,"15min":12.596},"last":0.81899999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.8919999999999999,"5min":1.764,"15min":1.3680000000000001},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":20.193999999999999,"5min":20.193999999999999,"15min":20.193999999999999},"last":0.91400000000000003},{"interface":"front","average":{"1min":3.552,"5min":1.6240000000000001,"15min":1.202},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.708,"5min":15.708,"15min":15.708},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1890000000000001,"5min":1.4470000000000001,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.949,"5min":10.949,"15min":10.949},"last":0.93100000000000005},{"interface":"front","average":{"1min":4.1619999999999999,"5min":1.5960000000000001,"15min":1.198},"min":{"1min":0.499,"5min":0.435,"15min":0.435},"max":{"1min":20.224,"5min":20.224,"15min":20.224},"last":0.873}]},{"osd":3,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.242,"15min":1.1379999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.85699999999999998},{"interface":"front","average":{"1min":5.1600000000000001,"5min":1.968,"15min":1.514},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":20.114999999999998,"5min":20.114999999999998,"15min":20.114999999999998},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3250000000000002,"5min":0.97499999999999998,"15min":0.73099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":15.784000000000001,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.84499999999999997,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":0.92800000000000005,"15min":0.73199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.60499999999999998},{"interface":"front","average":{"1min":2.3149999999999999,"5min":1.0109999999999999,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":15.815,"5min":15.815,"15min":15.815},"last":0.83599999999999997}]},{"osd":7,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.012,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.71199999999999997},{"interface":"front","average":{"1min":3.456,"5min":1.3120000000000001,"15min":0.94599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":20.161000000000001,"5min":20.161000000000001,"15min":20.161000000000001},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2149873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2142281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26738688,"data_stored":26738688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28835840,"data_stored":28835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24641536,"data_stored":24641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27787264,"data_stored":27787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25690112,"data_stored":25690112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17301504,"data_stored":17301504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":39321600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:33:50.203 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.203 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.204 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.204 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.204 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.205 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.205 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.205 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.206 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.206 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.206 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.207 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.207 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.207 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.208 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.208 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.208 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.209 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.209 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.209 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.210 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.210 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.210 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.210 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.211 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.211 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.211 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.212 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.212 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.212 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.213 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.213 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.213 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.214 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.214 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.214 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.214 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.215 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.215 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.215 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.216 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.216 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.216 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.217 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.217 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.217 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.217 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.218 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.218 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.218 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.219 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.219 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.219 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.220 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.220 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.220 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.221 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.221 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.221 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.221 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.222 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.222 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.222 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.223 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.223 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.223 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.224 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.224 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.224 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.225 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.225 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.225 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.226 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.226 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.226 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.227 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.227 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.227 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.228 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-08-10T10:30:32.286667+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=32, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.228 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.228 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.228 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.229 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.229 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.229 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:33:50.230 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-10T10:33:56.699 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:33:56.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:10.231 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:34:10.441 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.441+0000 7f49745ff700 1 Processor -- start 2023-08-10T10:34:10.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.441+0000 7f49745ff700 1 -- start start 2023-08-10T10:34:10.442 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f49745ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 0x7f496c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f49745ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f496c159790 0x7f496c071760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f49745ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496c0cb410 con 0x7f496c0c9f20 2023-08-10T10:34:10.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f49745ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c06af70 con 0x7f496c159790 2023-08-10T10:34:10.443 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f49745ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496c0cab70 con 0x7f496c1593b0 2023-08-10T10:34:10.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f4971b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f496c159790 0x7f496c071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f4971b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f496c159790 0x7f496c071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54428/0 (socket says 172.21.15.88:54428) 2023-08-10T10:34:10.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f4971b9a700 1 -- 172.21.15.88:0/972905105 learned_addr learned my addr 172.21.15.88:0/972905105 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:10.444 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.442+0000 7f497239b700 1 --2- 172.21.15.88:0/972905105 >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 0x7f496c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.445 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971b9a700 1 -- 172.21.15.88:0/972905105 >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 msgr2=0x7f496c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:10.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971b9a700 1 --2- 172.21.15.88:0/972905105 >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 0x7f496c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971b9a700 1 -- 172.21.15.88:0/972905105 >> v1:172.21.15.187:6789/0 conn(0x7f496c0c9f20 legacy=0x7f496c0ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971b9a700 1 -- 172.21.15.88:0/972905105 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f496c0cae50 con 0x7f496c159790 2023-08-10T10:34:10.446 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f497239b700 1 --2- 172.21.15.88:0/972905105 >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 0x7f496c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:10.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971b9a700 1 --2- 172.21.15.88:0/972905105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c159790 0x7f496c071760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f496c06ebc0 tx=0x7f495c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d80c2366a9c745b server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:10.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971399700 1 -- 172.21.15.88:0/972905105 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00b870 con 0x7f496c159790 2023-08-10T10:34:10.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971399700 1 -- 172.21.15.88:0/972905105 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c00b9d0 con 0x7f496c159790 2023-08-10T10:34:10.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.443+0000 7f4971399700 1 -- 172.21.15.88:0/972905105 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c00bd60 con 0x7f496c159790 2023-08-10T10:34:10.447 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 -- 172.21.15.88:0/972905105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c159790 msgr2=0x7f496c071760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 --2- 172.21.15.88:0/972905105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c159790 0x7f496c071760 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f496c06ebc0 tx=0x7f495c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 -- 172.21.15.88:0/972905105 shutdown_connections 2023-08-10T10:34:10.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 --2- 172.21.15.88:0/972905105 >> v2:172.21.15.187:3300/0 conn(0x7f496c1593b0 0x7f496c071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 --2- 172.21.15.88:0/972905105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c159790 0x7f496c071760 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.448 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 -- 172.21.15.88:0/972905105 >> 172.21.15.88:0/972905105 conn(0x7f496c0ced50 msgr2=0x7f496c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:10.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 -- 172.21.15.88:0/972905105 shutdown_connections 2023-08-10T10:34:10.449 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.444+0000 7f49745ff700 1 -- 172.21.15.88:0/972905105 wait complete. 2023-08-10T10:34:10.450 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.446+0000 7f49745ff700 1 Processor -- start 2023-08-10T10:34:10.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.446+0000 7f49745ff700 1 -- start start 2023-08-10T10:34:10.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f496c0c9f20 0x7f496c1f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f496c159790 0x7f496c0c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.451 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c54d0 con 0x7f496c1593b0 2023-08-10T10:34:10.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c6fa0 con 0x7f496c159790 2023-08-10T10:34:10.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f49745ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f496c0c7280 con 0x7f496c0c9f20 2023-08-10T10:34:10.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:54442/0 (socket says 172.21.15.88:54442) 2023-08-10T10:34:10.452 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 -- 172.21.15.88:0/1659284196 learned_addr learned my addr 172.21.15.88:0/1659284196 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:10.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f497239b700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f496c0c9f20 0x7f496c1f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4972b9c700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f496c159790 0x7f496c0c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 -- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f496c0c9f20 msgr2=0x7f496c1f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f496c0c9f20 0x7f496c1f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.453 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 -- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f496c159790 msgr2=0x7f496c0c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f496c159790 0x7f496c0c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.447+0000 7f4971b9a700 1 -- 172.21.15.88:0/1659284196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009550 con 0x7f496c1593b0 2023-08-10T10:34:10.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f4971b9a700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:10.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c004540 con 0x7f496c1593b0 2023-08-10T10:34:10.454 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c0036a0 con 0x7f496c1593b0 2023-08-10T10:34:10.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c003a50 con 0x7f496c1593b0 2023-08-10T10:34:10.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c1534c0 con 0x7f496c1593b0 2023-08-10T10:34:10.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.448+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c1f3100 con 0x7f496c1593b0 2023-08-10T10:34:10.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.449+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496c1539e0 con 0x7f496c1593b0 2023-08-10T10:34:10.455 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.450+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f495c021070 con 0x7f496c1593b0 2023-08-10T10:34:10.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.451+0000 7f4962ffd700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 0x7f495006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:10.456 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.451+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f495c08ae80 con 0x7f496c1593b0 2023-08-10T10:34:10.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.451+0000 7f497239b700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 0x7f495006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:10.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.452+0000 7f497239b700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 0x7f495006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f496c06e0f0 tx=0x7f4968008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:10.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.455+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f496c1539e0 con 0x7f496c1593b0 2023-08-10T10:34:10.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.648+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f496c0cc870 con 0x7f495006ace0 2023-08-10T10:34:10.659 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.658+0000 7f4962ffd700 1 -- 172.21.15.88:0/1659284196 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+391679 (secure 0 0 0) 0x7f49680095c0 con 0x7f495006ace0 2023-08-10T10:34:10.663 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:10.666 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.663+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 msgr2=0x7f495006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.663+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 0x7f495006d1a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f496c06e0f0 tx=0x7f4968008040 comp rx=0 tx=0).stop 2023-08-10T10:34:10.667 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.663+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 msgr2=0x7f496c0c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:10.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.663+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f495c000c00 tx=0x7f495c004750 comp rx=0 tx=0).stop 2023-08-10T10:34:10.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 shutdown_connections 2023-08-10T10:34:10.668 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f496c159790 0x7f496c0c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f495006ace0 0x7f495006d1a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f496c0c9f20 0x7f496c1f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.669 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 --2- 172.21.15.88:0/1659284196 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f496c1593b0 0x7f496c0c4f90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:10.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 >> 172.21.15.88:0/1659284196 conn(0x7f496c0ced50 msgr2=0x7f496c156a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:10.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 shutdown_connections 2023-08-10T10:34:10.670 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:10.664+0000 7f49745ff700 1 -- 172.21.15.88:0/1659284196 wait complete. 2023-08-10T10:34:10.670 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:34:10.683 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2023-08-10T10:34:09.615612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113890039,"num_objects":53,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":1382,"num_write_kb":1081239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17778,"ondisk_log_size":17778,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":494340,"kb_used_data":224964,"kb_used_omap":13,"kb_used_meta":269298,"kb_avail":754480380,"statfs":{"total":773094113280,"available":772587909120,"internally_reserved":0,"allocated":230363136,"data_stored":228852459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":275761240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003276"},"pg_stats":[{"pgid":"4.3f","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.883026+0000","last_change":"2023-08-10T10:33:36.883077+0000","last_active":"2023-08-10T10:33:36.883026+0000","last_peered":"2023-08-10T10:33:36.883026+0000","last_clean":"2023-08-10T10:33:36.883026+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:36.883026+0000","last_undegraded":"2023-08-10T10:33:36.883026+0000","last_fullsized":"2023-08-10T10:33:36.883026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.882946+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:55.798064+0000","scrub_duration":0.001698803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.975771+0000","last_change":"2023-08-10T10:30:34.339531+0000","last_active":"2023-08-10T10:33:19.975771+0000","last_peered":"2023-08-10T10:33:19.975771+0000","last_clean":"2023-08-10T10:33:19.975771+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:33:19.975771+0000","last_undegraded":"2023-08-10T10:33:19.975771+0000","last_fullsized":"2023-08-10T10:33:19.975771+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'42","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989909+0000","last_change":"2023-08-10T10:30:34.336267+0000","last_active":"2023-08-10T10:33:19.989909+0000","last_peered":"2023-08-10T10:33:19.989909+0000","last_clean":"2023-08-10T10:33:19.989909+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:33:19.989909+0000","last_undegraded":"2023-08-10T10:33:19.989909+0000","last_fullsized":"2023-08-10T10:33:19.989909+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.739305+0000","last_change":"2023-08-10T10:33:59.739357+0000","last_active":"2023-08-10T10:33:59.739305+0000","last_peered":"2023-08-10T10:33:59.739305+0000","last_clean":"2023-08-10T10:33:59.739305+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:59.739305+0000","last_undegraded":"2023-08-10T10:33:59.739305+0000","last_fullsized":"2023-08-10T10:33:59.739305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.739228+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:25:24.684820+0000","scrub_duration":0.0021901009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.899724+0000","last_change":"2023-08-10T10:33:25.899769+0000","last_active":"2023-08-10T10:33:25.899724+0000","last_peered":"2023-08-10T10:33:25.899724+0000","last_clean":"2023-08-10T10:33:25.899724+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:25.899724+0000","last_undegraded":"2023-08-10T10:33:25.899724+0000","last_fullsized":"2023-08-10T10:33:25.899724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.899655+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.048352+0000","scrub_duration":0.001506755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'38","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991091+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:19.991091+0000","last_peered":"2023-08-10T10:33:19.991091+0000","last_clean":"2023-08-10T10:33:19.991091+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:19.991091+0000","last_undegraded":"2023-08-10T10:33:19.991091+0000","last_fullsized":"2023-08-10T10:33:19.991091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.235707+0000","last_change":"2023-08-10T10:33:59.235761+0000","last_active":"2023-08-10T10:33:59.235707+0000","last_peered":"2023-08-10T10:33:59.235707+0000","last_clean":"2023-08-10T10:33:59.235707+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:59.235707+0000","last_undegraded":"2023-08-10T10:33:59.235707+0000","last_fullsized":"2023-08-10T10:33:59.235707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.235628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:24.883888+0000","scrub_duration":0.0021164880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979049+0000","last_change":"2023-08-10T10:30:34.339514+0000","last_active":"2023-08-10T10:33:19.979049+0000","last_peered":"2023-08-10T10:33:19.979049+0000","last_clean":"2023-08-10T10:33:19.979049+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:33:19.979049+0000","last_undegraded":"2023-08-10T10:33:19.979049+0000","last_fullsized":"2023-08-10T10:33:19.979049+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'37","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979468+0000","last_change":"2023-08-10T10:31:15.301420+0000","last_active":"2023-08-10T10:33:19.979468+0000","last_peered":"2023-08-10T10:33:19.979468+0000","last_clean":"2023-08-10T10:33:19.979468+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:33:19.979468+0000","last_undegraded":"2023-08-10T10:33:19.979468+0000","last_fullsized":"2023-08-10T10:33:19.979468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'44","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.066157+0000","last_change":"2023-08-10T10:33:30.066237+0000","last_active":"2023-08-10T10:33:30.066157+0000","last_peered":"2023-08-10T10:33:30.066157+0000","last_clean":"2023-08-10T10:33:30.066157+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:30.066157+0000","last_undegraded":"2023-08-10T10:33:30.066157+0000","last_fullsized":"2023-08-10T10:33:30.066157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.066062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:46.020476+0000","scrub_duration":0.0021977630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.517329+0000","last_change":"2023-08-10T10:33:33.517379+0000","last_active":"2023-08-10T10:33:33.517329+0000","last_peered":"2023-08-10T10:33:33.517329+0000","last_clean":"2023-08-10T10:33:33.517329+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:33.517329+0000","last_undegraded":"2023-08-10T10:33:33.517329+0000","last_fullsized":"2023-08-10T10:33:33.517329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.517247+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:41.342304+0000","scrub_duration":0.002340221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.902165+0000","last_change":"2023-08-10T10:33:35.902217+0000","last_active":"2023-08-10T10:33:35.902165+0000","last_peered":"2023-08-10T10:33:35.902165+0000","last_clean":"2023-08-10T10:33:35.902165+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:35.902165+0000","last_undegraded":"2023-08-10T10:33:35.902165+0000","last_fullsized":"2023-08-10T10:33:35.902165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.902089+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:01.877768+0000","scrub_duration":0.0023654119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.879384+0000","last_change":"2023-08-10T10:33:31.879433+0000","last_active":"2023-08-10T10:33:31.879384+0000","last_peered":"2023-08-10T10:33:31.879384+0000","last_clean":"2023-08-10T10:33:31.879384+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:31.879384+0000","last_undegraded":"2023-08-10T10:33:31.879384+0000","last_fullsized":"2023-08-10T10:33:31.879384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.879295+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:47.686858+0000","scrub_duration":0.001582806,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.929484+0000","last_change":"2023-08-10T10:33:36.929535+0000","last_active":"2023-08-10T10:33:36.929484+0000","last_peered":"2023-08-10T10:33:36.929484+0000","last_clean":"2023-08-10T10:33:36.929484+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:36.929484+0000","last_undegraded":"2023-08-10T10:33:36.929484+0000","last_fullsized":"2023-08-10T10:33:36.929484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.929396+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:24.773523+0000","scrub_duration":0.0025361160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.229130+0000","last_change":"2023-08-10T10:34:00.229186+0000","last_active":"2023-08-10T10:34:00.229130+0000","last_peered":"2023-08-10T10:34:00.229130+0000","last_clean":"2023-08-10T10:34:00.229130+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:34:00.229130+0000","last_undegraded":"2023-08-10T10:34:00.229130+0000","last_fullsized":"2023-08-10T10:34:00.229130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.229006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:23.598603+0000","scrub_duration":0.002074916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'38","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.992262+0000","last_change":"2023-08-10T10:30:34.335530+0000","last_active":"2023-08-10T10:33:19.992262+0000","last_peered":"2023-08-10T10:33:19.992262+0000","last_clean":"2023-08-10T10:33:19.992262+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:33:19.992262+0000","last_undegraded":"2023-08-10T10:33:19.992262+0000","last_fullsized":"2023-08-10T10:33:19.992262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'36","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.107239+0000","last_change":"2023-08-10T10:34:02.107288+0000","last_active":"2023-08-10T10:34:02.107239+0000","last_peered":"2023-08-10T10:34:02.107239+0000","last_clean":"2023-08-10T10:34:02.107239+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:34:02.107239+0000","last_undegraded":"2023-08-10T10:34:02.107239+0000","last_fullsized":"2023-08-10T10:34:02.107239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.107165+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:27.755425+0000","scrub_duration":0.0016039889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.585707+0000","last_change":"2023-08-10T10:33:27.585762+0000","last_active":"2023-08-10T10:33:27.585707+0000","last_peered":"2023-08-10T10:33:27.585707+0000","last_clean":"2023-08-10T10:33:27.585707+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:27.585707+0000","last_undegraded":"2023-08-10T10:33:27.585707+0000","last_fullsized":"2023-08-10T10:33:27.585707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.585622+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:18.903219+0000","scrub_duration":0.0017968820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.813816+0000","last_change":"2023-08-10T10:33:39.813869+0000","last_active":"2023-08-10T10:33:39.813816+0000","last_peered":"2023-08-10T10:33:39.813816+0000","last_clean":"2023-08-10T10:33:39.813816+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:39.813816+0000","last_undegraded":"2023-08-10T10:33:39.813816+0000","last_fullsized":"2023-08-10T10:33:39.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.813733+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:37.309818+0000","scrub_duration":0.0023901679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.581199+0000","last_change":"2023-08-10T10:33:31.581251+0000","last_active":"2023-08-10T10:33:31.581199+0000","last_peered":"2023-08-10T10:33:31.581199+0000","last_clean":"2023-08-10T10:33:31.581199+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:31.581199+0000","last_undegraded":"2023-08-10T10:33:31.581199+0000","last_fullsized":"2023-08-10T10:33:31.581199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.581116+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:27.046813+0000","scrub_duration":0.0015992249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'41","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978489+0000","last_change":"2023-08-10T10:30:34.338090+0000","last_active":"2023-08-10T10:33:19.978489+0000","last_peered":"2023-08-10T10:33:19.978489+0000","last_clean":"2023-08-10T10:33:19.978489+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:33:19.978489+0000","last_undegraded":"2023-08-10T10:33:19.978489+0000","last_fullsized":"2023-08-10T10:33:19.978489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.940798+0000","last_change":"2023-08-10T10:33:39.940853+0000","last_active":"2023-08-10T10:33:39.940798+0000","last_peered":"2023-08-10T10:33:39.940798+0000","last_clean":"2023-08-10T10:33:39.940798+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:39.940798+0000","last_undegraded":"2023-08-10T10:33:39.940798+0000","last_fullsized":"2023-08-10T10:33:39.940798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.940687+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:46.721896+0000","scrub_duration":0.00155013,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'35","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.161482+0000","last_change":"2023-08-10T10:33:31.161534+0000","last_active":"2023-08-10T10:33:31.161482+0000","last_peered":"2023-08-10T10:33:31.161482+0000","last_clean":"2023-08-10T10:33:31.161482+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:31.161482+0000","last_undegraded":"2023-08-10T10:33:31.161482+0000","last_fullsized":"2023-08-10T10:33:31.161482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.161398+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:36.341462+0000","scrub_duration":0.0014948749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'33","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.981594+0000","last_change":"2023-08-10T10:30:34.336491+0000","last_active":"2023-08-10T10:33:19.981594+0000","last_peered":"2023-08-10T10:33:19.981594+0000","last_clean":"2023-08-10T10:33:19.981594+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:33:19.981594+0000","last_undegraded":"2023-08-10T10:33:19.981594+0000","last_fullsized":"2023-08-10T10:33:19.981594+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.648876+0000","last_change":"2023-08-10T10:33:51.648966+0000","last_active":"2023-08-10T10:33:51.648876+0000","last_peered":"2023-08-10T10:33:51.648876+0000","last_clean":"2023-08-10T10:33:51.648876+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:51.648876+0000","last_undegraded":"2023-08-10T10:33:51.648876+0000","last_fullsized":"2023-08-10T10:33:51.648876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.648764+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:35.551430+0000","scrub_duration":0.0021019300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'37","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.711548+0000","last_change":"2023-08-10T10:33:45.711619+0000","last_active":"2023-08-10T10:33:45.711548+0000","last_peered":"2023-08-10T10:33:45.711548+0000","last_clean":"2023-08-10T10:33:45.711548+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:45.711548+0000","last_undegraded":"2023-08-10T10:33:45.711548+0000","last_fullsized":"2023-08-10T10:33:45.711548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.711454+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:52.492664+0000","scrub_duration":0.0016896599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.042561+0000","last_change":"2023-08-10T10:33:29.042633+0000","last_active":"2023-08-10T10:33:29.042561+0000","last_peered":"2023-08-10T10:33:29.042561+0000","last_clean":"2023-08-10T10:33:29.042561+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:29.042561+0000","last_undegraded":"2023-08-10T10:33:29.042561+0000","last_fullsized":"2023-08-10T10:33:29.042561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.042483+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.511552+0000","scrub_duration":0.001545306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'444","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593004+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:20.593004+0000","last_peered":"2023-08-10T10:33:20.593004+0000","last_clean":"2023-08-10T10:33:20.593004+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:20.593004+0000","last_undegraded":"2023-08-10T10:33:20.593004+0000","last_fullsized":"2023-08-10T10:33:20.593004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.623062+0000","last_change":"2023-08-10T10:34:02.623115+0000","last_active":"2023-08-10T10:34:02.623062+0000","last_peered":"2023-08-10T10:34:02.623062+0000","last_clean":"2023-08-10T10:34:02.623062+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:34:02.623062+0000","last_undegraded":"2023-08-10T10:34:02.623062+0000","last_fullsized":"2023-08-10T10:34:02.623062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.622978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:44.380373+0000","scrub_duration":0.001989092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'39","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982339+0000","last_change":"2023-08-10T10:30:34.335883+0000","last_active":"2023-08-10T10:33:19.982339+0000","last_peered":"2023-08-10T10:33:19.982339+0000","last_clean":"2023-08-10T10:33:19.982339+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:33:19.982339+0000","last_undegraded":"2023-08-10T10:33:19.982339+0000","last_fullsized":"2023-08-10T10:33:19.982339+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'473","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.679083+0000","last_change":"2023-08-10T10:34:02.679172+0000","last_active":"2023-08-10T10:34:02.679083+0000","last_peered":"2023-08-10T10:34:02.679083+0000","last_clean":"2023-08-10T10:34:02.679083+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:34:02.679083+0000","last_undegraded":"2023-08-10T10:34:02.679083+0000","last_fullsized":"2023-08-10T10:34:02.679083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.679000+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:46.106964+0000","scrub_duration":0.0058418979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.715152+0000","last_change":"2023-08-10T10:33:33.715201+0000","last_active":"2023-08-10T10:33:33.715152+0000","last_peered":"2023-08-10T10:33:33.715152+0000","last_clean":"2023-08-10T10:33:33.715152+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:33:33.715152+0000","last_undegraded":"2023-08-10T10:33:33.715152+0000","last_fullsized":"2023-08-10T10:33:33.715152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.715068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:04.044108+0000","scrub_duration":0.0015745259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.054243+0000","last_change":"2023-08-10T10:33:48.054296+0000","last_active":"2023-08-10T10:33:48.054243+0000","last_peered":"2023-08-10T10:33:48.054243+0000","last_clean":"2023-08-10T10:33:48.054243+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:48.054243+0000","last_undegraded":"2023-08-10T10:33:48.054243+0000","last_fullsized":"2023-08-10T10:33:48.054243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.054163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:31.956829+0000","scrub_duration":0.0021941999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'477","reported_seq":496,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.606501+0000","last_change":"2023-08-10T10:30:38.388149+0000","last_active":"2023-08-10T10:33:20.606501+0000","last_peered":"2023-08-10T10:33:20.606501+0000","last_clean":"2023-08-10T10:33:20.606501+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:33:20.606501+0000","last_undegraded":"2023-08-10T10:33:20.606501+0000","last_fullsized":"2023-08-10T10:33:20.606501+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:56.307143+0000","last_change":"2023-08-10T10:33:56.307192+0000","last_active":"2023-08-10T10:33:56.307143+0000","last_peered":"2023-08-10T10:33:56.307143+0000","last_clean":"2023-08-10T10:33:56.307143+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:33:56.307143+0000","last_undegraded":"2023-08-10T10:33:56.307143+0000","last_fullsized":"2023-08-10T10:33:56.307143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_clean_scrub_stamp":"2023-08-10T10:33:56.307064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:19.676661+0000","scrub_duration":0.001379796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.850329+0000","last_change":"2023-08-10T10:33:47.850385+0000","last_active":"2023-08-10T10:33:47.850329+0000","last_peered":"2023-08-10T10:33:47.850329+0000","last_clean":"2023-08-10T10:33:47.850329+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:47.850329+0000","last_undegraded":"2023-08-10T10:33:47.850329+0000","last_fullsized":"2023-08-10T10:33:47.850329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.850250+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:26.814272+0000","scrub_duration":0.0016867119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":488,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.698975+0000","last_change":"2023-08-10T10:34:00.699070+0000","last_active":"2023-08-10T10:34:00.698975+0000","last_peered":"2023-08-10T10:34:00.698975+0000","last_clean":"2023-08-10T10:34:00.698975+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:34:00.698975+0000","last_undegraded":"2023-08-10T10:34:00.698975+0000","last_fullsized":"2023-08-10T10:34:00.698975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'461","last_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_deep_scrub":"29'461","last_deep_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.698874+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:31.027914+0000","scrub_duration":0.0070033159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.008482+0000","last_change":"2023-08-10T10:33:34.008533+0000","last_active":"2023-08-10T10:33:34.008482+0000","last_peered":"2023-08-10T10:33:34.008482+0000","last_clean":"2023-08-10T10:33:34.008482+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:33:34.008482+0000","last_undegraded":"2023-08-10T10:33:34.008482+0000","last_fullsized":"2023-08-10T10:33:34.008482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.008392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:21.852519+0000","scrub_duration":0.002546034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'27","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.171650+0000","last_change":"2023-08-10T10:33:34.171704+0000","last_active":"2023-08-10T10:33:34.171650+0000","last_peered":"2023-08-10T10:33:34.171650+0000","last_clean":"2023-08-10T10:33:34.171650+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:34.171650+0000","last_undegraded":"2023-08-10T10:33:34.171650+0000","last_fullsized":"2023-08-10T10:33:34.171650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.171561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:40.952770+0000","scrub_duration":0.001549545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'465","reported_seq":484,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.605927+0000","last_change":"2023-08-10T10:30:38.404037+0000","last_active":"2023-08-10T10:33:20.605927+0000","last_peered":"2023-08-10T10:33:20.605927+0000","last_clean":"2023-08-10T10:33:20.605927+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:33:20.605927+0000","last_undegraded":"2023-08-10T10:33:20.605927+0000","last_fullsized":"2023-08-10T10:33:20.605927+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.005191+0000","last_change":"2023-08-10T10:33:54.005241+0000","last_active":"2023-08-10T10:33:54.005191+0000","last_peered":"2023-08-10T10:33:54.005191+0000","last_clean":"2023-08-10T10:33:54.005191+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:33:54.005191+0000","last_undegraded":"2023-08-10T10:33:54.005191+0000","last_fullsized":"2023-08-10T10:33:54.005191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.005110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:01.830167+0000","scrub_duration":0.001665653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'36","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979918+0000","last_change":"2023-08-10T10:30:34.334809+0000","last_active":"2023-08-10T10:33:19.979918+0000","last_peered":"2023-08-10T10:33:19.979918+0000","last_clean":"2023-08-10T10:33:19.979918+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:33:19.979918+0000","last_undegraded":"2023-08-10T10:33:19.979918+0000","last_fullsized":"2023-08-10T10:33:19.979918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.682684+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.682684+0000","last_peered":"2023-08-10T10:33:16.682684+0000","last_clean":"2023-08-10T10:33:16.682684+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.682684+0000","last_undegraded":"2023-08-10T10:33:16.682684+0000","last_fullsized":"2023-08-10T10:33:16.682684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.340567+0000","last_change":"2023-08-10T10:33:48.340677+0000","last_active":"2023-08-10T10:33:48.340567+0000","last_peered":"2023-08-10T10:33:48.340567+0000","last_clean":"2023-08-10T10:33:48.340567+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:48.340567+0000","last_undegraded":"2023-08-10T10:33:48.340567+0000","last_fullsized":"2023-08-10T10:33:48.340567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.340462+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:32.243128+0000","scrub_duration":0.0055728410000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'42","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.699136+0000","last_change":"2023-08-10T10:33:40.699214+0000","last_active":"2023-08-10T10:33:40.699136+0000","last_peered":"2023-08-10T10:33:40.699136+0000","last_clean":"2023-08-10T10:33:40.699136+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:40.699136+0000","last_undegraded":"2023-08-10T10:33:40.699136+0000","last_fullsized":"2023-08-10T10:33:40.699136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.699048+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:29.397615+0000","scrub_duration":0.0021018759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'455","reported_seq":474,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.604908+0000","last_change":"2023-08-10T10:30:38.393232+0000","last_active":"2023-08-10T10:33:20.604908+0000","last_peered":"2023-08-10T10:33:20.604908+0000","last_clean":"2023-08-10T10:33:20.604908+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:33:20.604908+0000","last_undegraded":"2023-08-10T10:33:20.604908+0000","last_fullsized":"2023-08-10T10:33:20.604908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'627","reported_seq":662,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:58.493785+0000","last_change":"2023-08-10T10:33:58.493843+0000","last_active":"2023-08-10T10:33:58.493785+0000","last_peered":"2023-08-10T10:33:58.493785+0000","last_clean":"2023-08-10T10:33:58.493785+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:58.493785+0000","last_undegraded":"2023-08-10T10:33:58.493785+0000","last_fullsized":"2023-08-10T10:33:58.493785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'627","last_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_deep_scrub":"29'627","last_deep_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:58.493691+0000","objects_scrubbed":4,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:26.432825+0000","scrub_duration":0.012523909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142065,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.995794+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:19.995794+0000","last_peered":"2023-08-10T10:33:19.995794+0000","last_clean":"2023-08-10T10:33:19.995794+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:19.995794+0000","last_undegraded":"2023-08-10T10:33:19.995794+0000","last_fullsized":"2023-08-10T10:33:19.995794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":508,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.691722+0000","last_change":"2023-08-10T10:30:38.397926+0000","last_active":"2023-08-10T10:33:16.691722+0000","last_peered":"2023-08-10T10:33:16.691722+0000","last_clean":"2023-08-10T10:33:16.691722+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:33:16.691722+0000","last_undegraded":"2023-08-10T10:33:16.691722+0000","last_fullsized":"2023-08-10T10:33:16.691722+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.358720+0000","last_change":"2023-08-10T10:33:47.358774+0000","last_active":"2023-08-10T10:33:47.358720+0000","last_peered":"2023-08-10T10:33:47.358720+0000","last_clean":"2023-08-10T10:33:47.358720+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:33:47.358720+0000","last_undegraded":"2023-08-10T10:33:47.358720+0000","last_fullsized":"2023-08-10T10:33:47.358720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.358645+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:12.879510+0000","scrub_duration":0.0040639780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.233719+0000","last_change":"2023-08-10T10:33:28.233783+0000","last_active":"2023-08-10T10:33:28.233719+0000","last_peered":"2023-08-10T10:33:28.233719+0000","last_clean":"2023-08-10T10:33:28.233719+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:28.233719+0000","last_undegraded":"2023-08-10T10:33:28.233719+0000","last_fullsized":"2023-08-10T10:33:28.233719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.233641+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:16.077769+0000","scrub_duration":0.0020674529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'456","reported_seq":475,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.611815+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:20.611815+0000","last_peered":"2023-08-10T10:33:20.611815+0000","last_clean":"2023-08-10T10:33:20.611815+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:20.611815+0000","last_undegraded":"2023-08-10T10:33:20.611815+0000","last_fullsized":"2023-08-10T10:33:20.611815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.007534+0000","last_change":"2023-08-10T10:33:36.007599+0000","last_active":"2023-08-10T10:33:36.007534+0000","last_peered":"2023-08-10T10:33:36.007534+0000","last_clean":"2023-08-10T10:33:36.007534+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:33:36.007534+0000","last_undegraded":"2023-08-10T10:33:36.007534+0000","last_fullsized":"2023-08-10T10:33:36.007534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.007457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:24.706023+0000","scrub_duration":0.002469873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.992559+0000","last_change":"2023-08-10T10:34:03.992622+0000","last_active":"2023-08-10T10:34:03.992559+0000","last_peered":"2023-08-10T10:34:03.992559+0000","last_clean":"2023-08-10T10:34:03.992559+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:34:03.992559+0000","last_undegraded":"2023-08-10T10:34:03.992559+0000","last_fullsized":"2023-08-10T10:34:03.992559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.992472+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:29.640732+0000","scrub_duration":0.0016651019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:16.603925+0000","last_peered":"2023-08-10T10:33:16.603925+0000","last_clean":"2023-08-10T10:33:16.603925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:16.603925+0000","last_undegraded":"2023-08-10T10:33:16.603925+0000","last_fullsized":"2023-08-10T10:33:16.603925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.321985+0000","last_change":"2023-08-10T10:33:45.322039+0000","last_active":"2023-08-10T10:33:45.321985+0000","last_peered":"2023-08-10T10:33:45.321985+0000","last_clean":"2023-08-10T10:33:45.321985+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:45.321985+0000","last_undegraded":"2023-08-10T10:33:45.321985+0000","last_fullsized":"2023-08-10T10:33:45.321985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.321894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:36.639491+0000","scrub_duration":0.0016593409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'39","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.155840+0000","last_change":"2023-08-10T10:34:03.155890+0000","last_active":"2023-08-10T10:34:03.155840+0000","last_peered":"2023-08-10T10:34:03.155840+0000","last_clean":"2023-08-10T10:34:03.155840+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:34:03.155840+0000","last_undegraded":"2023-08-10T10:34:03.155840+0000","last_fullsized":"2023-08-10T10:34:03.155840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.155763+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.525360+0000","scrub_duration":0.0016010919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'510","reported_seq":529,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603792+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:20.603792+0000","last_peered":"2023-08-10T10:33:20.603792+0000","last_clean":"2023-08-10T10:33:20.603792+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:20.603792+0000","last_undegraded":"2023-08-10T10:33:20.603792+0000","last_fullsized":"2023-08-10T10:33:20.603792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.909944+0000","last_change":"2023-08-10T10:33:33.910006+0000","last_active":"2023-08-10T10:33:33.909944+0000","last_peered":"2023-08-10T10:33:33.909944+0000","last_clean":"2023-08-10T10:33:33.909944+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:33:33.909944+0000","last_undegraded":"2023-08-10T10:33:33.909944+0000","last_fullsized":"2023-08-10T10:33:33.909944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.909866+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:52.137280+0000","scrub_duration":0.0047131780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.978556+0000","last_change":"2023-08-10T10:30:34.340498+0000","last_active":"2023-08-10T10:33:19.978556+0000","last_peered":"2023-08-10T10:33:19.978556+0000","last_clean":"2023-08-10T10:33:19.978556+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:33:19.978556+0000","last_undegraded":"2023-08-10T10:33:19.978556+0000","last_fullsized":"2023-08-10T10:33:19.978556+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.687708+0000","last_change":"2023-08-10T10:30:38.396154+0000","last_active":"2023-08-10T10:33:16.687708+0000","last_peered":"2023-08-10T10:33:16.687708+0000","last_clean":"2023-08-10T10:33:16.687708+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:33:16.687708+0000","last_undegraded":"2023-08-10T10:33:16.687708+0000","last_fullsized":"2023-08-10T10:33:16.687708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.286658+0000","last_change":"2023-08-10T10:33:35.286714+0000","last_active":"2023-08-10T10:33:35.286658+0000","last_peered":"2023-08-10T10:33:35.286658+0000","last_clean":"2023-08-10T10:33:35.286658+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:35.286658+0000","last_undegraded":"2023-08-10T10:33:35.286658+0000","last_fullsized":"2023-08-10T10:33:35.286658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.286568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:23.130695+0000","scrub_duration":0.0033667300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'29","reported_seq":54,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.972007+0000","last_change":"2023-08-10T10:30:34.350711+0000","last_active":"2023-08-10T10:33:19.972007+0000","last_peered":"2023-08-10T10:33:19.972007+0000","last_clean":"2023-08-10T10:33:19.972007+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:33:19.972007+0000","last_undegraded":"2023-08-10T10:33:19.972007+0000","last_fullsized":"2023-08-10T10:33:19.972007+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":524,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:46.780481+0000","last_change":"2023-08-10T10:33:46.780614+0000","last_active":"2023-08-10T10:33:46.780481+0000","last_peered":"2023-08-10T10:33:46.780481+0000","last_clean":"2023-08-10T10:33:46.780481+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:46.780481+0000","last_undegraded":"2023-08-10T10:33:46.780481+0000","last_fullsized":"2023-08-10T10:33:46.780481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'497","last_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_deep_scrub":"29'497","last_deep_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_clean_scrub_stamp":"2023-08-10T10:33:46.780378+0000","objects_scrubbed":2,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:26.660886+0000","scrub_duration":0.010450968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.274812+0000","last_change":"2023-08-10T10:33:51.274878+0000","last_active":"2023-08-10T10:33:51.274812+0000","last_peered":"2023-08-10T10:33:51.274812+0000","last_clean":"2023-08-10T10:33:51.274812+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:33:51.274812+0000","last_undegraded":"2023-08-10T10:33:51.274812+0000","last_fullsized":"2023-08-10T10:33:51.274812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.274730+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:59.099787+0000","scrub_duration":0.0029352610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991136+0000","last_change":"2023-08-10T10:30:34.334026+0000","last_active":"2023-08-10T10:33:19.991136+0000","last_peered":"2023-08-10T10:33:19.991136+0000","last_clean":"2023-08-10T10:33:19.991136+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:33:19.991136+0000","last_undegraded":"2023-08-10T10:33:19.991136+0000","last_fullsized":"2023-08-10T10:33:19.991136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'473","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.753624+0000","last_change":"2023-08-10T10:33:54.753735+0000","last_active":"2023-08-10T10:33:54.753624+0000","last_peered":"2023-08-10T10:33:54.753624+0000","last_clean":"2023-08-10T10:33:54.753624+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:54.753624+0000","last_undegraded":"2023-08-10T10:33:54.753624+0000","last_fullsized":"2023-08-10T10:33:54.753624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.753507+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:21.530219+0000","scrub_duration":0.0074936170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.347637+0000","last_change":"2023-08-10T10:33:49.347692+0000","last_active":"2023-08-10T10:33:49.347637+0000","last_peered":"2023-08-10T10:33:49.347637+0000","last_clean":"2023-08-10T10:33:49.347637+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:33:49.347637+0000","last_undegraded":"2023-08-10T10:33:49.347637+0000","last_fullsized":"2023-08-10T10:33:49.347637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.347549+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.813246+0000","scrub_duration":0.0030245340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:57.750541+0000","last_change":"2023-08-10T10:33:57.750610+0000","last_active":"2023-08-10T10:33:57.750541+0000","last_peered":"2023-08-10T10:33:57.750541+0000","last_clean":"2023-08-10T10:33:57.750541+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:57.750541+0000","last_undegraded":"2023-08-10T10:33:57.750541+0000","last_fullsized":"2023-08-10T10:33:57.750541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_clean_scrub_stamp":"2023-08-10T10:33:57.750444+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:51:26.899141+0000","scrub_duration":0.0025147009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.682718+0000","last_change":"2023-08-10T10:33:51.682788+0000","last_active":"2023-08-10T10:33:51.682718+0000","last_peered":"2023-08-10T10:33:51.682718+0000","last_clean":"2023-08-10T10:33:51.682718+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:51.682718+0000","last_undegraded":"2023-08-10T10:33:51.682718+0000","last_fullsized":"2023-08-10T10:33:51.682718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'459","last_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_deep_scrub":"29'459","last_deep_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.682645+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:30.646667+0000","scrub_duration":0.002161919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.058424+0000","last_change":"2023-08-10T10:33:49.058472+0000","last_active":"2023-08-10T10:33:49.058424+0000","last_peered":"2023-08-10T10:33:49.058424+0000","last_clean":"2023-08-10T10:33:49.058424+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:33:49.058424+0000","last_undegraded":"2023-08-10T10:33:49.058424+0000","last_fullsized":"2023-08-10T10:33:49.058424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.058345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.151225+0000","scrub_duration":0.0024074959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.950114+0000","last_change":"2023-08-10T10:33:27.950155+0000","last_active":"2023-08-10T10:33:27.950114+0000","last_peered":"2023-08-10T10:33:27.950114+0000","last_clean":"2023-08-10T10:33:27.950114+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:27.950114+0000","last_undegraded":"2023-08-10T10:33:27.950114+0000","last_fullsized":"2023-08-10T10:33:27.950114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.950050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:52.895642+0000","scrub_duration":0.0013175579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.750589+0000","last_change":"2023-08-10T10:33:47.750695+0000","last_active":"2023-08-10T10:33:47.750589+0000","last_peered":"2023-08-10T10:33:47.750589+0000","last_clean":"2023-08-10T10:33:47.750589+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:47.750589+0000","last_undegraded":"2023-08-10T10:33:47.750589+0000","last_fullsized":"2023-08-10T10:33:47.750589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'441","last_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_deep_scrub":"29'441","last_deep_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.750477+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:44.745054+0000","scrub_duration":0.0026848639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.270842+0000","last_change":"2023-08-10T10:33:40.270896+0000","last_active":"2023-08-10T10:33:40.270842+0000","last_peered":"2023-08-10T10:33:40.270842+0000","last_clean":"2023-08-10T10:33:40.270842+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:33:40.270842+0000","last_undegraded":"2023-08-10T10:33:40.270842+0000","last_fullsized":"2023-08-10T10:33:40.270842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.270765+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:05.791630+0000","scrub_duration":0.0031293139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'26","reported_seq":51,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.993568+0000","last_change":"2023-08-10T10:30:34.343559+0000","last_active":"2023-08-10T10:33:19.993568+0000","last_peered":"2023-08-10T10:33:19.993568+0000","last_clean":"2023-08-10T10:33:19.993568+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:33:19.993568+0000","last_undegraded":"2023-08-10T10:33:19.993568+0000","last_fullsized":"2023-08-10T10:33:19.993568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'479","reported_seq":498,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.617374+0000","last_change":"2023-08-10T10:30:38.406608+0000","last_active":"2023-08-10T10:33:20.617374+0000","last_peered":"2023-08-10T10:33:20.617374+0000","last_clean":"2023-08-10T10:33:20.617374+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:33:20.617374+0000","last_undegraded":"2023-08-10T10:33:20.617374+0000","last_fullsized":"2023-08-10T10:33:20.617374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.952739+0000","last_change":"2023-08-10T10:33:35.952798+0000","last_active":"2023-08-10T10:33:35.952739+0000","last_peered":"2023-08-10T10:33:35.952739+0000","last_clean":"2023-08-10T10:33:35.952739+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:33:35.952739+0000","last_undegraded":"2023-08-10T10:33:35.952739+0000","last_fullsized":"2023-08-10T10:33:35.952739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.952663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.124104+0000","scrub_duration":0.0015171099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.580971+0000","last_change":"2023-08-10T10:33:30.581025+0000","last_active":"2023-08-10T10:33:30.580971+0000","last_peered":"2023-08-10T10:33:30.580971+0000","last_clean":"2023-08-10T10:33:30.580971+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:30.580971+0000","last_undegraded":"2023-08-10T10:33:30.580971+0000","last_fullsized":"2023-08-10T10:33:30.580971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.580850+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:14.483516+0000","scrub_duration":0.0024261040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.604915+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:20.604915+0000","last_peered":"2023-08-10T10:33:20.604915+0000","last_clean":"2023-08-10T10:33:20.604915+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:20.604915+0000","last_undegraded":"2023-08-10T10:33:20.604915+0000","last_fullsized":"2023-08-10T10:33:20.604915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.519905+0000","last_change":"2023-08-10T10:33:54.519965+0000","last_active":"2023-08-10T10:33:54.519905+0000","last_peered":"2023-08-10T10:33:54.519905+0000","last_clean":"2023-08-10T10:33:54.519905+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:33:54.519905+0000","last_undegraded":"2023-08-10T10:33:54.519905+0000","last_fullsized":"2023-08-10T10:33:54.519905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.519822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:05.538972+0000","scrub_duration":0.00232088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'17","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.617446+0000","last_change":"2023-08-10T10:33:29.617535+0000","last_active":"2023-08-10T10:33:29.617446+0000","last_peered":"2023-08-10T10:33:29.617446+0000","last_clean":"2023-08-10T10:33:29.617446+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:29.617446+0000","last_undegraded":"2023-08-10T10:33:29.617446+0000","last_fullsized":"2023-08-10T10:33:29.617446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.617330+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:55.138195+0000","scrub_duration":0.0018756619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.619121+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.619121+0000","last_peered":"2023-08-10T10:33:16.619121+0000","last_clean":"2023-08-10T10:33:16.619121+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.619121+0000","last_undegraded":"2023-08-10T10:33:16.619121+0000","last_fullsized":"2023-08-10T10:33:16.619121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.404468+0000","last_change":"2023-08-10T10:33:45.404519+0000","last_active":"2023-08-10T10:33:45.404468+0000","last_peered":"2023-08-10T10:33:45.404468+0000","last_clean":"2023-08-10T10:33:45.404468+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:33:45.404468+0000","last_undegraded":"2023-08-10T10:33:45.404468+0000","last_fullsized":"2023-08-10T10:33:45.404468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.404381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:53.229438+0000","scrub_duration":0.0015625789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'28","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.693014+0000","last_change":"2023-08-10T10:33:49.693066+0000","last_active":"2023-08-10T10:33:49.693014+0000","last_peered":"2023-08-10T10:33:49.693014+0000","last_clean":"2023-08-10T10:33:49.693014+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:49.693014+0000","last_undegraded":"2023-08-10T10:33:49.693014+0000","last_fullsized":"2023-08-10T10:33:49.693014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.692931+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.785811+0000","scrub_duration":0.001711401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686870+0000","last_change":"2023-08-10T10:30:38.395369+0000","last_active":"2023-08-10T10:33:16.686870+0000","last_peered":"2023-08-10T10:33:16.686870+0000","last_clean":"2023-08-10T10:33:16.686870+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:33:16.686870+0000","last_undegraded":"2023-08-10T10:33:16.686870+0000","last_fullsized":"2023-08-10T10:33:16.686870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.710680+0000","last_change":"2023-08-10T10:33:30.710720+0000","last_active":"2023-08-10T10:33:30.710680+0000","last_peered":"2023-08-10T10:33:30.710680+0000","last_clean":"2023-08-10T10:33:30.710680+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:33:30.710680+0000","last_undegraded":"2023-08-10T10:33:30.710680+0000","last_fullsized":"2023-08-10T10:33:30.710680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.710529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:59.859226+0000","scrub_duration":0.0012663329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.009702+0000","last_change":"2023-08-10T10:33:52.009755+0000","last_active":"2023-08-10T10:33:52.009702+0000","last_peered":"2023-08-10T10:33:52.009702+0000","last_clean":"2023-08-10T10:33:52.009702+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:52.009702+0000","last_undegraded":"2023-08-10T10:33:52.009702+0000","last_fullsized":"2023-08-10T10:33:52.009702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.009622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:47.475319+0000","scrub_duration":0.002330159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.696695+0000","last_change":"2023-08-10T10:33:38.696778+0000","last_active":"2023-08-10T10:33:38.696695+0000","last_peered":"2023-08-10T10:33:38.696695+0000","last_clean":"2023-08-10T10:33:38.696695+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:38.696695+0000","last_undegraded":"2023-08-10T10:33:38.696695+0000","last_fullsized":"2023-08-10T10:33:38.696695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.696559+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:26.540686+0000","scrub_duration":0.0024199579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.595509+0000","last_change":"2023-08-10T10:30:38.400474+0000","last_active":"2023-08-10T10:33:20.595509+0000","last_peered":"2023-08-10T10:33:20.595509+0000","last_clean":"2023-08-10T10:33:20.595509+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:33:20.595509+0000","last_undegraded":"2023-08-10T10:33:20.595509+0000","last_fullsized":"2023-08-10T10:33:20.595509+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:37.948632+0000","last_change":"2023-08-10T10:33:37.948688+0000","last_active":"2023-08-10T10:33:37.948632+0000","last_peered":"2023-08-10T10:33:37.948632+0000","last_clean":"2023-08-10T10:33:37.948632+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:33:37.948632+0000","last_undegraded":"2023-08-10T10:33:37.948632+0000","last_fullsized":"2023-08-10T10:33:37.948632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_clean_scrub_stamp":"2023-08-10T10:33:37.948513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:54.150578+0000","scrub_duration":0.002318966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.532024+0000","last_change":"2023-08-10T10:33:59.532081+0000","last_active":"2023-08-10T10:33:59.532024+0000","last_peered":"2023-08-10T10:33:59.532024+0000","last_clean":"2023-08-10T10:33:59.532024+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:33:59.532024+0000","last_undegraded":"2023-08-10T10:33:59.532024+0000","last_fullsized":"2023-08-10T10:33:59.532024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.531926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:26:59.686329+0000","scrub_duration":0.001805404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.718634+0000","last_change":"2023-08-10T10:33:41.718685+0000","last_active":"2023-08-10T10:33:41.718634+0000","last_peered":"2023-08-10T10:33:41.718634+0000","last_clean":"2023-08-10T10:33:41.718634+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:41.718634+0000","last_undegraded":"2023-08-10T10:33:41.718634+0000","last_fullsized":"2023-08-10T10:33:41.718634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.718538+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:53.207796+0000","scrub_duration":0.001658145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":445,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.707475+0000","last_change":"2023-08-10T10:33:48.707580+0000","last_active":"2023-08-10T10:33:48.707475+0000","last_peered":"2023-08-10T10:33:48.707475+0000","last_clean":"2023-08-10T10:33:48.707475+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:48.707475+0000","last_undegraded":"2023-08-10T10:33:48.707475+0000","last_fullsized":"2023-08-10T10:33:48.707475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'418","last_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_deep_scrub":"29'418","last_deep_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.707382+0000","objects_scrubbed":1,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:23.533062+0000","scrub_duration":0.0072502089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:26.879110+0000","last_change":"2023-08-10T10:33:26.879152+0000","last_active":"2023-08-10T10:33:26.879110+0000","last_peered":"2023-08-10T10:33:26.879110+0000","last_clean":"2023-08-10T10:33:26.879110+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:33:26.879110+0000","last_undegraded":"2023-08-10T10:33:26.879110+0000","last_fullsized":"2023-08-10T10:33:26.879110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_clean_scrub_stamp":"2023-08-10T10:33:26.879039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:12.596625+0000","scrub_duration":0.001274535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.701104+0000","last_change":"2023-08-10T10:33:34.701154+0000","last_active":"2023-08-10T10:33:34.701104+0000","last_peered":"2023-08-10T10:33:34.701104+0000","last_clean":"2023-08-10T10:33:34.701104+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:33:34.701104+0000","last_undegraded":"2023-08-10T10:33:34.701104+0000","last_fullsized":"2023-08-10T10:33:34.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.701006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:58.432269+0000","scrub_duration":0.001815002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.665797+0000","last_change":"2023-08-10T10:33:50.665836+0000","last_active":"2023-08-10T10:33:50.665797+0000","last_peered":"2023-08-10T10:33:50.665797+0000","last_clean":"2023-08-10T10:33:50.665797+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:50.665797+0000","last_undegraded":"2023-08-10T10:33:50.665797+0000","last_fullsized":"2023-08-10T10:33:50.665797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.665732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:16.186597+0000","scrub_duration":0.002561823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":473,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.608391+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.608391+0000","last_peered":"2023-08-10T10:33:16.608391+0000","last_clean":"2023-08-10T10:33:16.608391+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.608391+0000","last_undegraded":"2023-08-10T10:33:16.608391+0000","last_fullsized":"2023-08-10T10:33:16.608391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.003375+0000","last_change":"2023-08-10T10:33:40.003425+0000","last_active":"2023-08-10T10:33:40.003375+0000","last_peered":"2023-08-10T10:33:40.003375+0000","last_clean":"2023-08-10T10:33:40.003375+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:33:40.003375+0000","last_undegraded":"2023-08-10T10:33:40.003375+0000","last_fullsized":"2023-08-10T10:33:40.003375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.003286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:45.183349+0000","scrub_duration":0.0025616390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":199,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.300509+0000","last_change":"2023-08-10T10:33:36.300593+0000","last_active":"2023-08-10T10:33:36.300509+0000","last_peered":"2023-08-10T10:33:36.300509+0000","last_clean":"2023-08-10T10:33:36.300509+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:33:36.300509+0000","last_undegraded":"2023-08-10T10:33:36.300509+0000","last_fullsized":"2023-08-10T10:33:36.300509+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.300423+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:52.502488+0000","scrub_duration":0.0062505190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.276021+0000","last_change":"2023-08-10T10:33:38.276073+0000","last_active":"2023-08-10T10:33:38.276021+0000","last_peered":"2023-08-10T10:33:38.276021+0000","last_clean":"2023-08-10T10:33:38.276021+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:33:38.276021+0000","last_undegraded":"2023-08-10T10:33:38.276021+0000","last_fullsized":"2023-08-10T10:33:38.276021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.275922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:29.593519+0000","scrub_duration":0.002303009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.794328+0000","last_change":"2023-08-10T10:33:50.794377+0000","last_active":"2023-08-10T10:33:50.794328+0000","last_peered":"2023-08-10T10:33:50.794328+0000","last_clean":"2023-08-10T10:33:50.794328+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:50.794328+0000","last_undegraded":"2023-08-10T10:33:50.794328+0000","last_fullsized":"2023-08-10T10:33:50.794328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.794244+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:17.570956+0000","scrub_duration":0.0016971849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'427","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603654+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:20.603654+0000","last_peered":"2023-08-10T10:33:20.603654+0000","last_clean":"2023-08-10T10:33:20.603654+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:20.603654+0000","last_undegraded":"2023-08-10T10:33:20.603654+0000","last_fullsized":"2023-08-10T10:33:20.603654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.298437+0000","last_change":"2023-08-10T10:33:38.298484+0000","last_active":"2023-08-10T10:33:38.298437+0000","last_peered":"2023-08-10T10:33:38.298437+0000","last_clean":"2023-08-10T10:33:38.298437+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:33:38.298437+0000","last_undegraded":"2023-08-10T10:33:38.298437+0000","last_fullsized":"2023-08-10T10:33:38.298437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.298353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:43.478416+0000","scrub_duration":0.002283045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'16","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.996845+0000","last_change":"2023-08-10T10:33:30.996902+0000","last_active":"2023-08-10T10:33:30.996845+0000","last_peered":"2023-08-10T10:33:30.996845+0000","last_clean":"2023-08-10T10:33:30.996845+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:30.996845+0000","last_undegraded":"2023-08-10T10:33:30.996845+0000","last_fullsized":"2023-08-10T10:33:30.996845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.996769+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:14.424734+0000","scrub_duration":0.0026543970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.986781+0000","last_change":"2023-08-10T10:33:43.986851+0000","last_active":"2023-08-10T10:33:43.986781+0000","last_peered":"2023-08-10T10:33:43.986781+0000","last_clean":"2023-08-10T10:33:43.986781+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:43.986781+0000","last_undegraded":"2023-08-10T10:33:43.986781+0000","last_fullsized":"2023-08-10T10:33:43.986781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.986673+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:35.304270+0000","scrub_duration":0.001579366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:01.658708+0000","last_change":"2023-08-10T10:34:01.658788+0000","last_active":"2023-08-10T10:34:01.658708+0000","last_peered":"2023-08-10T10:34:01.658708+0000","last_clean":"2023-08-10T10:34:01.658708+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:34:01.658708+0000","last_undegraded":"2023-08-10T10:34:01.658708+0000","last_fullsized":"2023-08-10T10:34:01.658708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'472","last_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_deep_scrub":"29'472","last_deep_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_clean_scrub_stamp":"2023-08-10T10:34:01.658617+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:08:25.389881+0000","scrub_duration":0.0024055499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.330743+0000","last_change":"2023-08-10T10:33:41.330818+0000","last_active":"2023-08-10T10:33:41.330743+0000","last_peered":"2023-08-10T10:33:41.330743+0000","last_clean":"2023-08-10T10:33:41.330743+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:33:41.330743+0000","last_undegraded":"2023-08-10T10:33:41.330743+0000","last_fullsized":"2023-08-10T10:33:41.330743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.330658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:48.111867+0000","scrub_duration":0.001792685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.662773+0000","last_change":"2023-08-10T10:33:35.662823+0000","last_active":"2023-08-10T10:33:35.662773+0000","last_peered":"2023-08-10T10:33:35.662773+0000","last_clean":"2023-08-10T10:33:35.662773+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:33:35.662773+0000","last_undegraded":"2023-08-10T10:33:35.662773+0000","last_fullsized":"2023-08-10T10:33:35.662773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.662682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:19.090646+0000","scrub_duration":0.0017149699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.073767+0000","last_change":"2023-08-10T10:33:49.073816+0000","last_active":"2023-08-10T10:33:49.073767+0000","last_peered":"2023-08-10T10:33:49.073767+0000","last_clean":"2023-08-10T10:33:49.073767+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:49.073767+0000","last_undegraded":"2023-08-10T10:33:49.073767+0000","last_fullsized":"2023-08-10T10:33:49.073767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.073691+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.539389+0000","scrub_duration":0.002661442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'511","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593079+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:20.593079+0000","last_peered":"2023-08-10T10:33:20.593079+0000","last_clean":"2023-08-10T10:33:20.593079+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:20.593079+0000","last_undegraded":"2023-08-10T10:33:20.593079+0000","last_fullsized":"2023-08-10T10:33:20.593079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.311638+0000","last_change":"2023-08-10T10:33:41.311696+0000","last_active":"2023-08-10T10:33:41.311638+0000","last_peered":"2023-08-10T10:33:41.311638+0000","last_clean":"2023-08-10T10:33:41.311638+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:33:41.311638+0000","last_undegraded":"2023-08-10T10:33:41.311638+0000","last_fullsized":"2023-08-10T10:33:41.311638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.311549+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:25.214215+0000","scrub_duration":0.0039921610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:32.706810+0000","last_change":"2023-08-10T10:33:32.706856+0000","last_active":"2023-08-10T10:33:32.706810+0000","last_peered":"2023-08-10T10:33:32.706810+0000","last_clean":"2023-08-10T10:33:32.706810+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:33:32.706810+0000","last_undegraded":"2023-08-10T10:33:32.706810+0000","last_fullsized":"2023-08-10T10:33:32.706810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_clean_scrub_stamp":"2023-08-10T10:33:32.706726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:57.652318+0000","scrub_duration":0.002258688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.211129+0000","last_change":"2023-08-10T10:33:29.211173+0000","last_active":"2023-08-10T10:33:29.211129+0000","last_peered":"2023-08-10T10:33:29.211129+0000","last_clean":"2023-08-10T10:33:29.211129+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:29.211129+0000","last_undegraded":"2023-08-10T10:33:29.211129+0000","last_fullsized":"2023-08-10T10:33:29.211129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.211063+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:45.413129+0000","scrub_duration":0.0022425100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.644856+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.644856+0000","last_peered":"2023-08-10T10:33:16.644856+0000","last_clean":"2023-08-10T10:33:16.644856+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.644856+0000","last_undegraded":"2023-08-10T10:33:16.644856+0000","last_fullsized":"2023-08-10T10:33:16.644856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.820766+0000","last_change":"2023-08-10T10:33:29.820813+0000","last_active":"2023-08-10T10:33:29.820766+0000","last_peered":"2023-08-10T10:33:29.820766+0000","last_clean":"2023-08-10T10:33:29.820766+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:33:29.820766+0000","last_undegraded":"2023-08-10T10:33:29.820766+0000","last_fullsized":"2023-08-10T10:33:29.820766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.820682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.382461+0000","scrub_duration":0.0016165769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.024844+0000","last_change":"2023-08-10T10:33:30.024886+0000","last_active":"2023-08-10T10:33:30.024844+0000","last_peered":"2023-08-10T10:33:30.024844+0000","last_clean":"2023-08-10T10:33:30.024844+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:30.024844+0000","last_undegraded":"2023-08-10T10:33:30.024844+0000","last_fullsized":"2023-08-10T10:33:30.024844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.024779+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:53.756043+0000","scrub_duration":0.001678323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'22","reported_seq":47,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.989605+0000","last_change":"2023-08-10T10:30:34.341924+0000","last_active":"2023-08-10T10:33:19.989605+0000","last_peered":"2023-08-10T10:33:19.989605+0000","last_clean":"2023-08-10T10:33:19.989605+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:33:19.989605+0000","last_undegraded":"2023-08-10T10:33:19.989605+0000","last_fullsized":"2023-08-10T10:33:19.989605+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'436","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.730477+0000","last_change":"2023-08-10T10:33:55.730594+0000","last_active":"2023-08-10T10:33:55.730477+0000","last_peered":"2023-08-10T10:33:55.730477+0000","last_clean":"2023-08-10T10:33:55.730477+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:55.730477+0000","last_undegraded":"2023-08-10T10:33:55.730477+0000","last_fullsized":"2023-08-10T10:33:55.730477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'436","last_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_deep_scrub":"29'436","last_deep_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.730389+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:17.182651+0000","scrub_duration":0.0023941240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.996535+0000","last_change":"2023-08-10T10:33:28.996619+0000","last_active":"2023-08-10T10:33:28.996535+0000","last_peered":"2023-08-10T10:33:28.996535+0000","last_clean":"2023-08-10T10:33:28.996535+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:33:28.996535+0000","last_undegraded":"2023-08-10T10:33:28.996535+0000","last_fullsized":"2023-08-10T10:33:28.996535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.996417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:59.325457+0000","scrub_duration":0.00214364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.761702+0000","last_change":"2023-08-10T10:33:43.761757+0000","last_active":"2023-08-10T10:33:43.761702+0000","last_peered":"2023-08-10T10:33:43.761702+0000","last_clean":"2023-08-10T10:33:43.761702+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:43.761702+0000","last_undegraded":"2023-08-10T10:33:43.761702+0000","last_fullsized":"2023-08-10T10:33:43.761702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.761621+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:33.933062+0000","scrub_duration":0.0016532879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.686881+0000","last_change":"2023-08-10T10:30:38.407041+0000","last_active":"2023-08-10T10:33:16.686881+0000","last_peered":"2023-08-10T10:33:16.686881+0000","last_clean":"2023-08-10T10:33:16.686881+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:33:16.686881+0000","last_undegraded":"2023-08-10T10:33:16.686881+0000","last_fullsized":"2023-08-10T10:33:16.686881+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.019552+0000","last_change":"2023-08-10T10:33:50.019623+0000","last_active":"2023-08-10T10:33:50.019552+0000","last_peered":"2023-08-10T10:33:50.019552+0000","last_clean":"2023-08-10T10:33:50.019552+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:33:50.019552+0000","last_undegraded":"2023-08-10T10:33:50.019552+0000","last_fullsized":"2023-08-10T10:33:50.019552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.019471+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:15.540336+0000","scrub_duration":0.0030648339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:44.471463+0000","last_change":"2023-08-10T10:33:44.471546+0000","last_active":"2023-08-10T10:33:44.471463+0000","last_peered":"2023-08-10T10:33:44.471463+0000","last_clean":"2023-08-10T10:33:44.471463+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:44.471463+0000","last_undegraded":"2023-08-10T10:33:44.471463+0000","last_fullsized":"2023-08-10T10:33:44.471463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_clean_scrub_stamp":"2023-08-10T10:33:44.471356+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:07.840953+0000","scrub_duration":0.0024103369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":503,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.664437+0000","last_change":"2023-08-10T10:30:38.406968+0000","last_active":"2023-08-10T10:33:16.664437+0000","last_peered":"2023-08-10T10:33:16.664437+0000","last_clean":"2023-08-10T10:33:16.664437+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:33:16.664437+0000","last_undegraded":"2023-08-10T10:33:16.664437+0000","last_fullsized":"2023-08-10T10:33:16.664437+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.974225+0000","last_change":"2023-08-10T10:33:50.974281+0000","last_active":"2023-08-10T10:33:50.974225+0000","last_peered":"2023-08-10T10:33:50.974225+0000","last_clean":"2023-08-10T10:33:50.974225+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:50.974225+0000","last_undegraded":"2023-08-10T10:33:50.974225+0000","last_fullsized":"2023-08-10T10:33:50.974225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.974148+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:34.876814+0000","scrub_duration":0.0029544839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'23","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.421729+0000","last_change":"2023-08-10T10:33:43.421786+0000","last_active":"2023-08-10T10:33:43.421729+0000","last_peered":"2023-08-10T10:33:43.421729+0000","last_clean":"2023-08-10T10:33:43.421729+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:43.421729+0000","last_undegraded":"2023-08-10T10:33:43.421729+0000","last_fullsized":"2023-08-10T10:33:43.421729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.421640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:09.069900+0000","scrub_duration":0.0020388680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'470","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.601755+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:20.601755+0000","last_peered":"2023-08-10T10:33:20.601755+0000","last_clean":"2023-08-10T10:33:20.601755+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:20.601755+0000","last_undegraded":"2023-08-10T10:33:20.601755+0000","last_fullsized":"2023-08-10T10:33:20.601755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.286442+0000","last_change":"2023-08-10T10:33:55.286501+0000","last_active":"2023-08-10T10:33:55.286442+0000","last_peered":"2023-08-10T10:33:55.286442+0000","last_clean":"2023-08-10T10:33:55.286442+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:33:55.286442+0000","last_undegraded":"2023-08-10T10:33:55.286442+0000","last_fullsized":"2023-08-10T10:33:55.286442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.286354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:20.934614+0000","scrub_duration":0.0020151869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'32","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.979982+0000","last_change":"2023-08-10T10:30:34.335338+0000","last_active":"2023-08-10T10:33:19.979982+0000","last_peered":"2023-08-10T10:33:19.979982+0000","last_clean":"2023-08-10T10:33:19.979982+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:33:19.979982+0000","last_undegraded":"2023-08-10T10:33:19.979982+0000","last_fullsized":"2023-08-10T10:33:19.979982+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'462","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.689362+0000","last_change":"2023-08-10T10:33:52.689490+0000","last_active":"2023-08-10T10:33:52.689362+0000","last_peered":"2023-08-10T10:33:52.689362+0000","last_clean":"2023-08-10T10:33:52.689362+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:52.689362+0000","last_undegraded":"2023-08-10T10:33:52.689362+0000","last_fullsized":"2023-08-10T10:33:52.689362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.689260+0000","objects_scrubbed":1,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:48.154957+0000","scrub_duration":0.0069198020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'7","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.996594+0000","last_change":"2023-08-10T10:33:36.996650+0000","last_active":"2023-08-10T10:33:36.996594+0000","last_peered":"2023-08-10T10:33:36.996594+0000","last_clean":"2023-08-10T10:33:36.996594+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:33:36.996594+0000","last_undegraded":"2023-08-10T10:33:36.996594+0000","last_fullsized":"2023-08-10T10:33:36.996594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.996505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:48.485764+0000","scrub_duration":0.004534967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.491588+0000","last_change":"2023-08-10T10:33:52.491684+0000","last_active":"2023-08-10T10:33:52.491588+0000","last_peered":"2023-08-10T10:33:52.491588+0000","last_clean":"2023-08-10T10:33:52.491588+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:52.491588+0000","last_undegraded":"2023-08-10T10:33:52.491588+0000","last_fullsized":"2023-08-10T10:33:52.491588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.491476+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:41.003245+0000","scrub_duration":0.0016911809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'48","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.879218+0000","last_change":"2023-08-10T10:33:40.879272+0000","last_active":"2023-08-10T10:33:40.879218+0000","last_peered":"2023-08-10T10:33:40.879218+0000","last_clean":"2023-08-10T10:33:40.879218+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:40.879218+0000","last_undegraded":"2023-08-10T10:33:40.879218+0000","last_fullsized":"2023-08-10T10:33:40.879218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.879137+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:38.333811+0000","scrub_duration":0.0022235739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982882+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:19.982882+0000","last_peered":"2023-08-10T10:33:19.982882+0000","last_clean":"2023-08-10T10:33:19.982882+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:19.982882+0000","last_undegraded":"2023-08-10T10:33:19.982882+0000","last_fullsized":"2023-08-10T10:33:19.982882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'34","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991199+0000","last_change":"2023-08-10T10:30:34.344754+0000","last_active":"2023-08-10T10:33:19.991199+0000","last_peered":"2023-08-10T10:33:19.991199+0000","last_clean":"2023-08-10T10:33:19.991199+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:33:19.991199+0000","last_undegraded":"2023-08-10T10:33:19.991199+0000","last_fullsized":"2023-08-10T10:33:19.991199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'31","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.976000+0000","last_change":"2023-08-10T10:30:34.351012+0000","last_active":"2023-08-10T10:33:19.976000+0000","last_peered":"2023-08-10T10:33:19.976000+0000","last_clean":"2023-08-10T10:33:19.976000+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:33:19.976000+0000","last_undegraded":"2023-08-10T10:33:19.976000+0000","last_fullsized":"2023-08-10T10:33:19.976000+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.806229+0000","last_change":"2023-08-10T10:33:25.806268+0000","last_active":"2023-08-10T10:33:25.806229+0000","last_peered":"2023-08-10T10:33:25.806229+0000","last_clean":"2023-08-10T10:33:25.806229+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:25.806229+0000","last_undegraded":"2023-08-10T10:33:25.806229+0000","last_fullsized":"2023-08-10T10:33:25.806229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.806161+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:38.537991+0000","scrub_duration":0.0024102640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":111149056,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":1076224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222298112,"data_stored":222298112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14883,"ondisk_log_size":14883,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2150615,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":712,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4301230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":728,"ondisk_log_size":728,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76612,"kb_used_data":41404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94295228,"statfs":{"total":96636764160,"available":96558313472,"internally_reserved":0,"allocated":42397696,"data_stored":42188424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.0800000000000001,"15min":0.78000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":6.7960000000000003,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.90600000000000003},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1830000000000001,"15min":0.78300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.4600000000000009,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.94299999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.085,"15min":0.76500000000000001},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":17.917000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":0.85999999999999999},{"interface":"front","average":{"1min":2.419,"5min":1.165,"15min":0.85299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":12.194000000000001,"5min":12.194000000000001,"15min":12.194000000000001},"last":0.84299999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.264,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.502},"max":{"1min":8.343,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":2.0209999999999999,"5min":1.321,"15min":0.91900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":9.8279999999999994,"5min":22.148,"15min":22.148},"last":0.98499999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.1160000000000001,"15min":0.82299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.2669999999999995,"5min":10.237,"15min":10.237},"last":0.82899999999999996},{"interface":"front","average":{"1min":2.1800000000000002,"5min":1.268,"15min":0.94199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.1709999999999994,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.95799999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.94499999999999995,"15min":0.76700000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.7560000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0069999999999999,"15min":0.79500000000000004},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.2380000000000004,"5min":11.779,"15min":11.779},"last":0.63400000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.88300000000000001,"15min":0.81699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.706,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.196,"5min":1.014,"15min":0.85899999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.7880000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.65800000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.0820000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":0.877},{"interface":"front","average":{"1min":1.1850000000000001,"5min":0.94499999999999995,"15min":0.79300000000000004},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.7080000000000002,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.77300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":17616896,"data_stored":17435679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.3,"15min":0.91400000000000003},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":8.8369999999999997,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.774,"5min":1.3280000000000001,"15min":0.95299999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.911,"5min":11.911,"15min":11.911},"last":0.72499999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":1.5469999999999999,"15min":1.0069999999999999},"min":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.7080000000000002,"5min":14.93,"15min":14.93},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.2849999999999999,"15min":0.92900000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":11.836,"5min":11.836,"15min":11.836},"last":0.78200000000000003}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.357,"15min":0.92300000000000004},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":8.4510000000000005,"5min":19.654,"15min":19.654},"last":0.69199999999999995},{"interface":"front","average":{"1min":2.097,"5min":1.379,"15min":0.94499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":8.7379999999999995,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.6379999999999999,"5min":1.5800000000000001,"15min":1.038},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":16.934000000000001,"5min":16.934000000000001,"15min":16.934000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.4319999999999999,"15min":1},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.968,"5min":19.907,"15min":19.907},"last":0.627}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.96499999999999997,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.984,"5min":5.984,"15min":5.984},"last":0.56399999999999995},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.0149999999999999,"15min":0.80900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":11.94,"5min":11.94,"15min":11.94},"last":0.81200000000000006}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.97699999999999998,"15min":0.78800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.3780000000000001,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.95999999999999996,"15min":0.81799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3490000000000002,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.752}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1,"15min":0.84199999999999997},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9569999999999999,"5min":5.577,"15min":5.577},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.1140000000000001,"15min":0.88},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":4.3239999999999998,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.79300000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66748,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94305092,"statfs":{"total":96636764160,"available":96568414208,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.67700000000000005,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":10.212999999999999,"5min":10.212999999999999,"15min":10.212999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":1.5609999999999999,"5min":0.73299999999999998,"15min":0.53700000000000003},"min":{"1min":0.314,"5min":0.308,"15min":0.308},"max":{"1min":6.46,"5min":6.46,"15min":6.46},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.3069999999999999,"5min":0.95799999999999996,"15min":0.622},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":13.24,"5min":13.24,"15min":13.24},"last":0.46899999999999997},{"interface":"front","average":{"1min":1.5640000000000001,"5min":0.79900000000000004,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.0270000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.58699999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.72399999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.438},"max":{"1min":5.0970000000000004,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.206,"5min":0.70699999999999996,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":3.0649999999999999,"5min":1.3480000000000001,"15min":0.93200000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.635,"5min":11.635,"15min":11.635},"last":0.76000000000000001},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.516,"15min":1.0049999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":14.271000000000001,"5min":14.271000000000001,"15min":14.271000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.7320000000000002,"5min":1.288,"15min":0.91200000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":10.101000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":4.3659999999999997,"5min":1.782,"15min":1.123},"min":{"1min":0.51600000000000001,"5min":0.505,"15min":0.505},"max":{"1min":17.66,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.80400000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.1699999999999999,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":6.5410000000000004,"5min":10.516,"15min":10.516},"last":0.88100000000000001},{"interface":"front","average":{"1min":3.6080000000000001,"5min":1.5,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":14.295999999999999,"5min":14.295999999999999,"15min":14.295999999999999},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":1.135,"15min":0.92900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6,"5min":6,"15min":6},"last":0.72099999999999997},{"interface":"front","average":{"1min":4.3150000000000004,"5min":1.6839999999999999,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":31.629999999999999,"5min":31.629999999999999,"15min":31.629999999999999},"last":0.83199999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62216,"kb_used_data":27008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94309624,"statfs":{"total":96636764160,"available":96573054976,"internally_reserved":0,"allocated":27656192,"data_stored":27470546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.84499999999999997,"15min":0.67100000000000004},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":5.7590000000000003,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.35999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.8530000000000002,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.751}]},{"osd":2,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":0.96499999999999997,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.018,"5min":0.98199999999999998,"15min":0.91000000000000003},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0890000000000004,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.68600000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.232,"15min":0.89100000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":19.68,"5min":19.68,"15min":19.68},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.681,"5min":1.0349999999999999,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.0579999999999998,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.71199999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.3780000000000001,"5min":1.8560000000000001,"15min":1.4610000000000001},"min":{"1min":0.53800000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":44.292000000000002,"5min":44.292000000000002,"15min":44.292000000000002},"last":0.82799999999999996},{"interface":"front","average":{"1min":4.6150000000000002,"5min":1.8740000000000001,"15min":1.238},"min":{"1min":0.48499999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":49.887999999999998,"5min":49.887999999999998,"15min":49.887999999999998},"last":0.876}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":9.3859999999999992,"5min":2.516,"15min":1.3109999999999999},"min":{"1min":0.58399999999999996,"5min":0.434,"15min":0.434},"max":{"1min":127.655,"5min":127.655,"15min":127.655},"last":0.80700000000000005},{"interface":"front","average":{"1min":5.2610000000000001,"5min":1.895,"15min":1.3540000000000001},"min":{"1min":0.59799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":65.376000000000005,"5min":65.376000000000005,"15min":65.376000000000005},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":1.6000000000000001,"15min":1.1699999999999999},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":16.510000000000002,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.97299999999999998},{"interface":"front","average":{"1min":2.6019999999999999,"5min":1.429,"15min":0.97499999999999998},"min":{"1min":0.59399999999999997,"5min":0.499,"15min":0.499},"max":{"1min":16.331,"5min":16.331,"15min":16.331},"last":0.89600000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":1.4770000000000001,"15min":1.216},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":8.9670000000000005,"5min":8.9670000000000005,"15min":8.9670000000000005},"last":0.92000000000000004},{"interface":"front","average":{"1min":2.4399999999999999,"5min":1.5509999999999999,"15min":1.1879999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":16.478000000000002,"5min":17.032,"15min":17.032},"last":0.93200000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":28468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":29151232,"data_stored":28970015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.8089999999999999,"5min":0.83299999999999996,"15min":0.59499999999999997},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":14.092000000000001,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.54200000000000004},{"interface":"front","average":{"1min":2.2269999999999999,"5min":0.88400000000000001,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":13.456,"5min":13.456,"15min":13.456},"last":0.59099999999999997}]},{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.131,"15min":0.70999999999999996},"min":{"1min":0.35599999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":15.066000000000001,"5min":15.066000000000001,"15min":15.066000000000001},"last":0.48299999999999998},{"interface":"front","average":{"1min":1.8560000000000001,"5min":0.88,"15min":0.65200000000000002},"min":{"1min":0.38300000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":9.2029999999999994,"5min":9.2029999999999994,"15min":9.2029999999999994},"last":0.623}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.83699999999999997,"15min":0.63400000000000001},"min":{"1min":0.41299999999999998,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.7030000000000001,"5min":11.715,"15min":11.715},"last":0.57499999999999996},{"interface":"front","average":{"1min":2.2919999999999998,"5min":1.024,"15min":0.73799999999999999},"min":{"1min":0.39800000000000002,"5min":0.37,"15min":0.37},"max":{"1min":15.997999999999999,"5min":15.997999999999999,"15min":15.997999999999999},"last":0.70899999999999996}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.0880000000000001,"5min":1.5840000000000001,"15min":0.99199999999999999},"min":{"1min":0.47599999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":19.811,"5min":19.811,"15min":19.811},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.659,"5min":1.1799999999999999,"15min":0.86799999999999999},"min":{"1min":0.53600000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":11.002000000000001,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.82099999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8069999999999999,"5min":1.4219999999999999,"15min":0.97499999999999998},"min":{"1min":0.53100000000000003,"5min":0.499,"15min":0.499},"max":{"1min":16.045000000000002,"5min":16.045000000000002,"15min":16.045000000000002},"last":0.873},{"interface":"front","average":{"1min":3.52,"5min":1.5960000000000001,"15min":1.04},"min":{"1min":0.63600000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":13.414999999999999,"5min":13.414999999999999,"15min":13.414999999999999},"last":0.78300000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.8330000000000002,"5min":1.6339999999999999,"15min":1.042},"min":{"1min":0.54200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":20.692,"5min":20.692,"15min":20.692},"last":0.72399999999999998},{"interface":"front","average":{"1min":2.2130000000000001,"5min":1.5109999999999999,"15min":1.0229999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":9.1519999999999992,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.91100000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.9670000000000001,"5min":1.498,"15min":1.0369999999999999},"min":{"1min":0.54000000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":13.516,"5min":13.516,"15min":13.516},"last":0.84899999999999998},{"interface":"front","average":{"1min":2.6920000000000002,"5min":1.4119999999999999,"15min":0.98799999999999999},"min":{"1min":0.59599999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":20.757999999999999,"5min":20.757999999999999,"15min":20.757999999999999},"last":0.69299999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574897,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55488,"kb_used_data":24376,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94316352,"statfs":{"total":96636764160,"available":96579944448,"internally_reserved":0,"allocated":24961024,"data_stored":24775801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":1.004,"15min":0.71799999999999997},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":24.925999999999998,"5min":24.925999999999998,"15min":24.925999999999998},"last":0.38800000000000001},{"interface":"front","average":{"1min":2.1499999999999999,"5min":0.94199999999999995,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":19.779,"5min":19.779,"15min":19.779},"last":0.41499999999999998}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":0.94899999999999995,"15min":0.67500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.6259999999999994,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.304,"15min":1.216},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":9.4700000000000006,"5min":12.754,"15min":12.754},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.0489999999999999,"15min":0.80100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.0629999999999997,"5min":14.169,"15min":14.169},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.173,"15min":0.875},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":14.156000000000001,"5min":16.927,"15min":16.927},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.3690000000000002,"5min":1.456,"15min":0.98599999999999999},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.84499999999999997},{"interface":"front","average":{"1min":2.246,"5min":1.3180000000000001,"15min":0.92500000000000004},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":14.225,"5min":14.225,"15min":14.225},"last":0.879}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0369999999999999,"5min":1.1759999999999999,"15min":0.89500000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.976,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":3.048,"5min":1.542,"15min":1.0529999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":24.853999999999999,"5min":24.853999999999999,"15min":24.853999999999999},"last":0.98399999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":1.468,"15min":1.0249999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":10.403,"5min":16.919,"15min":16.919},"last":0.93400000000000005},{"interface":"front","average":{"1min":2.3300000000000001,"5min":1.365,"15min":0.98499999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":9.6880000000000006,"5min":12.504,"15min":12.504},"last":0.79500000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1559999999999999,"15min":0.93400000000000005},"min":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":9.5090000000000003,"5min":9.5090000000000003,"15min":9.5090000000000003},"last":0.85299999999999998},{"interface":"front","average":{"1min":3.427,"5min":1.667,"15min":1.1040000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.80900000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64768,"kb_used_data":29560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94307072,"statfs":{"total":96636764160,"available":96570441728,"internally_reserved":0,"allocated":30269440,"data_stored":30071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.1079999999999997,"5min":1.829,"15min":1.0600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":69.530000000000001,"5min":69.530000000000001,"15min":69.530000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":2.8839999999999999,"5min":1.5109999999999999,"15min":1.0840000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.388000000000002,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.6779999999999999,"5min":1.8380000000000001,"15min":1.147},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":64.784999999999997,"5min":64.784999999999997,"15min":64.784999999999997},"last":0.75600000000000001},{"interface":"front","average":{"1min":7.8789999999999996,"5min":2.6440000000000001,"15min":1.4630000000000001},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":120.05,"5min":120.05,"15min":120.05},"last":0.55700000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":7.6840000000000002,"5min":2.4060000000000001,"15min":1.284},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":119.992,"5min":119.992,"15min":119.992},"last":0.67900000000000005},{"interface":"front","average":{"1min":3.0299999999999998,"5min":1.5880000000000001,"15min":1.214},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":30.984000000000002,"5min":30.984000000000002,"15min":30.984000000000002},"last":0.78500000000000003}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.0759999999999996,"5min":1.8779999999999999,"15min":1.1479999999999999},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":64.823999999999998,"5min":64.823999999999998,"15min":64.823999999999998},"last":0.77000000000000002},{"interface":"front","average":{"1min":3.0600000000000001,"5min":1.417,"15min":1.0129999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":30.940000000000001,"5min":30.940000000000001,"15min":30.940000000000001},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":9.218,"5min":2.7400000000000002,"15min":1.504},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":165.98500000000001,"5min":165.98500000000001,"15min":165.98500000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":7.6159999999999997,"5min":2.21,"15min":1.278},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":125.369,"5min":125.369,"15min":125.369},"last":0.81000000000000005}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":6.5289999999999999,"5min":2.4590000000000001,"15min":1.7949999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":113.884,"5min":113.884,"15min":113.884},"last":0.52200000000000002},{"interface":"front","average":{"1min":7.1520000000000001,"5min":2.2280000000000002,"15min":1.2869999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":124.836,"5min":124.836,"15min":124.836},"last":0.73799999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":1.6020000000000001,"15min":1.1220000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":67.281999999999996,"5min":67.281999999999996,"15min":67.281999999999996},"last":0.68700000000000006},{"interface":"front","average":{"1min":7.125,"5min":2.1520000000000001,"15min":1.27},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":125.12,"5min":125.12,"15min":125.12},"last":0.71599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60612,"kb_used_data":25404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94311228,"statfs":{"total":96636764160,"available":96574697472,"internally_reserved":0,"allocated":26013696,"data_stored":25824939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2729999999999997,"5min":1.6970000000000001,"15min":1.2410000000000001},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":2.4340000000000002,"5min":1.3720000000000001,"15min":1.133},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":12.596,"5min":12.596,"15min":12.596},"last":0.871}]},{"osd":1,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.8919999999999999,"5min":1.764,"15min":1.3680000000000001},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":20.193999999999999,"5min":20.193999999999999,"15min":20.193999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":3.552,"5min":1.6240000000000001,"15min":1.202},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.708,"5min":15.708,"15min":15.708},"last":0.66800000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1890000000000001,"5min":1.4470000000000001,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.949,"5min":10.949,"15min":10.949},"last":0.93799999999999994},{"interface":"front","average":{"1min":4.1619999999999999,"5min":1.5960000000000001,"15min":1.198},"min":{"1min":0.499,"5min":0.435,"15min":0.435},"max":{"1min":20.224,"5min":20.224,"15min":20.224},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.242,"15min":1.1379999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.96199999999999997},{"interface":"front","average":{"1min":5.1600000000000001,"5min":1.968,"15min":1.514},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":20.114999999999998,"5min":20.114999999999998,"15min":20.114999999999998},"last":0.747}]},{"osd":4,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3250000000000002,"5min":0.97499999999999998,"15min":0.73099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":15.784000000000001,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.84499999999999997,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.81200000000000006}]},{"osd":6,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":0.92800000000000005,"15min":0.73199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.69099999999999995},{"interface":"front","average":{"1min":2.3149999999999999,"5min":1.0109999999999999,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":15.815,"5min":15.815,"15min":15.815},"last":0.77200000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.012,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":3.456,"5min":1.3120000000000001,"15min":0.94599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":20.161000000000001,"5min":20.161000000000001,"15min":20.161000000000001},"last":0.86099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2149873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2142281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26738688,"data_stored":26738688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28835840,"data_stored":28835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24641536,"data_stored":24641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27787264,"data_stored":27787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25690112,"data_stored":25690112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17301504,"data_stored":17301504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":39321600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:34:10.693 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.693 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.694 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.694 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.694 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.695 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.695 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.695 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.696 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.696 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.696 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.697 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.697 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.697 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.698 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.698 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.698 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.698 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.699 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.699 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.699 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.700 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.700 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.700 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.701 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.701 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.701 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.702 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.702 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.702 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.703 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.703 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.704 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.704 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.704 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.705 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.705 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.705 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.706 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.706 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.706 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.706 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:10.707 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-10T10:34:26.813 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:26.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:30.708 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:34:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.913+0000 7f2673fff700 1 Processor -- start 2023-08-10T10:34:30.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.913+0000 7f2673fff700 1 -- start start 2023-08-10T10:34:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.914+0000 7f2673fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f266c159d00 0x7f266c15d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.916 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.914+0000 7f2673fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f266c0710a0 0x7f266c06a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.914+0000 7f2673fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c06a170 con 0x7f266c0716d0 2023-08-10T10:34:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2673fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c0cdeb0 con 0x7f266c159d00 2023-08-10T10:34:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2673fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f266c0ce190 con 0x7f266c0710a0 2023-08-10T10:34:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f266c159d00 0x7f266c15d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:30.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f267159a700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f266c0716d0 0x7f266c070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:39638/0 (socket says 172.21.15.88:39638) 2023-08-10T10:34:30.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f267159a700 1 -- 172.21.15.88:0/2423760799 learned_addr learned my addr 172.21.15.88:0/2423760799 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:34:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 -- 172.21.15.88:0/2423760799 >> v2:172.21.15.187:3300/0 conn(0x7f266c0710a0 msgr2=0x7f266c06a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 --2- 172.21.15.88:0/2423760799 >> v2:172.21.15.187:3300/0 conn(0x7f266c0710a0 0x7f266c06a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 -- 172.21.15.88:0/2423760799 >> v1:172.21.15.88:6789/0 conn(0x7f266c0716d0 legacy=0x7f266c070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 -- 172.21.15.88:0/2423760799 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0ce470 con 0x7f266c159d00 2023-08-10T10:34:30.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.915+0000 7f2671d9b700 1 --2- 172.21.15.88:0/2423760799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c15d8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f266c06b8b0 tx=0x7f2668009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826ea7efd3ee6b10 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2670d99700 1 -- 172.21.15.88:0/2423760799 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668011830 con 0x7f266c159d00 2023-08-10T10:34:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2670d99700 1 -- 172.21.15.88:0/2423760799 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668011990 con 0x7f266c159d00 2023-08-10T10:34:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2670d99700 1 -- 172.21.15.88:0/2423760799 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2668011d20 con 0x7f266c159d00 2023-08-10T10:34:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 -- 172.21.15.88:0/2423760799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 msgr2=0x7f266c15d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:30.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 --2- 172.21.15.88:0/2423760799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c15d8d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f266c06b8b0 tx=0x7f2668009b20 comp rx=0 tx=0).stop 2023-08-10T10:34:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 -- 172.21.15.88:0/2423760799 shutdown_connections 2023-08-10T10:34:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 --2- 172.21.15.88:0/2423760799 >> v2:172.21.15.187:3300/0 conn(0x7f266c0710a0 0x7f266c06a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 --2- 172.21.15.88:0/2423760799 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c15d8d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 -- 172.21.15.88:0/2423760799 >> 172.21.15.88:0/2423760799 conn(0x7f266c0ced50 msgr2=0x7f266c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:30.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 -- 172.21.15.88:0/2423760799 shutdown_connections 2023-08-10T10:34:30.922 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.916+0000 7f2673fff700 1 -- 172.21.15.88:0/2423760799 wait complete. 2023-08-10T10:34:30.923 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.918+0000 7f2673fff700 1 Processor -- start 2023-08-10T10:34:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.918+0000 7f2673fff700 1 -- start start 2023-08-10T10:34:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f266c0710a0 0x7f266c1f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f266c0716d0 0x7f266c0adea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.924 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c155090 con 0x7f266c159d00 2023-08-10T10:34:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c1f4260 con 0x7f266c0710a0 2023-08-10T10:34:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f2673fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c1f6dc0 con 0x7f266c0716d0 2023-08-10T10:34:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.919+0000 7f267259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:60150/0 (socket says 172.21.15.88:60150) 2023-08-10T10:34:30.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 -- 172.21.15.88:0/2925733907 learned_addr learned my addr 172.21.15.88:0/2925733907 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f2671d9b700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f266c0710a0 0x7f266c1f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267159a700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f266c0716d0 0x7f266c0adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 -- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f266c0716d0 msgr2=0x7f266c0adea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f266c0716d0 0x7f266c0adea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:30.926 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 -- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f266c0710a0 msgr2=0x7f266c1f7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f266c0710a0 0x7f266c1f7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 -- 172.21.15.88:0/2925733907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26680094a0 con 0x7f266c159d00 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f267259c700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f266400b9e0 tx=0x7f266400bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400d8e0 con 0x7f266c159d00 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.920+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266400da60 con 0x7f266c159d00 2023-08-10T10:34:30.927 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.921+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266c1f7790 con 0x7f266c159d00 2023-08-10T10:34:30.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.921+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400de10 con 0x7f266c159d00 2023-08-10T10:34:30.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.921+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c1f3f80 con 0x7f266c159d00 2023-08-10T10:34:30.928 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.922+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c1f6f70 con 0x7f266c159d00 2023-08-10T10:34:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.922+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f2664015420 con 0x7f266c159d00 2023-08-10T10:34:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.923+0000 7f26627fc700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 0x7f265006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:30.929 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.923+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f2664011070 con 0x7f266c159d00 2023-08-10T10:34:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.924+0000 7f2671d9b700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 0x7f265006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.924+0000 7f2671d9b700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 0x7f265006d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2668000c00 tx=0x7f2668008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:30.930 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:30.928+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f266404e330 con 0x7f266c159d00 2023-08-10T10:34:31.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.118+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f266c15a0e0 con 0x7f265006ace0 2023-08-10T10:34:31.130 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.129+0000 7f26627fc700 1 -- 172.21.15.88:0/2925733907 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+393188 (secure 0 0 0) 0x7f2668011cb0 con 0x7f265006ace0 2023-08-10T10:34:31.135 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:31.137 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 msgr2=0x7f265006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:31.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 0x7f265006d1a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2668000c00 tx=0x7f2668008030 comp rx=0 tx=0).stop 2023-08-10T10:34:31.138 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 msgr2=0x7f266c1f3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:31.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f266400b9e0 tx=0x7f266400bcf0 comp rx=0 tx=0).stop 2023-08-10T10:34:31.139 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 shutdown_connections 2023-08-10T10:34:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f266c159d00 0x7f266c1f3350 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:31.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f266c0710a0 0x7f266c1f7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f265006ace0 0x7f265006d1a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 --2- 172.21.15.88:0/2925733907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f266c0716d0 0x7f266c0adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:31.141 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 >> 172.21.15.88:0/2925733907 conn(0x7f266c0ced50 msgr2=0x7f266c0cc720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 shutdown_connections 2023-08-10T10:34:31.142 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:31.134+0000 7f2673fff700 1 -- 172.21.15.88:0/2925733907 wait complete. 2023-08-10T10:34:31.143 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:34:31.154 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2023-08-10T10:34:29.621671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113890039,"num_objects":53,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":1382,"num_write_kb":1081239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17778,"ondisk_log_size":17778,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":494340,"kb_used_data":224964,"kb_used_omap":13,"kb_used_meta":269298,"kb_avail":754480380,"statfs":{"total":773094113280,"available":772587909120,"internally_reserved":0,"allocated":230363136,"data_stored":228852459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":275761240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003851"},"pg_stats":[{"pgid":"4.3f","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.883026+0000","last_change":"2023-08-10T10:33:36.883077+0000","last_active":"2023-08-10T10:33:36.883026+0000","last_peered":"2023-08-10T10:33:36.883026+0000","last_clean":"2023-08-10T10:33:36.883026+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:36.883026+0000","last_undegraded":"2023-08-10T10:33:36.883026+0000","last_fullsized":"2023-08-10T10:33:36.883026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.882946+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:55.798064+0000","scrub_duration":0.001698803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:04.989160+0000","last_change":"2023-08-10T10:34:04.989246+0000","last_active":"2023-08-10T10:34:04.989160+0000","last_peered":"2023-08-10T10:34:04.989160+0000","last_clean":"2023-08-10T10:34:04.989160+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:34:04.989160+0000","last_undegraded":"2023-08-10T10:34:04.989160+0000","last_fullsized":"2023-08-10T10:34:04.989160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:34:04.989056+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:34:04.989056+0000","last_clean_scrub_stamp":"2023-08-10T10:34:04.989056+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:28.358652+0000","scrub_duration":0.0021473880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'42","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:20.821329+0000","last_change":"2023-08-10T10:34:20.821386+0000","last_active":"2023-08-10T10:34:20.821329+0000","last_peered":"2023-08-10T10:34:20.821329+0000","last_clean":"2023-08-10T10:34:20.821329+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:34:20.821329+0000","last_undegraded":"2023-08-10T10:34:20.821329+0000","last_fullsized":"2023-08-10T10:34:20.821329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:34:20.821240+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:34:20.821240+0000","last_clean_scrub_stamp":"2023-08-10T10:34:20.821240+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:09.207057+0000","scrub_duration":0.0023435299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.739305+0000","last_change":"2023-08-10T10:33:59.739357+0000","last_active":"2023-08-10T10:33:59.739305+0000","last_peered":"2023-08-10T10:33:59.739305+0000","last_clean":"2023-08-10T10:33:59.739305+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:59.739305+0000","last_undegraded":"2023-08-10T10:33:59.739305+0000","last_fullsized":"2023-08-10T10:33:59.739305+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.739228+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:25:24.684820+0000","scrub_duration":0.0021901009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.899724+0000","last_change":"2023-08-10T10:33:25.899769+0000","last_active":"2023-08-10T10:33:25.899724+0000","last_peered":"2023-08-10T10:33:25.899724+0000","last_clean":"2023-08-10T10:33:25.899724+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:25.899724+0000","last_undegraded":"2023-08-10T10:33:25.899724+0000","last_fullsized":"2023-08-10T10:33:25.899724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.899655+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.048352+0000","scrub_duration":0.001506755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'38","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.991091+0000","last_change":"2023-08-10T10:30:34.333436+0000","last_active":"2023-08-10T10:33:19.991091+0000","last_peered":"2023-08-10T10:33:19.991091+0000","last_clean":"2023-08-10T10:33:19.991091+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:33:19.991091+0000","last_undegraded":"2023-08-10T10:33:19.991091+0000","last_fullsized":"2023-08-10T10:33:19.991091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.235707+0000","last_change":"2023-08-10T10:33:59.235761+0000","last_active":"2023-08-10T10:33:59.235707+0000","last_peered":"2023-08-10T10:33:59.235707+0000","last_clean":"2023-08-10T10:33:59.235707+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:59.235707+0000","last_undegraded":"2023-08-10T10:33:59.235707+0000","last_fullsized":"2023-08-10T10:33:59.235707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.235628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:24.883888+0000","scrub_duration":0.0021164880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:15.935614+0000","last_change":"2023-08-10T10:34:15.935667+0000","last_active":"2023-08-10T10:34:15.935614+0000","last_peered":"2023-08-10T10:34:15.935614+0000","last_clean":"2023-08-10T10:34:15.935614+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:34:15.935614+0000","last_undegraded":"2023-08-10T10:34:15.935614+0000","last_fullsized":"2023-08-10T10:34:15.935614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:34:15.935514+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:34:15.935514+0000","last_clean_scrub_stamp":"2023-08-10T10:34:15.935514+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:26.954665+0000","scrub_duration":0.001619229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'37","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:12.206826+0000","last_change":"2023-08-10T10:34:12.206885+0000","last_active":"2023-08-10T10:34:12.206826+0000","last_peered":"2023-08-10T10:34:12.206826+0000","last_clean":"2023-08-10T10:34:12.206826+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:34:12.206826+0000","last_undegraded":"2023-08-10T10:34:12.206826+0000","last_fullsized":"2023-08-10T10:34:12.206826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-08-10T10:34:12.206749+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-08-10T10:34:12.206749+0000","last_clean_scrub_stamp":"2023-08-10T10:34:12.206749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:00.718518+0000","scrub_duration":0.0015892370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'44","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.066157+0000","last_change":"2023-08-10T10:33:30.066237+0000","last_active":"2023-08-10T10:33:30.066157+0000","last_peered":"2023-08-10T10:33:30.066157+0000","last_clean":"2023-08-10T10:33:30.066157+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:30.066157+0000","last_undegraded":"2023-08-10T10:33:30.066157+0000","last_fullsized":"2023-08-10T10:33:30.066157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.066062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:46.020476+0000","scrub_duration":0.0021977630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.517329+0000","last_change":"2023-08-10T10:33:33.517379+0000","last_active":"2023-08-10T10:33:33.517329+0000","last_peered":"2023-08-10T10:33:33.517329+0000","last_clean":"2023-08-10T10:33:33.517329+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:33.517329+0000","last_undegraded":"2023-08-10T10:33:33.517329+0000","last_fullsized":"2023-08-10T10:33:33.517329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.517247+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:41.342304+0000","scrub_duration":0.002340221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.902165+0000","last_change":"2023-08-10T10:33:35.902217+0000","last_active":"2023-08-10T10:33:35.902165+0000","last_peered":"2023-08-10T10:33:35.902165+0000","last_clean":"2023-08-10T10:33:35.902165+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:35.902165+0000","last_undegraded":"2023-08-10T10:33:35.902165+0000","last_fullsized":"2023-08-10T10:33:35.902165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.902089+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:01.877768+0000","scrub_duration":0.0023654119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.879384+0000","last_change":"2023-08-10T10:33:31.879433+0000","last_active":"2023-08-10T10:33:31.879384+0000","last_peered":"2023-08-10T10:33:31.879384+0000","last_clean":"2023-08-10T10:33:31.879384+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:31.879384+0000","last_undegraded":"2023-08-10T10:33:31.879384+0000","last_fullsized":"2023-08-10T10:33:31.879384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.879295+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:47.686858+0000","scrub_duration":0.001582806,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.929484+0000","last_change":"2023-08-10T10:33:36.929535+0000","last_active":"2023-08-10T10:33:36.929484+0000","last_peered":"2023-08-10T10:33:36.929484+0000","last_clean":"2023-08-10T10:33:36.929484+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:36.929484+0000","last_undegraded":"2023-08-10T10:33:36.929484+0000","last_fullsized":"2023-08-10T10:33:36.929484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.929396+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:24.773523+0000","scrub_duration":0.0025361160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.229130+0000","last_change":"2023-08-10T10:34:00.229186+0000","last_active":"2023-08-10T10:34:00.229130+0000","last_peered":"2023-08-10T10:34:00.229130+0000","last_clean":"2023-08-10T10:34:00.229130+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:34:00.229130+0000","last_undegraded":"2023-08-10T10:34:00.229130+0000","last_fullsized":"2023-08-10T10:34:00.229130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.229006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:23.598603+0000","scrub_duration":0.002074916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'38","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:06.662391+0000","last_change":"2023-08-10T10:34:06.662447+0000","last_active":"2023-08-10T10:34:06.662391+0000","last_peered":"2023-08-10T10:34:06.662391+0000","last_clean":"2023-08-10T10:34:06.662391+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:34:06.662391+0000","last_undegraded":"2023-08-10T10:34:06.662391+0000","last_fullsized":"2023-08-10T10:34:06.662391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-08-10T10:34:06.662309+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-08-10T10:34:06.662309+0000","last_clean_scrub_stamp":"2023-08-10T10:34:06.662309+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:48:48.780773+0000","scrub_duration":0.0020288139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'36","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.107239+0000","last_change":"2023-08-10T10:34:02.107288+0000","last_active":"2023-08-10T10:34:02.107239+0000","last_peered":"2023-08-10T10:34:02.107239+0000","last_clean":"2023-08-10T10:34:02.107239+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:34:02.107239+0000","last_undegraded":"2023-08-10T10:34:02.107239+0000","last_fullsized":"2023-08-10T10:34:02.107239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.107165+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:27.755425+0000","scrub_duration":0.0016039889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.585707+0000","last_change":"2023-08-10T10:33:27.585762+0000","last_active":"2023-08-10T10:33:27.585707+0000","last_peered":"2023-08-10T10:33:27.585707+0000","last_clean":"2023-08-10T10:33:27.585707+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:27.585707+0000","last_undegraded":"2023-08-10T10:33:27.585707+0000","last_fullsized":"2023-08-10T10:33:27.585707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.585622+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:18.903219+0000","scrub_duration":0.0017968820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.813816+0000","last_change":"2023-08-10T10:33:39.813869+0000","last_active":"2023-08-10T10:33:39.813816+0000","last_peered":"2023-08-10T10:33:39.813816+0000","last_clean":"2023-08-10T10:33:39.813816+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:39.813816+0000","last_undegraded":"2023-08-10T10:33:39.813816+0000","last_fullsized":"2023-08-10T10:33:39.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.813733+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:37.309818+0000","scrub_duration":0.0023901679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.581199+0000","last_change":"2023-08-10T10:33:31.581251+0000","last_active":"2023-08-10T10:33:31.581199+0000","last_peered":"2023-08-10T10:33:31.581199+0000","last_clean":"2023-08-10T10:33:31.581199+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:31.581199+0000","last_undegraded":"2023-08-10T10:33:31.581199+0000","last_fullsized":"2023-08-10T10:33:31.581199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.581116+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:27.046813+0000","scrub_duration":0.0015992249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'41","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:09.203092+0000","last_change":"2023-08-10T10:34:09.203148+0000","last_active":"2023-08-10T10:34:09.203092+0000","last_peered":"2023-08-10T10:34:09.203092+0000","last_clean":"2023-08-10T10:34:09.203092+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:34:09.203092+0000","last_undegraded":"2023-08-10T10:34:09.203092+0000","last_fullsized":"2023-08-10T10:34:09.203092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-08-10T10:34:09.203007+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-08-10T10:34:09.203007+0000","last_clean_scrub_stamp":"2023-08-10T10:34:09.203007+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:57.714776+0000","scrub_duration":0.0023523020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.940798+0000","last_change":"2023-08-10T10:33:39.940853+0000","last_active":"2023-08-10T10:33:39.940798+0000","last_peered":"2023-08-10T10:33:39.940798+0000","last_clean":"2023-08-10T10:33:39.940798+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:39.940798+0000","last_undegraded":"2023-08-10T10:33:39.940798+0000","last_fullsized":"2023-08-10T10:33:39.940798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.940687+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:46.721896+0000","scrub_duration":0.00155013,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'35","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.161482+0000","last_change":"2023-08-10T10:33:31.161534+0000","last_active":"2023-08-10T10:33:31.161482+0000","last_peered":"2023-08-10T10:33:31.161482+0000","last_clean":"2023-08-10T10:33:31.161482+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:31.161482+0000","last_undegraded":"2023-08-10T10:33:31.161482+0000","last_fullsized":"2023-08-10T10:33:31.161482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.161398+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:36.341462+0000","scrub_duration":0.0014948749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:12.223270+0000","last_change":"2023-08-10T10:34:12.223348+0000","last_active":"2023-08-10T10:34:12.223270+0000","last_peered":"2023-08-10T10:34:12.223270+0000","last_clean":"2023-08-10T10:34:12.223270+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:34:12.223270+0000","last_undegraded":"2023-08-10T10:34:12.223270+0000","last_fullsized":"2023-08-10T10:34:12.223270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:34:12.223186+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:34:12.223186+0000","last_clean_scrub_stamp":"2023-08-10T10:34:12.223186+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:23.242336+0000","scrub_duration":0.001906004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.648876+0000","last_change":"2023-08-10T10:33:51.648966+0000","last_active":"2023-08-10T10:33:51.648876+0000","last_peered":"2023-08-10T10:33:51.648876+0000","last_clean":"2023-08-10T10:33:51.648876+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:51.648876+0000","last_undegraded":"2023-08-10T10:33:51.648876+0000","last_fullsized":"2023-08-10T10:33:51.648876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.648764+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:35.551430+0000","scrub_duration":0.0021019300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'37","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.711548+0000","last_change":"2023-08-10T10:33:45.711619+0000","last_active":"2023-08-10T10:33:45.711548+0000","last_peered":"2023-08-10T10:33:45.711548+0000","last_clean":"2023-08-10T10:33:45.711548+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:45.711548+0000","last_undegraded":"2023-08-10T10:33:45.711548+0000","last_fullsized":"2023-08-10T10:33:45.711548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.711454+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:52.492664+0000","scrub_duration":0.0016896599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.042561+0000","last_change":"2023-08-10T10:33:29.042633+0000","last_active":"2023-08-10T10:33:29.042561+0000","last_peered":"2023-08-10T10:33:29.042561+0000","last_clean":"2023-08-10T10:33:29.042561+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:29.042561+0000","last_undegraded":"2023-08-10T10:33:29.042561+0000","last_fullsized":"2023-08-10T10:33:29.042561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.042483+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.511552+0000","scrub_duration":0.001545306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'444","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593004+0000","last_change":"2023-08-10T10:30:38.404970+0000","last_active":"2023-08-10T10:33:20.593004+0000","last_peered":"2023-08-10T10:33:20.593004+0000","last_clean":"2023-08-10T10:33:20.593004+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:33:20.593004+0000","last_undegraded":"2023-08-10T10:33:20.593004+0000","last_fullsized":"2023-08-10T10:33:20.593004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.623062+0000","last_change":"2023-08-10T10:34:02.623115+0000","last_active":"2023-08-10T10:34:02.623062+0000","last_peered":"2023-08-10T10:34:02.623062+0000","last_clean":"2023-08-10T10:34:02.623062+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:34:02.623062+0000","last_undegraded":"2023-08-10T10:34:02.623062+0000","last_fullsized":"2023-08-10T10:34:02.623062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.622978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:44.380373+0000","scrub_duration":0.001989092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'39","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:16.445164+0000","last_change":"2023-08-10T10:34:16.445241+0000","last_active":"2023-08-10T10:34:16.445164+0000","last_peered":"2023-08-10T10:34:16.445164+0000","last_clean":"2023-08-10T10:34:16.445164+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:34:16.445164+0000","last_undegraded":"2023-08-10T10:34:16.445164+0000","last_fullsized":"2023-08-10T10:34:16.445164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-08-10T10:34:16.445061+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-08-10T10:34:16.445061+0000","last_clean_scrub_stamp":"2023-08-10T10:34:16.445061+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:58.202456+0000","scrub_duration":0.00167884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'473","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.679083+0000","last_change":"2023-08-10T10:34:02.679172+0000","last_active":"2023-08-10T10:34:02.679083+0000","last_peered":"2023-08-10T10:34:02.679083+0000","last_clean":"2023-08-10T10:34:02.679083+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:34:02.679083+0000","last_undegraded":"2023-08-10T10:34:02.679083+0000","last_fullsized":"2023-08-10T10:34:02.679083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.679000+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:46.106964+0000","scrub_duration":0.0058418979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.715152+0000","last_change":"2023-08-10T10:33:33.715201+0000","last_active":"2023-08-10T10:33:33.715152+0000","last_peered":"2023-08-10T10:33:33.715152+0000","last_clean":"2023-08-10T10:33:33.715152+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:33:33.715152+0000","last_undegraded":"2023-08-10T10:33:33.715152+0000","last_fullsized":"2023-08-10T10:33:33.715152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.715068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:04.044108+0000","scrub_duration":0.0015745259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.054243+0000","last_change":"2023-08-10T10:33:48.054296+0000","last_active":"2023-08-10T10:33:48.054243+0000","last_peered":"2023-08-10T10:33:48.054243+0000","last_clean":"2023-08-10T10:33:48.054243+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:48.054243+0000","last_undegraded":"2023-08-10T10:33:48.054243+0000","last_fullsized":"2023-08-10T10:33:48.054243+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.054163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:31.956829+0000","scrub_duration":0.0021941999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'477","reported_seq":504,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:18.301232+0000","last_change":"2023-08-10T10:34:18.301365+0000","last_active":"2023-08-10T10:34:18.301232+0000","last_peered":"2023-08-10T10:34:18.301232+0000","last_clean":"2023-08-10T10:34:18.301232+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:34:18.301232+0000","last_undegraded":"2023-08-10T10:34:18.301232+0000","last_fullsized":"2023-08-10T10:34:18.301232+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'477","last_scrub_stamp":"2023-08-10T10:34:18.301120+0000","last_deep_scrub":"29'477","last_deep_scrub_stamp":"2023-08-10T10:34:18.301120+0000","last_clean_scrub_stamp":"2023-08-10T10:34:18.301120+0000","objects_scrubbed":2,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:46.240254+0000","scrub_duration":0.012152744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:56.307143+0000","last_change":"2023-08-10T10:33:56.307192+0000","last_active":"2023-08-10T10:33:56.307143+0000","last_peered":"2023-08-10T10:33:56.307143+0000","last_clean":"2023-08-10T10:33:56.307143+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:33:56.307143+0000","last_undegraded":"2023-08-10T10:33:56.307143+0000","last_fullsized":"2023-08-10T10:33:56.307143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_clean_scrub_stamp":"2023-08-10T10:33:56.307064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:19.676661+0000","scrub_duration":0.001379796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.850329+0000","last_change":"2023-08-10T10:33:47.850385+0000","last_active":"2023-08-10T10:33:47.850329+0000","last_peered":"2023-08-10T10:33:47.850329+0000","last_clean":"2023-08-10T10:33:47.850329+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:47.850329+0000","last_undegraded":"2023-08-10T10:33:47.850329+0000","last_fullsized":"2023-08-10T10:33:47.850329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.850250+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:26.814272+0000","scrub_duration":0.0016867119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":488,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.698975+0000","last_change":"2023-08-10T10:34:00.699070+0000","last_active":"2023-08-10T10:34:00.698975+0000","last_peered":"2023-08-10T10:34:00.698975+0000","last_clean":"2023-08-10T10:34:00.698975+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:34:00.698975+0000","last_undegraded":"2023-08-10T10:34:00.698975+0000","last_fullsized":"2023-08-10T10:34:00.698975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'461","last_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_deep_scrub":"29'461","last_deep_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.698874+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:31.027914+0000","scrub_duration":0.0070033159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.008482+0000","last_change":"2023-08-10T10:33:34.008533+0000","last_active":"2023-08-10T10:33:34.008482+0000","last_peered":"2023-08-10T10:33:34.008482+0000","last_clean":"2023-08-10T10:33:34.008482+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:33:34.008482+0000","last_undegraded":"2023-08-10T10:33:34.008482+0000","last_fullsized":"2023-08-10T10:33:34.008482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.008392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:21.852519+0000","scrub_duration":0.002546034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'27","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.171650+0000","last_change":"2023-08-10T10:33:34.171704+0000","last_active":"2023-08-10T10:33:34.171650+0000","last_peered":"2023-08-10T10:33:34.171650+0000","last_clean":"2023-08-10T10:33:34.171650+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:34.171650+0000","last_undegraded":"2023-08-10T10:33:34.171650+0000","last_fullsized":"2023-08-10T10:33:34.171650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.171561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:40.952770+0000","scrub_duration":0.001549545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'465","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:16.254095+0000","last_change":"2023-08-10T10:34:16.254174+0000","last_active":"2023-08-10T10:34:16.254095+0000","last_peered":"2023-08-10T10:34:16.254095+0000","last_clean":"2023-08-10T10:34:16.254095+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:34:16.254095+0000","last_undegraded":"2023-08-10T10:34:16.254095+0000","last_fullsized":"2023-08-10T10:34:16.254095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'465","last_scrub_stamp":"2023-08-10T10:34:16.254009+0000","last_deep_scrub":"29'465","last_deep_scrub_stamp":"2023-08-10T10:34:16.254009+0000","last_clean_scrub_stamp":"2023-08-10T10:34:16.254009+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:44.193143+0000","scrub_duration":0.0022438100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.005191+0000","last_change":"2023-08-10T10:33:54.005241+0000","last_active":"2023-08-10T10:33:54.005191+0000","last_peered":"2023-08-10T10:33:54.005191+0000","last_clean":"2023-08-10T10:33:54.005191+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:33:54.005191+0000","last_undegraded":"2023-08-10T10:33:54.005191+0000","last_fullsized":"2023-08-10T10:33:54.005191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.005110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:01.830167+0000","scrub_duration":0.001665653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'36","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:11.450134+0000","last_change":"2023-08-10T10:34:11.450223+0000","last_active":"2023-08-10T10:34:11.450134+0000","last_peered":"2023-08-10T10:34:11.450134+0000","last_clean":"2023-08-10T10:34:11.450134+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:34:11.450134+0000","last_undegraded":"2023-08-10T10:34:11.450134+0000","last_fullsized":"2023-08-10T10:34:11.450134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-08-10T10:34:11.450029+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-08-10T10:34:11.450029+0000","last_clean_scrub_stamp":"2023-08-10T10:34:11.450029+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:39.389164+0000","scrub_duration":0.0022280490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.682684+0000","last_change":"2023-08-10T10:30:38.398389+0000","last_active":"2023-08-10T10:33:16.682684+0000","last_peered":"2023-08-10T10:33:16.682684+0000","last_clean":"2023-08-10T10:33:16.682684+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:33:16.682684+0000","last_undegraded":"2023-08-10T10:33:16.682684+0000","last_fullsized":"2023-08-10T10:33:16.682684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.340567+0000","last_change":"2023-08-10T10:33:48.340677+0000","last_active":"2023-08-10T10:33:48.340567+0000","last_peered":"2023-08-10T10:33:48.340567+0000","last_clean":"2023-08-10T10:33:48.340567+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:48.340567+0000","last_undegraded":"2023-08-10T10:33:48.340567+0000","last_fullsized":"2023-08-10T10:33:48.340567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.340462+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:32.243128+0000","scrub_duration":0.0055728410000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'42","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.699136+0000","last_change":"2023-08-10T10:33:40.699214+0000","last_active":"2023-08-10T10:33:40.699136+0000","last_peered":"2023-08-10T10:33:40.699136+0000","last_clean":"2023-08-10T10:33:40.699136+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:40.699136+0000","last_undegraded":"2023-08-10T10:33:40.699136+0000","last_fullsized":"2023-08-10T10:33:40.699136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.699048+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:29.397615+0000","scrub_duration":0.0021018759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'455","reported_seq":482,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:06.619339+0000","last_change":"2023-08-10T10:34:06.619454+0000","last_active":"2023-08-10T10:34:06.619339+0000","last_peered":"2023-08-10T10:34:06.619339+0000","last_clean":"2023-08-10T10:34:06.619339+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:34:06.619339+0000","last_undegraded":"2023-08-10T10:34:06.619339+0000","last_fullsized":"2023-08-10T10:34:06.619339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'455","last_scrub_stamp":"2023-08-10T10:34:06.619226+0000","last_deep_scrub":"29'455","last_deep_scrub_stamp":"2023-08-10T10:34:06.619226+0000","last_clean_scrub_stamp":"2023-08-10T10:34:06.619226+0000","objects_scrubbed":2,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:29.988822+0000","scrub_duration":0.0091010469999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'627","reported_seq":662,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:58.493785+0000","last_change":"2023-08-10T10:33:58.493843+0000","last_active":"2023-08-10T10:33:58.493785+0000","last_peered":"2023-08-10T10:33:58.493785+0000","last_clean":"2023-08-10T10:33:58.493785+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:58.493785+0000","last_undegraded":"2023-08-10T10:33:58.493785+0000","last_fullsized":"2023-08-10T10:33:58.493785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'627","last_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_deep_scrub":"29'627","last_deep_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:58.493691+0000","objects_scrubbed":4,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:26.432825+0000","scrub_duration":0.012523909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142065,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.995794+0000","last_change":"2023-08-10T10:30:34.344735+0000","last_active":"2023-08-10T10:33:19.995794+0000","last_peered":"2023-08-10T10:33:19.995794+0000","last_clean":"2023-08-10T10:33:19.995794+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:33:19.995794+0000","last_undegraded":"2023-08-10T10:33:19.995794+0000","last_fullsized":"2023-08-10T10:33:19.995794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:19.834024+0000","last_change":"2023-08-10T10:34:19.834097+0000","last_active":"2023-08-10T10:34:19.834024+0000","last_peered":"2023-08-10T10:34:19.834024+0000","last_clean":"2023-08-10T10:34:19.834024+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:34:19.834024+0000","last_undegraded":"2023-08-10T10:34:19.834024+0000","last_fullsized":"2023-08-10T10:34:19.834024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'489","last_scrub_stamp":"2023-08-10T10:34:19.833934+0000","last_deep_scrub":"29'489","last_deep_scrub_stamp":"2023-08-10T10:34:19.833934+0000","last_clean_scrub_stamp":"2023-08-10T10:34:19.833934+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:47.773068+0000","scrub_duration":0.002739043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.358720+0000","last_change":"2023-08-10T10:33:47.358774+0000","last_active":"2023-08-10T10:33:47.358720+0000","last_peered":"2023-08-10T10:33:47.358720+0000","last_clean":"2023-08-10T10:33:47.358720+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:33:47.358720+0000","last_undegraded":"2023-08-10T10:33:47.358720+0000","last_fullsized":"2023-08-10T10:33:47.358720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.358645+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:12.879510+0000","scrub_duration":0.0040639780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.233719+0000","last_change":"2023-08-10T10:33:28.233783+0000","last_active":"2023-08-10T10:33:28.233719+0000","last_peered":"2023-08-10T10:33:28.233719+0000","last_clean":"2023-08-10T10:33:28.233719+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:28.233719+0000","last_undegraded":"2023-08-10T10:33:28.233719+0000","last_fullsized":"2023-08-10T10:33:28.233719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.233641+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:16.077769+0000","scrub_duration":0.0020674529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'456","reported_seq":475,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.611815+0000","last_change":"2023-08-10T10:30:38.390481+0000","last_active":"2023-08-10T10:33:20.611815+0000","last_peered":"2023-08-10T10:33:20.611815+0000","last_clean":"2023-08-10T10:33:20.611815+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:33:20.611815+0000","last_undegraded":"2023-08-10T10:33:20.611815+0000","last_fullsized":"2023-08-10T10:33:20.611815+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.007534+0000","last_change":"2023-08-10T10:33:36.007599+0000","last_active":"2023-08-10T10:33:36.007534+0000","last_peered":"2023-08-10T10:33:36.007534+0000","last_clean":"2023-08-10T10:33:36.007534+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:33:36.007534+0000","last_undegraded":"2023-08-10T10:33:36.007534+0000","last_fullsized":"2023-08-10T10:33:36.007534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.007457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:24.706023+0000","scrub_duration":0.002469873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.992559+0000","last_change":"2023-08-10T10:34:03.992622+0000","last_active":"2023-08-10T10:34:03.992559+0000","last_peered":"2023-08-10T10:34:03.992559+0000","last_clean":"2023-08-10T10:34:03.992559+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:34:03.992559+0000","last_undegraded":"2023-08-10T10:34:03.992559+0000","last_fullsized":"2023-08-10T10:34:03.992559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.992472+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:29.640732+0000","scrub_duration":0.0016651019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":464,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.603925+0000","last_change":"2023-08-10T10:30:38.390247+0000","last_active":"2023-08-10T10:33:16.603925+0000","last_peered":"2023-08-10T10:33:16.603925+0000","last_clean":"2023-08-10T10:33:16.603925+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:33:16.603925+0000","last_undegraded":"2023-08-10T10:33:16.603925+0000","last_fullsized":"2023-08-10T10:33:16.603925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.321985+0000","last_change":"2023-08-10T10:33:45.322039+0000","last_active":"2023-08-10T10:33:45.321985+0000","last_peered":"2023-08-10T10:33:45.321985+0000","last_clean":"2023-08-10T10:33:45.321985+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:45.321985+0000","last_undegraded":"2023-08-10T10:33:45.321985+0000","last_fullsized":"2023-08-10T10:33:45.321985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.321894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:36.639491+0000","scrub_duration":0.0016593409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'39","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.155840+0000","last_change":"2023-08-10T10:34:03.155890+0000","last_active":"2023-08-10T10:34:03.155840+0000","last_peered":"2023-08-10T10:34:03.155840+0000","last_clean":"2023-08-10T10:34:03.155840+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:34:03.155840+0000","last_undegraded":"2023-08-10T10:34:03.155840+0000","last_fullsized":"2023-08-10T10:34:03.155840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.155763+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.525360+0000","scrub_duration":0.0016010919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'510","reported_seq":529,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603792+0000","last_change":"2023-08-10T10:30:38.409425+0000","last_active":"2023-08-10T10:33:20.603792+0000","last_peered":"2023-08-10T10:33:20.603792+0000","last_clean":"2023-08-10T10:33:20.603792+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:33:20.603792+0000","last_undegraded":"2023-08-10T10:33:20.603792+0000","last_fullsized":"2023-08-10T10:33:20.603792+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.909944+0000","last_change":"2023-08-10T10:33:33.910006+0000","last_active":"2023-08-10T10:33:33.909944+0000","last_peered":"2023-08-10T10:33:33.909944+0000","last_clean":"2023-08-10T10:33:33.909944+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:33:33.909944+0000","last_undegraded":"2023-08-10T10:33:33.909944+0000","last_fullsized":"2023-08-10T10:33:33.909944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.909866+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:52.137280+0000","scrub_duration":0.0047131780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:07.359893+0000","last_change":"2023-08-10T10:34:07.359957+0000","last_active":"2023-08-10T10:34:07.359893+0000","last_peered":"2023-08-10T10:34:07.359893+0000","last_clean":"2023-08-10T10:34:07.359893+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:34:07.359893+0000","last_undegraded":"2023-08-10T10:34:07.359893+0000","last_fullsized":"2023-08-10T10:34:07.359893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:07.359815+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:07.359815+0000","last_clean_scrub_stamp":"2023-08-10T10:34:07.359815+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:18.378966+0000","scrub_duration":0.0021041499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:24.197809+0000","last_change":"2023-08-10T10:34:24.197907+0000","last_active":"2023-08-10T10:34:24.197809+0000","last_peered":"2023-08-10T10:34:24.197809+0000","last_clean":"2023-08-10T10:34:24.197809+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:34:24.197809+0000","last_undegraded":"2023-08-10T10:34:24.197809+0000","last_fullsized":"2023-08-10T10:34:24.197809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'484","last_scrub_stamp":"2023-08-10T10:34:24.197712+0000","last_deep_scrub":"29'484","last_deep_scrub_stamp":"2023-08-10T10:34:24.197712+0000","last_clean_scrub_stamp":"2023-08-10T10:34:24.197712+0000","objects_scrubbed":2,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:33:56.755849+0000","scrub_duration":0.0096465149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.286658+0000","last_change":"2023-08-10T10:33:35.286714+0000","last_active":"2023-08-10T10:33:35.286658+0000","last_peered":"2023-08-10T10:33:35.286658+0000","last_clean":"2023-08-10T10:33:35.286658+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:35.286658+0000","last_undegraded":"2023-08-10T10:33:35.286658+0000","last_fullsized":"2023-08-10T10:33:35.286658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.286568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:23.130695+0000","scrub_duration":0.0033667300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:13.982648+0000","last_change":"2023-08-10T10:34:13.982700+0000","last_active":"2023-08-10T10:34:13.982648+0000","last_peered":"2023-08-10T10:34:13.982648+0000","last_clean":"2023-08-10T10:34:13.982648+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:34:13.982648+0000","last_undegraded":"2023-08-10T10:34:13.982648+0000","last_fullsized":"2023-08-10T10:34:13.982648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:34:13.982555+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:34:13.982555+0000","last_clean_scrub_stamp":"2023-08-10T10:34:13.982555+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:02.494323+0000","scrub_duration":0.001656755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":524,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:46.780481+0000","last_change":"2023-08-10T10:33:46.780614+0000","last_active":"2023-08-10T10:33:46.780481+0000","last_peered":"2023-08-10T10:33:46.780481+0000","last_clean":"2023-08-10T10:33:46.780481+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:46.780481+0000","last_undegraded":"2023-08-10T10:33:46.780481+0000","last_fullsized":"2023-08-10T10:33:46.780481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'497","last_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_deep_scrub":"29'497","last_deep_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_clean_scrub_stamp":"2023-08-10T10:33:46.780378+0000","objects_scrubbed":2,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:26.660886+0000","scrub_duration":0.010450968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.274812+0000","last_change":"2023-08-10T10:33:51.274878+0000","last_active":"2023-08-10T10:33:51.274812+0000","last_peered":"2023-08-10T10:33:51.274812+0000","last_clean":"2023-08-10T10:33:51.274812+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:33:51.274812+0000","last_undegraded":"2023-08-10T10:33:51.274812+0000","last_fullsized":"2023-08-10T10:33:51.274812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.274730+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:59.099787+0000","scrub_duration":0.0029352610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:13.792386+0000","last_change":"2023-08-10T10:34:13.792458+0000","last_active":"2023-08-10T10:34:13.792386+0000","last_peered":"2023-08-10T10:34:13.792386+0000","last_clean":"2023-08-10T10:34:13.792386+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:34:13.792386+0000","last_undegraded":"2023-08-10T10:34:13.792386+0000","last_fullsized":"2023-08-10T10:34:13.792386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:13.792301+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:13.792301+0000","last_clean_scrub_stamp":"2023-08-10T10:34:13.792301+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:17.772770+0000","scrub_duration":0.002485765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'473","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.753624+0000","last_change":"2023-08-10T10:33:54.753735+0000","last_active":"2023-08-10T10:33:54.753624+0000","last_peered":"2023-08-10T10:33:54.753624+0000","last_clean":"2023-08-10T10:33:54.753624+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:54.753624+0000","last_undegraded":"2023-08-10T10:33:54.753624+0000","last_fullsized":"2023-08-10T10:33:54.753624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.753507+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:21.530219+0000","scrub_duration":0.0074936170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.347637+0000","last_change":"2023-08-10T10:33:49.347692+0000","last_active":"2023-08-10T10:33:49.347637+0000","last_peered":"2023-08-10T10:33:49.347637+0000","last_clean":"2023-08-10T10:33:49.347637+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:33:49.347637+0000","last_undegraded":"2023-08-10T10:33:49.347637+0000","last_fullsized":"2023-08-10T10:33:49.347637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.347549+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.813246+0000","scrub_duration":0.0030245340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:57.750541+0000","last_change":"2023-08-10T10:33:57.750610+0000","last_active":"2023-08-10T10:33:57.750541+0000","last_peered":"2023-08-10T10:33:57.750541+0000","last_clean":"2023-08-10T10:33:57.750541+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:57.750541+0000","last_undegraded":"2023-08-10T10:33:57.750541+0000","last_fullsized":"2023-08-10T10:33:57.750541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_clean_scrub_stamp":"2023-08-10T10:33:57.750444+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:51:26.899141+0000","scrub_duration":0.0025147009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.682718+0000","last_change":"2023-08-10T10:33:51.682788+0000","last_active":"2023-08-10T10:33:51.682718+0000","last_peered":"2023-08-10T10:33:51.682718+0000","last_clean":"2023-08-10T10:33:51.682718+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:51.682718+0000","last_undegraded":"2023-08-10T10:33:51.682718+0000","last_fullsized":"2023-08-10T10:33:51.682718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'459","last_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_deep_scrub":"29'459","last_deep_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.682645+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:30.646667+0000","scrub_duration":0.002161919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.058424+0000","last_change":"2023-08-10T10:33:49.058472+0000","last_active":"2023-08-10T10:33:49.058424+0000","last_peered":"2023-08-10T10:33:49.058424+0000","last_clean":"2023-08-10T10:33:49.058424+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:33:49.058424+0000","last_undegraded":"2023-08-10T10:33:49.058424+0000","last_fullsized":"2023-08-10T10:33:49.058424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.058345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.151225+0000","scrub_duration":0.0024074959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.950114+0000","last_change":"2023-08-10T10:33:27.950155+0000","last_active":"2023-08-10T10:33:27.950114+0000","last_peered":"2023-08-10T10:33:27.950114+0000","last_clean":"2023-08-10T10:33:27.950114+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:27.950114+0000","last_undegraded":"2023-08-10T10:33:27.950114+0000","last_fullsized":"2023-08-10T10:33:27.950114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.950050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:52.895642+0000","scrub_duration":0.0013175579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.750589+0000","last_change":"2023-08-10T10:33:47.750695+0000","last_active":"2023-08-10T10:33:47.750589+0000","last_peered":"2023-08-10T10:33:47.750589+0000","last_clean":"2023-08-10T10:33:47.750589+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:47.750589+0000","last_undegraded":"2023-08-10T10:33:47.750589+0000","last_fullsized":"2023-08-10T10:33:47.750589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'441","last_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_deep_scrub":"29'441","last_deep_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.750477+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:44.745054+0000","scrub_duration":0.0026848639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.270842+0000","last_change":"2023-08-10T10:33:40.270896+0000","last_active":"2023-08-10T10:33:40.270842+0000","last_peered":"2023-08-10T10:33:40.270842+0000","last_clean":"2023-08-10T10:33:40.270842+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:33:40.270842+0000","last_undegraded":"2023-08-10T10:33:40.270842+0000","last_fullsized":"2023-08-10T10:33:40.270842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.270765+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:05.791630+0000","scrub_duration":0.0031293139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:11.739851+0000","last_change":"2023-08-10T10:34:11.739904+0000","last_active":"2023-08-10T10:34:11.739851+0000","last_peered":"2023-08-10T10:34:11.739851+0000","last_clean":"2023-08-10T10:34:11.739851+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:34:11.739851+0000","last_undegraded":"2023-08-10T10:34:11.739851+0000","last_fullsized":"2023-08-10T10:34:11.739851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:34:11.739708+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:34:11.739708+0000","last_clean_scrub_stamp":"2023-08-10T10:34:11.739708+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:38.540541+0000","scrub_duration":0.0024274370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'479","reported_seq":506,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:14.464765+0000","last_change":"2023-08-10T10:34:14.464838+0000","last_active":"2023-08-10T10:34:14.464765+0000","last_peered":"2023-08-10T10:34:14.464765+0000","last_clean":"2023-08-10T10:34:14.464765+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:34:14.464765+0000","last_undegraded":"2023-08-10T10:34:14.464765+0000","last_fullsized":"2023-08-10T10:34:14.464765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'479","last_scrub_stamp":"2023-08-10T10:34:14.464686+0000","last_deep_scrub":"29'479","last_deep_scrub_stamp":"2023-08-10T10:34:14.464686+0000","last_clean_scrub_stamp":"2023-08-10T10:34:14.464686+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:02.976455+0000","scrub_duration":0.0021581220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.952739+0000","last_change":"2023-08-10T10:33:35.952798+0000","last_active":"2023-08-10T10:33:35.952739+0000","last_peered":"2023-08-10T10:33:35.952739+0000","last_clean":"2023-08-10T10:33:35.952739+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:33:35.952739+0000","last_undegraded":"2023-08-10T10:33:35.952739+0000","last_fullsized":"2023-08-10T10:33:35.952739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.952663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.124104+0000","scrub_duration":0.0015171099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.580971+0000","last_change":"2023-08-10T10:33:30.581025+0000","last_active":"2023-08-10T10:33:30.580971+0000","last_peered":"2023-08-10T10:33:30.580971+0000","last_clean":"2023-08-10T10:33:30.580971+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:30.580971+0000","last_undegraded":"2023-08-10T10:33:30.580971+0000","last_fullsized":"2023-08-10T10:33:30.580971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.580850+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:14.483516+0000","scrub_duration":0.0024261040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'458","reported_seq":477,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.604915+0000","last_change":"2023-08-10T10:30:38.407161+0000","last_active":"2023-08-10T10:33:20.604915+0000","last_peered":"2023-08-10T10:33:20.604915+0000","last_clean":"2023-08-10T10:33:20.604915+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:33:20.604915+0000","last_undegraded":"2023-08-10T10:33:20.604915+0000","last_fullsized":"2023-08-10T10:33:20.604915+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.519905+0000","last_change":"2023-08-10T10:33:54.519965+0000","last_active":"2023-08-10T10:33:54.519905+0000","last_peered":"2023-08-10T10:33:54.519905+0000","last_clean":"2023-08-10T10:33:54.519905+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:33:54.519905+0000","last_undegraded":"2023-08-10T10:33:54.519905+0000","last_fullsized":"2023-08-10T10:33:54.519905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.519822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:05.538972+0000","scrub_duration":0.00232088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'17","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.617446+0000","last_change":"2023-08-10T10:33:29.617535+0000","last_active":"2023-08-10T10:33:29.617446+0000","last_peered":"2023-08-10T10:33:29.617446+0000","last_clean":"2023-08-10T10:33:29.617446+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:29.617446+0000","last_undegraded":"2023-08-10T10:33:29.617446+0000","last_fullsized":"2023-08-10T10:33:29.617446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.617330+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:55.138195+0000","scrub_duration":0.0018756619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":481,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.619121+0000","last_change":"2023-08-10T10:30:38.408950+0000","last_active":"2023-08-10T10:33:16.619121+0000","last_peered":"2023-08-10T10:33:16.619121+0000","last_clean":"2023-08-10T10:33:16.619121+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:33:16.619121+0000","last_undegraded":"2023-08-10T10:33:16.619121+0000","last_fullsized":"2023-08-10T10:33:16.619121+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.404468+0000","last_change":"2023-08-10T10:33:45.404519+0000","last_active":"2023-08-10T10:33:45.404468+0000","last_peered":"2023-08-10T10:33:45.404468+0000","last_clean":"2023-08-10T10:33:45.404468+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:33:45.404468+0000","last_undegraded":"2023-08-10T10:33:45.404468+0000","last_fullsized":"2023-08-10T10:33:45.404468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.404381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:53.229438+0000","scrub_duration":0.0015625789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'28","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.693014+0000","last_change":"2023-08-10T10:33:49.693066+0000","last_active":"2023-08-10T10:33:49.693014+0000","last_peered":"2023-08-10T10:33:49.693014+0000","last_clean":"2023-08-10T10:33:49.693014+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:49.693014+0000","last_undegraded":"2023-08-10T10:33:49.693014+0000","last_fullsized":"2023-08-10T10:33:49.693014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.692931+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.785811+0000","scrub_duration":0.001711401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":493,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:14.255728+0000","last_change":"2023-08-10T10:34:14.255802+0000","last_active":"2023-08-10T10:34:14.255728+0000","last_peered":"2023-08-10T10:34:14.255728+0000","last_clean":"2023-08-10T10:34:14.255728+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:34:14.255728+0000","last_undegraded":"2023-08-10T10:34:14.255728+0000","last_fullsized":"2023-08-10T10:34:14.255728+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'466","last_scrub_stamp":"2023-08-10T10:34:14.255638+0000","last_deep_scrub":"29'466","last_deep_scrub_stamp":"2023-08-10T10:34:14.255638+0000","last_clean_scrub_stamp":"2023-08-10T10:34:14.255638+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:25.274788+0000","scrub_duration":0.0022907560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.710680+0000","last_change":"2023-08-10T10:33:30.710720+0000","last_active":"2023-08-10T10:33:30.710680+0000","last_peered":"2023-08-10T10:33:30.710680+0000","last_clean":"2023-08-10T10:33:30.710680+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:33:30.710680+0000","last_undegraded":"2023-08-10T10:33:30.710680+0000","last_fullsized":"2023-08-10T10:33:30.710680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.710529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:59.859226+0000","scrub_duration":0.0012663329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.009702+0000","last_change":"2023-08-10T10:33:52.009755+0000","last_active":"2023-08-10T10:33:52.009702+0000","last_peered":"2023-08-10T10:33:52.009702+0000","last_clean":"2023-08-10T10:33:52.009702+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:52.009702+0000","last_undegraded":"2023-08-10T10:33:52.009702+0000","last_fullsized":"2023-08-10T10:33:52.009702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.009622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:47.475319+0000","scrub_duration":0.002330159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.696695+0000","last_change":"2023-08-10T10:33:38.696778+0000","last_active":"2023-08-10T10:33:38.696695+0000","last_peered":"2023-08-10T10:33:38.696695+0000","last_clean":"2023-08-10T10:33:38.696695+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:38.696695+0000","last_undegraded":"2023-08-10T10:33:38.696695+0000","last_fullsized":"2023-08-10T10:33:38.696695+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.696559+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:26.540686+0000","scrub_duration":0.0024199579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'462","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:19.269631+0000","last_change":"2023-08-10T10:34:19.269727+0000","last_active":"2023-08-10T10:34:19.269631+0000","last_peered":"2023-08-10T10:34:19.269631+0000","last_clean":"2023-08-10T10:34:19.269631+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:34:19.269631+0000","last_undegraded":"2023-08-10T10:34:19.269631+0000","last_fullsized":"2023-08-10T10:34:19.269631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:34:19.269531+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:34:19.269531+0000","last_clean_scrub_stamp":"2023-08-10T10:34:19.269531+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:27:19.423933+0000","scrub_duration":0.0022145950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:37.948632+0000","last_change":"2023-08-10T10:33:37.948688+0000","last_active":"2023-08-10T10:33:37.948632+0000","last_peered":"2023-08-10T10:33:37.948632+0000","last_clean":"2023-08-10T10:33:37.948632+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:33:37.948632+0000","last_undegraded":"2023-08-10T10:33:37.948632+0000","last_fullsized":"2023-08-10T10:33:37.948632+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_clean_scrub_stamp":"2023-08-10T10:33:37.948513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:54.150578+0000","scrub_duration":0.002318966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.532024+0000","last_change":"2023-08-10T10:33:59.532081+0000","last_active":"2023-08-10T10:33:59.532024+0000","last_peered":"2023-08-10T10:33:59.532024+0000","last_clean":"2023-08-10T10:33:59.532024+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:33:59.532024+0000","last_undegraded":"2023-08-10T10:33:59.532024+0000","last_fullsized":"2023-08-10T10:33:59.532024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.531926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:26:59.686329+0000","scrub_duration":0.001805404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.718634+0000","last_change":"2023-08-10T10:33:41.718685+0000","last_active":"2023-08-10T10:33:41.718634+0000","last_peered":"2023-08-10T10:33:41.718634+0000","last_clean":"2023-08-10T10:33:41.718634+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:41.718634+0000","last_undegraded":"2023-08-10T10:33:41.718634+0000","last_fullsized":"2023-08-10T10:33:41.718634+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.718538+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:53.207796+0000","scrub_duration":0.001658145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":445,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.707475+0000","last_change":"2023-08-10T10:33:48.707580+0000","last_active":"2023-08-10T10:33:48.707475+0000","last_peered":"2023-08-10T10:33:48.707475+0000","last_clean":"2023-08-10T10:33:48.707475+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:48.707475+0000","last_undegraded":"2023-08-10T10:33:48.707475+0000","last_fullsized":"2023-08-10T10:33:48.707475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'418","last_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_deep_scrub":"29'418","last_deep_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.707382+0000","objects_scrubbed":1,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:23.533062+0000","scrub_duration":0.0072502089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:26.879110+0000","last_change":"2023-08-10T10:33:26.879152+0000","last_active":"2023-08-10T10:33:26.879110+0000","last_peered":"2023-08-10T10:33:26.879110+0000","last_clean":"2023-08-10T10:33:26.879110+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:33:26.879110+0000","last_undegraded":"2023-08-10T10:33:26.879110+0000","last_fullsized":"2023-08-10T10:33:26.879110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_clean_scrub_stamp":"2023-08-10T10:33:26.879039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:12.596625+0000","scrub_duration":0.001274535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.701104+0000","last_change":"2023-08-10T10:33:34.701154+0000","last_active":"2023-08-10T10:33:34.701104+0000","last_peered":"2023-08-10T10:33:34.701104+0000","last_clean":"2023-08-10T10:33:34.701104+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:33:34.701104+0000","last_undegraded":"2023-08-10T10:33:34.701104+0000","last_fullsized":"2023-08-10T10:33:34.701104+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.701006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:58.432269+0000","scrub_duration":0.001815002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.665797+0000","last_change":"2023-08-10T10:33:50.665836+0000","last_active":"2023-08-10T10:33:50.665797+0000","last_peered":"2023-08-10T10:33:50.665797+0000","last_clean":"2023-08-10T10:33:50.665797+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:50.665797+0000","last_undegraded":"2023-08-10T10:33:50.665797+0000","last_fullsized":"2023-08-10T10:33:50.665797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.665732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:16.186597+0000","scrub_duration":0.002561823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":473,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.608391+0000","last_change":"2023-08-10T10:30:38.393501+0000","last_active":"2023-08-10T10:33:16.608391+0000","last_peered":"2023-08-10T10:33:16.608391+0000","last_clean":"2023-08-10T10:33:16.608391+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:33:16.608391+0000","last_undegraded":"2023-08-10T10:33:16.608391+0000","last_fullsized":"2023-08-10T10:33:16.608391+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.003375+0000","last_change":"2023-08-10T10:33:40.003425+0000","last_active":"2023-08-10T10:33:40.003375+0000","last_peered":"2023-08-10T10:33:40.003375+0000","last_clean":"2023-08-10T10:33:40.003375+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:33:40.003375+0000","last_undegraded":"2023-08-10T10:33:40.003375+0000","last_fullsized":"2023-08-10T10:33:40.003375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.003286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:45.183349+0000","scrub_duration":0.0025616390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":200,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.300593+0000","last_change":"2023-08-10T10:33:36.300593+0000","last_active":"2023-08-10T10:33:36.300593+0000","last_peered":"2023-08-10T10:33:36.300593+0000","last_clean":"2023-08-10T10:33:36.300593+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:33:36.300593+0000","last_undegraded":"2023-08-10T10:33:36.300593+0000","last_fullsized":"2023-08-10T10:33:36.300593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.300423+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:52.502488+0000","scrub_duration":0.0062505190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.276021+0000","last_change":"2023-08-10T10:33:38.276073+0000","last_active":"2023-08-10T10:33:38.276021+0000","last_peered":"2023-08-10T10:33:38.276021+0000","last_clean":"2023-08-10T10:33:38.276021+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:33:38.276021+0000","last_undegraded":"2023-08-10T10:33:38.276021+0000","last_fullsized":"2023-08-10T10:33:38.276021+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.275922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:29.593519+0000","scrub_duration":0.002303009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.794328+0000","last_change":"2023-08-10T10:33:50.794377+0000","last_active":"2023-08-10T10:33:50.794328+0000","last_peered":"2023-08-10T10:33:50.794328+0000","last_clean":"2023-08-10T10:33:50.794328+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:50.794328+0000","last_undegraded":"2023-08-10T10:33:50.794328+0000","last_fullsized":"2023-08-10T10:33:50.794328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.794244+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:17.570956+0000","scrub_duration":0.0016971849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'427","reported_seq":446,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.603654+0000","last_change":"2023-08-10T10:30:38.411034+0000","last_active":"2023-08-10T10:33:20.603654+0000","last_peered":"2023-08-10T10:33:20.603654+0000","last_clean":"2023-08-10T10:33:20.603654+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:33:20.603654+0000","last_undegraded":"2023-08-10T10:33:20.603654+0000","last_fullsized":"2023-08-10T10:33:20.603654+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.298437+0000","last_change":"2023-08-10T10:33:38.298484+0000","last_active":"2023-08-10T10:33:38.298437+0000","last_peered":"2023-08-10T10:33:38.298437+0000","last_clean":"2023-08-10T10:33:38.298437+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:33:38.298437+0000","last_undegraded":"2023-08-10T10:33:38.298437+0000","last_fullsized":"2023-08-10T10:33:38.298437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.298353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:43.478416+0000","scrub_duration":0.002283045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'16","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.996845+0000","last_change":"2023-08-10T10:33:30.996902+0000","last_active":"2023-08-10T10:33:30.996845+0000","last_peered":"2023-08-10T10:33:30.996845+0000","last_clean":"2023-08-10T10:33:30.996845+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:30.996845+0000","last_undegraded":"2023-08-10T10:33:30.996845+0000","last_fullsized":"2023-08-10T10:33:30.996845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.996769+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:14.424734+0000","scrub_duration":0.0026543970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.986781+0000","last_change":"2023-08-10T10:33:43.986851+0000","last_active":"2023-08-10T10:33:43.986781+0000","last_peered":"2023-08-10T10:33:43.986781+0000","last_clean":"2023-08-10T10:33:43.986781+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:43.986781+0000","last_undegraded":"2023-08-10T10:33:43.986781+0000","last_fullsized":"2023-08-10T10:33:43.986781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.986673+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:35.304270+0000","scrub_duration":0.001579366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":499,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:01.658708+0000","last_change":"2023-08-10T10:34:01.658788+0000","last_active":"2023-08-10T10:34:01.658708+0000","last_peered":"2023-08-10T10:34:01.658708+0000","last_clean":"2023-08-10T10:34:01.658708+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:34:01.658708+0000","last_undegraded":"2023-08-10T10:34:01.658708+0000","last_fullsized":"2023-08-10T10:34:01.658708+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'472","last_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_deep_scrub":"29'472","last_deep_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_clean_scrub_stamp":"2023-08-10T10:34:01.658617+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:08:25.389881+0000","scrub_duration":0.0024055499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.330743+0000","last_change":"2023-08-10T10:33:41.330818+0000","last_active":"2023-08-10T10:33:41.330743+0000","last_peered":"2023-08-10T10:33:41.330743+0000","last_clean":"2023-08-10T10:33:41.330743+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:33:41.330743+0000","last_undegraded":"2023-08-10T10:33:41.330743+0000","last_fullsized":"2023-08-10T10:33:41.330743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.330658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:48.111867+0000","scrub_duration":0.001792685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.662773+0000","last_change":"2023-08-10T10:33:35.662823+0000","last_active":"2023-08-10T10:33:35.662773+0000","last_peered":"2023-08-10T10:33:35.662773+0000","last_clean":"2023-08-10T10:33:35.662773+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:33:35.662773+0000","last_undegraded":"2023-08-10T10:33:35.662773+0000","last_fullsized":"2023-08-10T10:33:35.662773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.662682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:19.090646+0000","scrub_duration":0.0017149699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.073767+0000","last_change":"2023-08-10T10:33:49.073816+0000","last_active":"2023-08-10T10:33:49.073767+0000","last_peered":"2023-08-10T10:33:49.073767+0000","last_clean":"2023-08-10T10:33:49.073767+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:49.073767+0000","last_undegraded":"2023-08-10T10:33:49.073767+0000","last_fullsized":"2023-08-10T10:33:49.073767+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.073691+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.539389+0000","scrub_duration":0.002661442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'511","reported_seq":530,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.593079+0000","last_change":"2023-08-10T10:30:38.402555+0000","last_active":"2023-08-10T10:33:20.593079+0000","last_peered":"2023-08-10T10:33:20.593079+0000","last_clean":"2023-08-10T10:33:20.593079+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:33:20.593079+0000","last_undegraded":"2023-08-10T10:33:20.593079+0000","last_fullsized":"2023-08-10T10:33:20.593079+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.311638+0000","last_change":"2023-08-10T10:33:41.311696+0000","last_active":"2023-08-10T10:33:41.311638+0000","last_peered":"2023-08-10T10:33:41.311638+0000","last_clean":"2023-08-10T10:33:41.311638+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:33:41.311638+0000","last_undegraded":"2023-08-10T10:33:41.311638+0000","last_fullsized":"2023-08-10T10:33:41.311638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.311549+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:25.214215+0000","scrub_duration":0.0039921610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:32.706810+0000","last_change":"2023-08-10T10:33:32.706856+0000","last_active":"2023-08-10T10:33:32.706810+0000","last_peered":"2023-08-10T10:33:32.706810+0000","last_clean":"2023-08-10T10:33:32.706810+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:33:32.706810+0000","last_undegraded":"2023-08-10T10:33:32.706810+0000","last_fullsized":"2023-08-10T10:33:32.706810+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_clean_scrub_stamp":"2023-08-10T10:33:32.706726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:57.652318+0000","scrub_duration":0.002258688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.211129+0000","last_change":"2023-08-10T10:33:29.211173+0000","last_active":"2023-08-10T10:33:29.211129+0000","last_peered":"2023-08-10T10:33:29.211129+0000","last_clean":"2023-08-10T10:33:29.211129+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:29.211129+0000","last_undegraded":"2023-08-10T10:33:29.211129+0000","last_fullsized":"2023-08-10T10:33:29.211129+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.211063+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:45.413129+0000","scrub_duration":0.0022425100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":469,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:16.644856+0000","last_change":"2023-08-10T10:30:38.404994+0000","last_active":"2023-08-10T10:33:16.644856+0000","last_peered":"2023-08-10T10:33:16.644856+0000","last_clean":"2023-08-10T10:33:16.644856+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:33:16.644856+0000","last_undegraded":"2023-08-10T10:33:16.644856+0000","last_fullsized":"2023-08-10T10:33:16.644856+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":41,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.820766+0000","last_change":"2023-08-10T10:33:29.820813+0000","last_active":"2023-08-10T10:33:29.820766+0000","last_peered":"2023-08-10T10:33:29.820766+0000","last_clean":"2023-08-10T10:33:29.820766+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:33:29.820766+0000","last_undegraded":"2023-08-10T10:33:29.820766+0000","last_fullsized":"2023-08-10T10:33:29.820766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.820682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.382461+0000","scrub_duration":0.0016165769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.024844+0000","last_change":"2023-08-10T10:33:30.024886+0000","last_active":"2023-08-10T10:33:30.024844+0000","last_peered":"2023-08-10T10:33:30.024844+0000","last_clean":"2023-08-10T10:33:30.024844+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:30.024844+0000","last_undegraded":"2023-08-10T10:33:30.024844+0000","last_fullsized":"2023-08-10T10:33:30.024844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.024779+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:53.756043+0000","scrub_duration":0.001678323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'22","reported_seq":55,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:05.628179+0000","last_change":"2023-08-10T10:34:05.628254+0000","last_active":"2023-08-10T10:34:05.628179+0000","last_peered":"2023-08-10T10:34:05.628179+0000","last_clean":"2023-08-10T10:34:05.628179+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:34:05.628179+0000","last_undegraded":"2023-08-10T10:34:05.628179+0000","last_fullsized":"2023-08-10T10:34:05.628179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2023-08-10T10:34:05.628079+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2023-08-10T10:34:05.628079+0000","last_clean_scrub_stamp":"2023-08-10T10:34:05.628079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:59.234795+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'436","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.730477+0000","last_change":"2023-08-10T10:33:55.730594+0000","last_active":"2023-08-10T10:33:55.730477+0000","last_peered":"2023-08-10T10:33:55.730477+0000","last_clean":"2023-08-10T10:33:55.730477+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:55.730477+0000","last_undegraded":"2023-08-10T10:33:55.730477+0000","last_fullsized":"2023-08-10T10:33:55.730477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'436","last_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_deep_scrub":"29'436","last_deep_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.730389+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:17.182651+0000","scrub_duration":0.0023941240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.996535+0000","last_change":"2023-08-10T10:33:28.996619+0000","last_active":"2023-08-10T10:33:28.996535+0000","last_peered":"2023-08-10T10:33:28.996535+0000","last_clean":"2023-08-10T10:33:28.996535+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:33:28.996535+0000","last_undegraded":"2023-08-10T10:33:28.996535+0000","last_fullsized":"2023-08-10T10:33:28.996535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.996417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:59.325457+0000","scrub_duration":0.00214364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.761702+0000","last_change":"2023-08-10T10:33:43.761757+0000","last_active":"2023-08-10T10:33:43.761702+0000","last_peered":"2023-08-10T10:33:43.761702+0000","last_clean":"2023-08-10T10:33:43.761702+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:43.761702+0000","last_undegraded":"2023-08-10T10:33:43.761702+0000","last_fullsized":"2023-08-10T10:33:43.761702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.761621+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:33.933062+0000","scrub_duration":0.0016532879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":512,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:21.297908+0000","last_change":"2023-08-10T10:34:21.297989+0000","last_active":"2023-08-10T10:34:21.297908+0000","last_peered":"2023-08-10T10:34:21.297908+0000","last_clean":"2023-08-10T10:34:21.297908+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:34:21.297908+0000","last_undegraded":"2023-08-10T10:34:21.297908+0000","last_fullsized":"2023-08-10T10:34:21.297908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'485","last_scrub_stamp":"2023-08-10T10:34:21.297813+0000","last_deep_scrub":"29'485","last_deep_scrub_stamp":"2023-08-10T10:34:21.297813+0000","last_clean_scrub_stamp":"2023-08-10T10:34:21.297813+0000","objects_scrubbed":2,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:09:03.055208+0000","scrub_duration":0.012121412999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.019552+0000","last_change":"2023-08-10T10:33:50.019623+0000","last_active":"2023-08-10T10:33:50.019552+0000","last_peered":"2023-08-10T10:33:50.019552+0000","last_clean":"2023-08-10T10:33:50.019552+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:33:50.019552+0000","last_undegraded":"2023-08-10T10:33:50.019552+0000","last_fullsized":"2023-08-10T10:33:50.019552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.019471+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:15.540336+0000","scrub_duration":0.0030648339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:44.471463+0000","last_change":"2023-08-10T10:33:44.471546+0000","last_active":"2023-08-10T10:33:44.471463+0000","last_peered":"2023-08-10T10:33:44.471463+0000","last_clean":"2023-08-10T10:33:44.471463+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:44.471463+0000","last_undegraded":"2023-08-10T10:33:44.471463+0000","last_fullsized":"2023-08-10T10:33:44.471463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_clean_scrub_stamp":"2023-08-10T10:33:44.471356+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:07.840953+0000","scrub_duration":0.0024103369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:22.859098+0000","last_change":"2023-08-10T10:34:22.859178+0000","last_active":"2023-08-10T10:34:22.859098+0000","last_peered":"2023-08-10T10:34:22.859098+0000","last_clean":"2023-08-10T10:34:22.859098+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:34:22.859098+0000","last_undegraded":"2023-08-10T10:34:22.859098+0000","last_fullsized":"2023-08-10T10:34:22.859098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'484","last_scrub_stamp":"2023-08-10T10:34:22.859001+0000","last_deep_scrub":"29'484","last_deep_scrub_stamp":"2023-08-10T10:34:22.859001+0000","last_clean_scrub_stamp":"2023-08-10T10:34:22.859001+0000","objects_scrubbed":2,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:57:11.952489+0000","scrub_duration":0.011800982999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.974225+0000","last_change":"2023-08-10T10:33:50.974281+0000","last_active":"2023-08-10T10:33:50.974225+0000","last_peered":"2023-08-10T10:33:50.974225+0000","last_clean":"2023-08-10T10:33:50.974225+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:50.974225+0000","last_undegraded":"2023-08-10T10:33:50.974225+0000","last_fullsized":"2023-08-10T10:33:50.974225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.974148+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:34.876814+0000","scrub_duration":0.0029544839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'23","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.421729+0000","last_change":"2023-08-10T10:33:43.421786+0000","last_active":"2023-08-10T10:33:43.421729+0000","last_peered":"2023-08-10T10:33:43.421729+0000","last_clean":"2023-08-10T10:33:43.421729+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:43.421729+0000","last_undegraded":"2023-08-10T10:33:43.421729+0000","last_fullsized":"2023-08-10T10:33:43.421729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.421640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:09.069900+0000","scrub_duration":0.0020388680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'470","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:20.601755+0000","last_change":"2023-08-10T10:30:38.406903+0000","last_active":"2023-08-10T10:33:20.601755+0000","last_peered":"2023-08-10T10:33:20.601755+0000","last_clean":"2023-08-10T10:33:20.601755+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:33:20.601755+0000","last_undegraded":"2023-08-10T10:33:20.601755+0000","last_fullsized":"2023-08-10T10:33:20.601755+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:37.348126+0000","last_clean_scrub_stamp":"2023-08-10T10:30:37.348126+0000","objects_scrubbed":0,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.286442+0000","last_change":"2023-08-10T10:33:55.286501+0000","last_active":"2023-08-10T10:33:55.286442+0000","last_peered":"2023-08-10T10:33:55.286442+0000","last_clean":"2023-08-10T10:33:55.286442+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:33:55.286442+0000","last_undegraded":"2023-08-10T10:33:55.286442+0000","last_fullsized":"2023-08-10T10:33:55.286442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.286354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:20.934614+0000","scrub_duration":0.0020151869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:22.579185+0000","last_change":"2023-08-10T10:34:22.579240+0000","last_active":"2023-08-10T10:34:22.579185+0000","last_peered":"2023-08-10T10:34:22.579185+0000","last_clean":"2023-08-10T10:34:22.579185+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:34:22.579185+0000","last_undegraded":"2023-08-10T10:34:22.579185+0000","last_fullsized":"2023-08-10T10:34:22.579185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:22.579103+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:22.579103+0000","last_clean_scrub_stamp":"2023-08-10T10:34:22.579103+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:04.697567+0000","scrub_duration":0.0015950129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'462","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.689362+0000","last_change":"2023-08-10T10:33:52.689490+0000","last_active":"2023-08-10T10:33:52.689362+0000","last_peered":"2023-08-10T10:33:52.689362+0000","last_clean":"2023-08-10T10:33:52.689362+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:52.689362+0000","last_undegraded":"2023-08-10T10:33:52.689362+0000","last_fullsized":"2023-08-10T10:33:52.689362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.689260+0000","objects_scrubbed":1,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:48.154957+0000","scrub_duration":0.0069198020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'7","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.996594+0000","last_change":"2023-08-10T10:33:36.996650+0000","last_active":"2023-08-10T10:33:36.996594+0000","last_peered":"2023-08-10T10:33:36.996594+0000","last_clean":"2023-08-10T10:33:36.996594+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:33:36.996594+0000","last_undegraded":"2023-08-10T10:33:36.996594+0000","last_fullsized":"2023-08-10T10:33:36.996594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.996505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:48.485764+0000","scrub_duration":0.004534967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.491588+0000","last_change":"2023-08-10T10:33:52.491684+0000","last_active":"2023-08-10T10:33:52.491588+0000","last_peered":"2023-08-10T10:33:52.491588+0000","last_clean":"2023-08-10T10:33:52.491588+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:52.491588+0000","last_undegraded":"2023-08-10T10:33:52.491588+0000","last_fullsized":"2023-08-10T10:33:52.491588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.491476+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:41.003245+0000","scrub_duration":0.0016911809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'48","reported_seq":81,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.879218+0000","last_change":"2023-08-10T10:33:40.879272+0000","last_active":"2023-08-10T10:33:40.879218+0000","last_peered":"2023-08-10T10:33:40.879218+0000","last_clean":"2023-08-10T10:33:40.879218+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:40.879218+0000","last_undegraded":"2023-08-10T10:33:40.879218+0000","last_fullsized":"2023-08-10T10:33:40.879218+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.879137+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:38.333811+0000","scrub_duration":0.0022235739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'46","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:19.982882+0000","last_change":"2023-08-10T10:30:34.335896+0000","last_active":"2023-08-10T10:33:19.982882+0000","last_peered":"2023-08-10T10:33:19.982882+0000","last_clean":"2023-08-10T10:33:19.982882+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:33:19.982882+0000","last_undegraded":"2023-08-10T10:33:19.982882+0000","last_fullsized":"2023-08-10T10:33:19.982882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:30:33.293344+0000","last_clean_scrub_stamp":"2023-08-10T10:30:33.293344+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:18.830946+0000","last_change":"2023-08-10T10:34:18.831014+0000","last_active":"2023-08-10T10:34:18.830946+0000","last_peered":"2023-08-10T10:34:18.830946+0000","last_clean":"2023-08-10T10:34:18.830946+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:34:18.830946+0000","last_undegraded":"2023-08-10T10:34:18.830946+0000","last_fullsized":"2023-08-10T10:34:18.830946+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:34:18.830848+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:34:18.830848+0000","last_clean_scrub_stamp":"2023-08-10T10:34:18.830848+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:57.170586+0000","scrub_duration":0.001692795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:05.280947+0000","last_change":"2023-08-10T10:34:05.281001+0000","last_active":"2023-08-10T10:34:05.280947+0000","last_peered":"2023-08-10T10:34:05.280947+0000","last_clean":"2023-08-10T10:34:05.280947+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:34:05.280947+0000","last_undegraded":"2023-08-10T10:34:05.280947+0000","last_fullsized":"2023-08-10T10:34:05.280947+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:34:05.280866+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:34:05.280866+0000","last_clean_scrub_stamp":"2023-08-10T10:34:05.280866+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:53.792635+0000","scrub_duration":0.002470163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.806229+0000","last_change":"2023-08-10T10:33:25.806268+0000","last_active":"2023-08-10T10:33:25.806229+0000","last_peered":"2023-08-10T10:33:25.806229+0000","last_clean":"2023-08-10T10:33:25.806229+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:25.806229+0000","last_undegraded":"2023-08-10T10:33:25.806229+0000","last_fullsized":"2023-08-10T10:33:25.806229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.806161+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:38.537991+0000","scrub_duration":0.0024102640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":111149056,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":1076224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222298112,"data_stored":222298112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14883,"ondisk_log_size":14883,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2150615,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":712,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4301230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":728,"ondisk_log_size":728,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76612,"kb_used_data":41404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94295228,"statfs":{"total":96636764160,"available":96558313472,"internally_reserved":0,"allocated":42397696,"data_stored":42188424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.0800000000000001,"15min":0.78000000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":6.7960000000000003,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":1.6759999999999999,"5min":1.1830000000000001,"15min":0.78300000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":8.4600000000000009,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.67400000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0920000000000001,"5min":1.085,"15min":0.76500000000000001},"min":{"1min":0.40000000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":17.917000000000002,"5min":17.917000000000002,"15min":17.917000000000002},"last":0.72699999999999998},{"interface":"front","average":{"1min":2.419,"5min":1.165,"15min":0.85299999999999998},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":12.194000000000001,"5min":12.194000000000001,"15min":12.194000000000001},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.9350000000000001,"5min":1.264,"15min":0.93000000000000005},"min":{"1min":0.53600000000000003,"5min":0.502,"15min":0.502},"max":{"1min":8.343,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.78600000000000003},{"interface":"front","average":{"1min":2.0209999999999999,"5min":1.321,"15min":0.91900000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":9.8279999999999994,"5min":22.148,"15min":22.148},"last":0.80800000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.02,"5min":1.1160000000000001,"15min":0.82299999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.2669999999999995,"5min":10.237,"15min":10.237},"last":0.66200000000000003},{"interface":"front","average":{"1min":2.1800000000000002,"5min":1.268,"15min":0.94199999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":9.1709999999999994,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.752}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":0.94499999999999995,"15min":0.76700000000000002},"min":{"1min":0.435,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":4.7560000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.0069999999999999,"15min":0.79500000000000004},"min":{"1min":0.37,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":4.2380000000000004,"5min":11.779,"15min":11.779},"last":0.49099999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.88300000000000001,"15min":0.81699999999999995},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.706,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.52700000000000002},{"interface":"front","average":{"1min":1.196,"5min":1.014,"15min":0.85899999999999999},"min":{"1min":0.50700000000000001,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":4.7880000000000003,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.77000000000000002}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.5289999999999999,"5min":1.0820000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.4290000000000003,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1850000000000001,"5min":0.94499999999999995,"15min":0.79300000000000004},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":4.7080000000000002,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.58399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574899,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":17616896,"data_stored":17435679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":1.3,"15min":0.91400000000000003},"min":{"1min":0.38,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":8.8369999999999997,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.774,"5min":1.3280000000000001,"15min":0.95299999999999996},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.911,"5min":11.911,"15min":11.911},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":1.5469999999999999,"15min":1.0069999999999999},"min":{"1min":0.44400000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":8.7080000000000002,"5min":14.93,"15min":14.93},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.5309999999999999,"5min":1.2849999999999999,"15min":0.92900000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":11.836,"5min":11.836,"15min":11.836},"last":0.85099999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":1.357,"15min":0.92300000000000004},"min":{"1min":0.42099999999999999,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":8.4510000000000005,"5min":19.654,"15min":19.654},"last":0.70199999999999996},{"interface":"front","average":{"1min":2.097,"5min":1.379,"15min":0.94499999999999995},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":8.7379999999999995,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.82599999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.6379999999999999,"5min":1.5800000000000001,"15min":1.038},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":16.934000000000001,"5min":16.934000000000001,"15min":16.934000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":1.103,"5min":1.4319999999999999,"15min":1},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":2.968,"5min":19.907,"15min":19.907},"last":0.80000000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0489999999999999,"5min":0.96499999999999997,"15min":0.754},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":5.984,"5min":5.984,"15min":5.984},"last":0.55100000000000005},{"interface":"front","average":{"1min":1.5329999999999999,"5min":1.0149999999999999,"15min":0.80900000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":11.94,"5min":11.94,"15min":11.94},"last":0.63900000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":0.98999999999999999,"5min":0.97699999999999998,"15min":0.78800000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":2.3780000000000001,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":1.0329999999999999,"5min":0.95999999999999996,"15min":0.81799999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":3.3490000000000002,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1,"15min":0.84199999999999997},"min":{"1min":0.58699999999999997,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.9569999999999999,"5min":5.577,"15min":5.577},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.1140000000000001,"15min":0.88},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":4.3239999999999998,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.89000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66748,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94305092,"statfs":{"total":96636764160,"available":96568414208,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":0.67700000000000005,"15min":0.50600000000000001},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":10.212999999999999,"5min":10.212999999999999,"15min":10.212999999999999},"last":0.373},{"interface":"front","average":{"1min":1.5609999999999999,"5min":0.73299999999999998,"15min":0.53700000000000003},"min":{"1min":0.314,"5min":0.308,"15min":0.308},"max":{"1min":6.46,"5min":6.46,"15min":6.46},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.3069999999999999,"5min":0.95799999999999996,"15min":0.622},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":13.24,"5min":13.24,"15min":13.24},"last":0.44400000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":0.79900000000000004,"15min":0.61699999999999999},"min":{"1min":0.433,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":5.0270000000000001,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":1.131,"5min":0.72399999999999998,"15min":0.59899999999999998},"min":{"1min":0.48499999999999999,"5min":0.438,"15min":0.438},"max":{"1min":5.0970000000000004,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.206,"5min":0.70699999999999996,"15min":0.56899999999999995},"min":{"1min":0.40999999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":8.4930000000000003,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":3.0649999999999999,"5min":1.3480000000000001,"15min":0.93200000000000005},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":11.635,"5min":11.635,"15min":11.635},"last":0.69199999999999995},{"interface":"front","average":{"1min":4.1369999999999996,"5min":1.516,"15min":1.0049999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":14.271000000000001,"5min":14.271000000000001,"15min":14.271000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.7320000000000002,"5min":1.288,"15min":0.91200000000000003},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":10.101000000000001,"5min":10.444000000000001,"15min":10.444000000000001},"last":0.60199999999999998},{"interface":"front","average":{"1min":4.3659999999999997,"5min":1.782,"15min":1.123},"min":{"1min":0.51600000000000001,"5min":0.505,"15min":0.505},"max":{"1min":17.66,"5min":21.681999999999999,"15min":21.681999999999999},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.0880000000000001,"5min":1.1699999999999999,"15min":0.92600000000000005},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":6.5410000000000004,"5min":10.516,"15min":10.516},"last":0.76500000000000001},{"interface":"front","average":{"1min":3.6080000000000001,"5min":1.5,"15min":1.046},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":14.295999999999999,"5min":14.295999999999999,"15min":14.295999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":1.135,"15min":0.92900000000000005},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":6,"5min":6,"15min":6},"last":0.78100000000000003},{"interface":"front","average":{"1min":4.3150000000000004,"5min":1.6839999999999999,"15min":1.0960000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":31.629999999999999,"5min":31.629999999999999,"15min":31.629999999999999},"last":0.65700000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574900,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62216,"kb_used_data":27008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94309624,"statfs":{"total":96636764160,"available":96573054976,"internally_reserved":0,"allocated":27656192,"data_stored":27470546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":0.84499999999999997,"15min":0.67100000000000004},"min":{"1min":0.23699999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":5.7590000000000003,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.314},{"interface":"front","average":{"1min":0.95499999999999996,"5min":0.89200000000000002,"15min":0.85799999999999998},"min":{"1min":0.35999999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.8530000000000002,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.0840000000000001,"5min":0.96499999999999997,"15min":0.66600000000000004},"min":{"1min":0.42299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":8.9179999999999993,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.46200000000000002},{"interface":"front","average":{"1min":1.018,"5min":0.98199999999999998,"15min":0.91000000000000003},"min":{"1min":0.42499999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":4.0890000000000004,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":1.232,"15min":0.89100000000000001},"min":{"1min":0.32200000000000001,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":19.68,"5min":19.68,"15min":19.68},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.681,"5min":1.0349999999999999,"15min":0.79600000000000004},"min":{"1min":0.44500000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":6.0579999999999998,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":4.3780000000000001,"5min":1.8560000000000001,"15min":1.4610000000000001},"min":{"1min":0.53800000000000003,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":44.292000000000002,"5min":44.292000000000002,"15min":44.292000000000002},"last":0.73999999999999999},{"interface":"front","average":{"1min":4.6150000000000002,"5min":1.8740000000000001,"15min":1.238},"min":{"1min":0.48499999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":49.887999999999998,"5min":49.887999999999998,"15min":49.887999999999998},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":9.3859999999999992,"5min":2.516,"15min":1.3109999999999999},"min":{"1min":0.58399999999999996,"5min":0.434,"15min":0.434},"max":{"1min":127.655,"5min":127.655,"15min":127.655},"last":0.66300000000000003},{"interface":"front","average":{"1min":5.2610000000000001,"5min":1.895,"15min":1.3540000000000001},"min":{"1min":0.59799999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":65.376000000000005,"5min":65.376000000000005,"15min":65.376000000000005},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":3.141,"5min":1.6000000000000001,"15min":1.1699999999999999},"min":{"1min":0.61299999999999999,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":16.510000000000002,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":2.6019999999999999,"5min":1.429,"15min":0.97499999999999998},"min":{"1min":0.59399999999999997,"5min":0.499,"15min":0.499},"max":{"1min":16.331,"5min":16.331,"15min":16.331},"last":0.70799999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:33:23 2023","interfaces":[{"interface":"back","average":{"1min":2.3039999999999998,"5min":1.4770000000000001,"15min":1.216},"min":{"1min":0.58199999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":8.9670000000000005,"5min":8.9670000000000005,"15min":8.9670000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":2.4399999999999999,"5min":1.5509999999999999,"15min":1.1879999999999999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":16.478000000000002,"5min":17.032,"15min":17.032},"last":0.79400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574900,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":28468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":29151232,"data_stored":28970015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.82299999999999995,"15min":0.59199999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70999999999999996,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.89500000000000002,"15min":0.59099999999999997},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66100000000000003,"5min":13.456,"15min":13.456},"last":0.57599999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":1.129,"15min":0.70899999999999996},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":15.066000000000001,"15min":15.066000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.879,"15min":0.65100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79200000000000004,"5min":9.2029999999999994,"15min":9.2029999999999994},"last":0.42099999999999999}]},{"osd":3,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.84499999999999997,"15min":0.63700000000000001},"min":{"1min":0.442,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":11.715,"15min":11.715},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.0149999999999999,"15min":0.73499999999999999},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.82599999999999996,"5min":15.997999999999999,"15min":15.997999999999999},"last":0.47499999999999998}]},{"osd":4,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.593,"15min":0.995},"min":{"1min":0.5,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.026,"5min":19.811,"15min":19.811},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.1910000000000001,"15min":0.872},"min":{"1min":0.57699999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96199999999999997,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.747}]},{"osd":5,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.4239999999999999,"15min":0.97599999999999998},"min":{"1min":0.56000000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":16.045000000000002,"15min":16.045000000000002},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.591,"15min":1.038},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":13.414999999999999,"15min":13.414999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.6339999999999999,"15min":1.042},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92200000000000004,"5min":20.692,"15min":20.692},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.5129999999999999,"15min":1.024},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":10.885999999999999,"15min":10.885999999999999},"last":0.91000000000000003}]},{"osd":7,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":1.4930000000000001,"15min":1.0349999999999999},"min":{"1min":0.629,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":13.516,"15min":13.516},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.417,"15min":0.98999999999999999},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.008,"5min":20.757999999999999,"15min":20.757999999999999},"last":0.88700000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574901,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55488,"kb_used_data":24376,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94316352,"statfs":{"total":96636764160,"available":96579944448,"internally_reserved":0,"allocated":24961024,"data_stored":24775801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":1.004,"15min":0.71799999999999997},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":24.925999999999998,"5min":24.925999999999998,"15min":24.925999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":2.1499999999999999,"5min":0.94199999999999995,"15min":0.67300000000000004},"min":{"1min":0.32300000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":19.779,"5min":19.779,"15min":19.779},"last":0.501}]},{"osd":1,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.756,"5min":0.94899999999999995,"15min":0.67500000000000004},"min":{"1min":0.34399999999999997,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":9.6259999999999994,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":1.6870000000000001,"5min":1.304,"15min":1.216},"min":{"1min":0.39400000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":9.4700000000000006,"5min":12.754,"15min":12.754},"last":0.40799999999999997}]},{"osd":2,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.0489999999999999,"15min":0.80100000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":6.0629999999999997,"5min":14.169,"15min":14.169},"last":0.58899999999999997},{"interface":"front","average":{"1min":1.9179999999999999,"5min":1.173,"15min":0.875},"min":{"1min":0.45800000000000002,"5min":0.377,"15min":0.377},"max":{"1min":14.156000000000001,"5min":16.927,"15min":16.927},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":3.3690000000000002,"5min":1.456,"15min":0.98599999999999999},"min":{"1min":0.47999999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":12.779999999999999,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.246,"5min":1.3180000000000001,"15min":0.92500000000000004},"min":{"1min":0.58199999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":14.225,"5min":14.225,"15min":14.225},"last":0.95199999999999996}]},{"osd":5,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.0369999999999999,"5min":1.1759999999999999,"15min":0.89500000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":5.976,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.90700000000000003},{"interface":"front","average":{"1min":3.048,"5min":1.542,"15min":1.0529999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":24.853999999999999,"5min":24.853999999999999,"15min":24.853999999999999},"last":0.82399999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":2.589,"5min":1.468,"15min":1.0249999999999999},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":10.403,"5min":16.919,"15min":16.919},"last":0.89600000000000002},{"interface":"front","average":{"1min":2.3300000000000001,"5min":1.365,"15min":0.98499999999999999},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":9.6880000000000006,"5min":12.504,"15min":12.504},"last":0.996}]},{"osd":7,"last update":"Thu Aug 10 10:33:26 2023","interfaces":[{"interface":"back","average":{"1min":1.917,"5min":1.1559999999999999,"15min":0.93400000000000005},"min":{"1min":0.56399999999999995,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":9.5090000000000003,"5min":9.5090000000000003,"15min":9.5090000000000003},"last":0.78900000000000003},{"interface":"front","average":{"1min":3.427,"5min":1.667,"15min":1.1040000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":19.911000000000001,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.92800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64768,"kb_used_data":29560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94307072,"statfs":{"total":96636764160,"available":96570441728,"internally_reserved":0,"allocated":30269440,"data_stored":30071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.1079999999999997,"5min":1.829,"15min":1.0600000000000001},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":69.530000000000001,"5min":69.530000000000001,"15min":69.530000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":2.8839999999999999,"5min":1.5109999999999999,"15min":1.0840000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":19.388000000000002,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.66900000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.6779999999999999,"5min":1.8380000000000001,"15min":1.147},"min":{"1min":0.42999999999999999,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":64.784999999999997,"5min":64.784999999999997,"15min":64.784999999999997},"last":0.625},{"interface":"front","average":{"1min":7.8789999999999996,"5min":2.6440000000000001,"15min":1.4630000000000001},"min":{"1min":0.435,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":120.05,"5min":120.05,"15min":120.05},"last":0.69599999999999995}]},{"osd":2,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":7.6840000000000002,"5min":2.4060000000000001,"15min":1.284},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":119.992,"5min":119.992,"15min":119.992},"last":0.64600000000000002},{"interface":"front","average":{"1min":3.0299999999999998,"5min":1.5880000000000001,"15min":1.214},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":30.984000000000002,"5min":30.984000000000002,"15min":30.984000000000002},"last":0.71199999999999997}]},{"osd":3,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":5.0759999999999996,"5min":1.8779999999999999,"15min":1.1479999999999999},"min":{"1min":0.443,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":64.823999999999998,"5min":64.823999999999998,"15min":64.823999999999998},"last":0.59099999999999997},{"interface":"front","average":{"1min":3.0600000000000001,"5min":1.417,"15min":1.0129999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":30.940000000000001,"5min":30.940000000000001,"15min":30.940000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":9.218,"5min":2.7400000000000002,"15min":1.504},"min":{"1min":0.39400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":165.98500000000001,"5min":165.98500000000001,"15min":165.98500000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":7.6159999999999997,"5min":2.21,"15min":1.278},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":125.369,"5min":125.369,"15min":125.369},"last":0.503}]},{"osd":6,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":6.5289999999999999,"5min":2.4590000000000001,"15min":1.7949999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":113.884,"5min":113.884,"15min":113.884},"last":0.46600000000000003},{"interface":"front","average":{"1min":7.1520000000000001,"5min":2.2280000000000002,"15min":1.2869999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":124.836,"5min":124.836,"15min":124.836},"last":0.60899999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:33:27 2023","interfaces":[{"interface":"back","average":{"1min":4.3120000000000003,"5min":1.6020000000000001,"15min":1.1220000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":67.281999999999996,"5min":67.281999999999996,"15min":67.281999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":7.125,"5min":2.1520000000000001,"15min":1.27},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":125.12,"5min":125.12,"15min":125.12},"last":0.53100000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574900,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60612,"kb_used_data":25404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94311228,"statfs":{"total":96636764160,"available":96574697472,"internally_reserved":0,"allocated":26013696,"data_stored":25824939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":4.2729999999999997,"5min":1.6970000000000001,"15min":1.2410000000000001},"min":{"1min":0.42199999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":15.749000000000001,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":2.4340000000000002,"5min":1.3720000000000001,"15min":1.133},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":12.596,"5min":12.596,"15min":12.596},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.8919999999999999,"5min":1.764,"15min":1.3680000000000001},"min":{"1min":0.47499999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":20.193999999999999,"5min":20.193999999999999,"15min":20.193999999999999},"last":0.84199999999999997},{"interface":"front","average":{"1min":3.552,"5min":1.6240000000000001,"15min":1.202},"min":{"1min":0.52200000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":15.708,"5min":15.708,"15min":15.708},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":3.1890000000000001,"5min":1.4470000000000001,"15min":1.1839999999999999},"min":{"1min":0.59099999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":10.949,"5min":10.949,"15min":10.949},"last":0.90700000000000003},{"interface":"front","average":{"1min":4.1619999999999999,"5min":1.5960000000000001,"15min":1.198},"min":{"1min":0.499,"5min":0.435,"15min":0.435},"max":{"1min":20.224,"5min":20.224,"15min":20.224},"last":0.76500000000000001}]},{"osd":3,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":1.242,"15min":1.1379999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":10.978,"5min":10.978,"15min":10.978},"last":0.78900000000000003},{"interface":"front","average":{"1min":5.1600000000000001,"5min":1.968,"15min":1.514},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":20.114999999999998,"5min":20.114999999999998,"15min":20.114999999999998},"last":0.89100000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.3250000000000002,"5min":0.97499999999999998,"15min":0.73099999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":15.784000000000001,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":1.5649999999999999,"5min":0.84499999999999997,"15min":0.70099999999999996},"min":{"1min":0.45200000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":11.006,"5min":11.006,"15min":11.006},"last":0.70799999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":2.0219999999999998,"5min":0.92800000000000005,"15min":0.73199999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":9.9979999999999993,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.63800000000000001},{"interface":"front","average":{"1min":2.3149999999999999,"5min":1.0109999999999999,"15min":0.78900000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":15.815,"5min":15.815,"15min":15.815},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Aug 10 10:33:24 2023","interfaces":[{"interface":"back","average":{"1min":1.788,"5min":1.012,"15min":0.82199999999999995},"min":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":11.037000000000001,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.875},{"interface":"front","average":{"1min":3.456,"5min":1.3120000000000001,"15min":0.94599999999999995},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":20.161000000000001,"5min":20.161000000000001,"15min":20.161000000000001},"last":0.93700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2149873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2142281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26738688,"data_stored":26738688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28835840,"data_stored":28835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24641536,"data_stored":24641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27787264,"data_stored":27787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25690112,"data_stored":25690112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17301504,"data_stored":17301504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":39321600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:34:31.216 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.217 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.217 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.218 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.218 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.218 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.219 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.219 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.220 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.221 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.221 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.222 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.223 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.224 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2023-08-10T10:30:37.348126+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=37, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.224 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-08-10T10:30:33.293344+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=30, tm_sec=33, tm_wday=3, tm_yday=222, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=10, tm_hour=10, tm_min=33, tm_sec=22, tm_wday=3, tm_yday=222, tm_isdst=0) 2023-08-10T10:34:31.225 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-10T10:34:51.226 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-10T10:34:51.481 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.481+0000 7f6ded7ff700 1 Processor -- start 2023-08-10T10:34:51.482 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.481+0000 7f6ded7ff700 1 -- start start 2023-08-10T10:34:51.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6de80afd50 0x7f6de80b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de815e740 0x7f6de80cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6de815eba0 0x7f6de80cf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.483 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de806c2d0 con 0x7f6de80afd50 2023-08-10T10:34:51.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de806c5b0 con 0x7f6de815eba0 2023-08-10T10:34:51.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6ded7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de806c890 con 0x7f6de815e740 2023-08-10T10:34:51.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6de6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6de80afd50 0x7f6de80b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.484 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6de6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6de80afd50 0x7f6de80b0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53678/0 (socket says 172.21.15.88:53678) 2023-08-10T10:34:51.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.482+0000 7f6de6ffd700 1 -- 172.21.15.88:0/3682235320 learned_addr learned my addr 172.21.15.88:0/3682235320 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:51.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de67fc700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de815e740 0x7f6de80cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.485 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de77fe700 1 --2- 172.21.15.88:0/3682235320 >> v2:172.21.15.187:3300/0 conn(0x7f6de815eba0 0x7f6de80cf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 -- 172.21.15.88:0/3682235320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de815e740 msgr2=0x7f6de80cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:51.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de815e740 0x7f6de80cf020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 -- 172.21.15.88:0/3682235320 >> v2:172.21.15.187:3300/0 conn(0x7f6de815eba0 msgr2=0x7f6de80cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:51.487 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/3682235320 >> v2:172.21.15.187:3300/0 conn(0x7f6de815eba0 0x7f6de80cf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 -- 172.21.15.88:0/3682235320 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de806cb70 con 0x7f6de80afd50 2023-08-10T10:34:51.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de80afd50 0x7f6de80b0130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6de80701a0 tx=0x7f6dd8009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f0bde4e6c57b9e server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de5ffb700 1 -- 172.21.15.88:0/3682235320 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8011830 con 0x7f6de80afd50 2023-08-10T10:34:51.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de5ffb700 1 -- 172.21.15.88:0/3682235320 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd8011990 con 0x7f6de80afd50 2023-08-10T10:34:51.488 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.483+0000 7f6de5ffb700 1 -- 172.21.15.88:0/3682235320 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd8011d20 con 0x7f6de80afd50 2023-08-10T10:34:51.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 -- 172.21.15.88:0/3682235320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de80afd50 msgr2=0x7f6de80b0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de80afd50 0x7f6de80b0130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6de80701a0 tx=0x7f6dd8009bd0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 -- 172.21.15.88:0/3682235320 shutdown_connections 2023-08-10T10:34:51.489 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/3682235320 >> v2:172.21.15.187:3300/0 conn(0x7f6de815eba0 0x7f6de80cf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de80afd50 0x7f6de80b0130 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/3682235320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de815e740 0x7f6de80cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 -- 172.21.15.88:0/3682235320 >> 172.21.15.88:0/3682235320 conn(0x7f6de806f200 msgr2=0x7f6de806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:51.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 -- 172.21.15.88:0/3682235320 shutdown_connections 2023-08-10T10:34:51.490 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.484+0000 7f6ded7ff700 1 -- 172.21.15.88:0/3682235320 wait complete. 2023-08-10T10:34:51.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.486+0000 7f6ded7ff700 1 Processor -- start 2023-08-10T10:34:51.491 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.486+0000 7f6ded7ff700 1 -- start start 2023-08-10T10:34:51.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 0x7f6de81569e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6de815e740 0x7f6de80b5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.493 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80b5740 con 0x7f6de815eba0 2023-08-10T10:34:51.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80b3a30 con 0x7f6de815e740 2023-08-10T10:34:51.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6ded7ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de80b6840 con 0x7f6de80afd50 2023-08-10T10:34:51.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.494 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6de77fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53680/0 (socket says 172.21.15.88:53680) 2023-08-10T10:34:51.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.487+0000 7f6de77fe700 1 -- 172.21.15.88:0/642671885 learned_addr learned my addr 172.21.15.88:0/642671885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:51.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 0x7f6de81569e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de67fc700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6de815e740 0x7f6de80b5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.495 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 -- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 msgr2=0x7f6de81569e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 0x7f6de81569e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 -- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6de815e740 msgr2=0x7f6de80b5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6de815e740 0x7f6de80b5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.496 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 -- 172.21.15.88:0/642671885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8009550 con 0x7f6de815eba0 2023-08-10T10:34:51.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 0x7f6de81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:51.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6de77fe700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009fd0 tx=0x7f6de000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de000ede0 con 0x7f6de815eba0 2023-08-10T10:34:51.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de0014420 con 0x7f6de815eba0 2023-08-10T10:34:51.497 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de80b3cd0 con 0x7f6de815eba0 2023-08-10T10:34:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de00147d0 con 0x7f6de815eba0 2023-08-10T10:34:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.488+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de80b4290 con 0x7f6de815eba0 2023-08-10T10:34:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.489+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de80b4480 con 0x7f6de815eba0 2023-08-10T10:34:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.490+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6de0014930 con 0x7f6de815eba0 2023-08-10T10:34:51.498 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.491+0000 7f6dcf7fe700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.491+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f6de0089f40 con 0x7f6de815eba0 2023-08-10T10:34:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.491+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.499 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.492+0000 7f6de6ffd700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 0x7f6dd406d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009c10 tx=0x7f6dd8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.500 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.496+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6de0054c20 con 0x7f6de815eba0 2023-08-10T10:34:51.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.689+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 --> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6de804ecc0 con 0x7f6dd406ace0 2023-08-10T10:34:51.701 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.700+0000 7f6dcf7fe700 1 -- 172.21.15.88:0/642671885 <== mgr.4104 v2:172.21.15.88:6832/1444548676 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+394648 (secure 0 0 0) 0x7f6de804ecc0 con 0x7f6dd406ace0 2023-08-10T10:34:51.706 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 msgr2=0x7f6dd406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.708 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 0x7f6dd406d1a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009c10 tx=0x7f6dd8008030 comp rx=0 tx=0).stop 2023-08-10T10:34:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 msgr2=0x7f6de80b61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f6de0009fd0 tx=0x7f6de000e3c0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 shutdown_connections 2023-08-10T10:34:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6de815eba0 0x7f6de80b61c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.709 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6dd406ace0 0x7f6dd406d1a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6de80afd50 0x7f6de81569e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 --2- 172.21.15.88:0/642671885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6de815e740 0x7f6de80b5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 >> 172.21.15.88:0/642671885 conn(0x7f6de806f200 msgr2=0x7f6de815a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 shutdown_connections 2023-08-10T10:34:51.710 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.705+0000 7f6ded7ff700 1 -- 172.21.15.88:0/642671885 wait complete. 2023-08-10T10:34:51.711 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2023-08-10T10:34:51.724 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-08-10T10:34:51.627989+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":113890039,"num_objects":53,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":131,"num_read_kb":118,"num_write":1382,"num_write_kb":1081239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17778,"ondisk_log_size":17778,"up":338,"acting":338,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":338,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":494340,"kb_used_data":224964,"kb_used_omap":13,"kb_used_meta":269298,"kb_avail":754480380,"statfs":{"total":773094113280,"available":772587909120,"internally_reserved":0,"allocated":230363136,"data_stored":228852459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":275761240},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003562"},"pg_stats":[{"pgid":"4.3f","version":"29'26","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.883077+0000","last_change":"2023-08-10T10:33:36.883077+0000","last_active":"2023-08-10T10:33:36.883077+0000","last_peered":"2023-08-10T10:33:36.883077+0000","last_clean":"2023-08-10T10:33:36.883077+0000","last_became_active":"2023-08-10T10:30:34.335829+0000","last_became_peered":"2023-08-10T10:30:34.335829+0000","last_unstale":"2023-08-10T10:33:36.883077+0000","last_undegraded":"2023-08-10T10:33:36.883077+0000","last_fullsized":"2023-08-10T10:33:36.883077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:36.882946+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.882946+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:44:55.798064+0000","scrub_duration":0.001698803,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"29'26","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:04.989246+0000","last_change":"2023-08-10T10:34:04.989246+0000","last_active":"2023-08-10T10:34:04.989246+0000","last_peered":"2023-08-10T10:34:04.989246+0000","last_clean":"2023-08-10T10:34:04.989246+0000","last_became_active":"2023-08-10T10:30:34.339051+0000","last_became_peered":"2023-08-10T10:30:34.339051+0000","last_unstale":"2023-08-10T10:34:04.989246+0000","last_undegraded":"2023-08-10T10:34:04.989246+0000","last_fullsized":"2023-08-10T10:34:04.989246+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:34:04.989056+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:34:04.989056+0000","last_clean_scrub_stamp":"2023-08-10T10:34:04.989056+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:28.358652+0000","scrub_duration":0.0021473880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"29'42","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:20.821386+0000","last_change":"2023-08-10T10:34:20.821386+0000","last_active":"2023-08-10T10:34:20.821386+0000","last_peered":"2023-08-10T10:34:20.821386+0000","last_clean":"2023-08-10T10:34:20.821386+0000","last_became_active":"2023-08-10T10:30:34.335520+0000","last_became_peered":"2023-08-10T10:30:34.335520+0000","last_unstale":"2023-08-10T10:34:20.821386+0000","last_undegraded":"2023-08-10T10:34:20.821386+0000","last_fullsized":"2023-08-10T10:34:20.821386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:34:20.821240+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:34:20.821240+0000","last_clean_scrub_stamp":"2023-08-10T10:34:20.821240+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:09.207057+0000","scrub_duration":0.0023435299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"29'24","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.739357+0000","last_change":"2023-08-10T10:33:59.739357+0000","last_active":"2023-08-10T10:33:59.739357+0000","last_peered":"2023-08-10T10:33:59.739357+0000","last_clean":"2023-08-10T10:33:59.739357+0000","last_became_active":"2023-08-10T10:30:34.345308+0000","last_became_peered":"2023-08-10T10:30:34.345308+0000","last_unstale":"2023-08-10T10:33:59.739357+0000","last_undegraded":"2023-08-10T10:33:59.739357+0000","last_fullsized":"2023-08-10T10:33:59.739357+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:59.739228+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.739228+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:25:24.684820+0000","scrub_duration":0.0021901009999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.899724+0000","last_change":"2023-08-10T10:33:25.899769+0000","last_active":"2023-08-10T10:33:25.899724+0000","last_peered":"2023-08-10T10:33:25.899724+0000","last_clean":"2023-08-10T10:33:25.899724+0000","last_became_active":"2023-08-10T10:30:34.338114+0000","last_became_peered":"2023-08-10T10:30:34.338114+0000","last_unstale":"2023-08-10T10:33:25.899724+0000","last_undegraded":"2023-08-10T10:33:25.899724+0000","last_fullsized":"2023-08-10T10:33:25.899724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:25.899655+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.899655+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:55.048352+0000","scrub_duration":0.001506755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"29'38","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:27.916755+0000","last_change":"2023-08-10T10:34:27.916811+0000","last_active":"2023-08-10T10:34:27.916755+0000","last_peered":"2023-08-10T10:34:27.916755+0000","last_clean":"2023-08-10T10:34:27.916755+0000","last_became_active":"2023-08-10T10:30:34.332570+0000","last_became_peered":"2023-08-10T10:30:34.332570+0000","last_unstale":"2023-08-10T10:34:27.916755+0000","last_undegraded":"2023-08-10T10:34:27.916755+0000","last_fullsized":"2023-08-10T10:34:27.916755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-08-10T10:34:27.916644+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-08-10T10:34:27.916644+0000","last_clean_scrub_stamp":"2023-08-10T10:34:27.916644+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:57.875682+0000","scrub_duration":0.002410274,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.235707+0000","last_change":"2023-08-10T10:33:59.235761+0000","last_active":"2023-08-10T10:33:59.235707+0000","last_peered":"2023-08-10T10:33:59.235707+0000","last_clean":"2023-08-10T10:33:59.235707+0000","last_became_active":"2023-08-10T10:30:34.329737+0000","last_became_peered":"2023-08-10T10:30:34.329737+0000","last_unstale":"2023-08-10T10:33:59.235707+0000","last_undegraded":"2023-08-10T10:33:59.235707+0000","last_fullsized":"2023-08-10T10:33:59.235707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:59.235628+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.235628+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:24.883888+0000","scrub_duration":0.0021164880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:15.935614+0000","last_change":"2023-08-10T10:34:15.935667+0000","last_active":"2023-08-10T10:34:15.935614+0000","last_peered":"2023-08-10T10:34:15.935614+0000","last_clean":"2023-08-10T10:34:15.935614+0000","last_became_active":"2023-08-10T10:30:34.339182+0000","last_became_peered":"2023-08-10T10:30:34.339182+0000","last_unstale":"2023-08-10T10:34:15.935614+0000","last_undegraded":"2023-08-10T10:34:15.935614+0000","last_fullsized":"2023-08-10T10:34:15.935614+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:34:15.935514+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:34:15.935514+0000","last_clean_scrub_stamp":"2023-08-10T10:34:15.935514+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:26.954665+0000","scrub_duration":0.001619229,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"29'37","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:12.206826+0000","last_change":"2023-08-10T10:34:12.206885+0000","last_active":"2023-08-10T10:34:12.206826+0000","last_peered":"2023-08-10T10:34:12.206826+0000","last_clean":"2023-08-10T10:34:12.206826+0000","last_became_active":"2023-08-10T10:31:15.301140+0000","last_became_peered":"2023-08-10T10:31:15.301140+0000","last_unstale":"2023-08-10T10:34:12.206826+0000","last_undegraded":"2023-08-10T10:34:12.206826+0000","last_fullsized":"2023-08-10T10:34:12.206826+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-08-10T10:34:12.206749+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-08-10T10:34:12.206749+0000","last_clean_scrub_stamp":"2023-08-10T10:34:12.206749+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:00.718518+0000","scrub_duration":0.0015892370000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"29'44","reported_seq":77,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.066157+0000","last_change":"2023-08-10T10:33:30.066237+0000","last_active":"2023-08-10T10:33:30.066157+0000","last_peered":"2023-08-10T10:33:30.066157+0000","last_clean":"2023-08-10T10:33:30.066157+0000","last_became_active":"2023-08-10T10:30:34.338690+0000","last_became_peered":"2023-08-10T10:30:34.338690+0000","last_unstale":"2023-08-10T10:33:30.066157+0000","last_undegraded":"2023-08-10T10:33:30.066157+0000","last_fullsized":"2023-08-10T10:33:30.066157+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'44","last_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_deep_scrub":"29'44","last_deep_scrub_stamp":"2023-08-10T10:33:30.066062+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.066062+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:45:46.020476+0000","scrub_duration":0.0021977630000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"29'25","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.517329+0000","last_change":"2023-08-10T10:33:33.517379+0000","last_active":"2023-08-10T10:33:33.517329+0000","last_peered":"2023-08-10T10:33:33.517329+0000","last_clean":"2023-08-10T10:33:33.517329+0000","last_became_active":"2023-08-10T10:30:34.336594+0000","last_became_peered":"2023-08-10T10:30:34.336594+0000","last_unstale":"2023-08-10T10:33:33.517329+0000","last_undegraded":"2023-08-10T10:33:33.517329+0000","last_fullsized":"2023-08-10T10:33:33.517329+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'25","last_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_deep_scrub":"29'25","last_deep_scrub_stamp":"2023-08-10T10:33:33.517247+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.517247+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:41.342304+0000","scrub_duration":0.002340221,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.902165+0000","last_change":"2023-08-10T10:33:35.902217+0000","last_active":"2023-08-10T10:33:35.902165+0000","last_peered":"2023-08-10T10:33:35.902165+0000","last_clean":"2023-08-10T10:33:35.902165+0000","last_became_active":"2023-08-10T10:30:34.329199+0000","last_became_peered":"2023-08-10T10:30:34.329199+0000","last_unstale":"2023-08-10T10:33:35.902165+0000","last_undegraded":"2023-08-10T10:33:35.902165+0000","last_fullsized":"2023-08-10T10:33:35.902165+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:35.902089+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.902089+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:14:01.877768+0000","scrub_duration":0.0023654119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.879384+0000","last_change":"2023-08-10T10:33:31.879433+0000","last_active":"2023-08-10T10:33:31.879384+0000","last_peered":"2023-08-10T10:33:31.879384+0000","last_clean":"2023-08-10T10:33:31.879384+0000","last_became_active":"2023-08-10T10:30:34.333397+0000","last_became_peered":"2023-08-10T10:30:34.333397+0000","last_unstale":"2023-08-10T10:33:31.879384+0000","last_undegraded":"2023-08-10T10:33:31.879384+0000","last_fullsized":"2023-08-10T10:33:31.879384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:31.879295+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.879295+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:25:47.686858+0000","scrub_duration":0.001582806,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.929484+0000","last_change":"2023-08-10T10:33:36.929535+0000","last_active":"2023-08-10T10:33:36.929484+0000","last_peered":"2023-08-10T10:33:36.929484+0000","last_clean":"2023-08-10T10:33:36.929484+0000","last_became_active":"2023-08-10T10:30:34.341386+0000","last_became_peered":"2023-08-10T10:30:34.341386+0000","last_unstale":"2023-08-10T10:33:36.929484+0000","last_undegraded":"2023-08-10T10:33:36.929484+0000","last_fullsized":"2023-08-10T10:33:36.929484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:36.929396+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.929396+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:24.773523+0000","scrub_duration":0.0025361160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.229130+0000","last_change":"2023-08-10T10:34:00.229186+0000","last_active":"2023-08-10T10:34:00.229130+0000","last_peered":"2023-08-10T10:34:00.229130+0000","last_clean":"2023-08-10T10:34:00.229130+0000","last_became_active":"2023-08-10T10:30:34.328824+0000","last_became_peered":"2023-08-10T10:30:34.328824+0000","last_unstale":"2023-08-10T10:34:00.229130+0000","last_undegraded":"2023-08-10T10:34:00.229130+0000","last_fullsized":"2023-08-10T10:34:00.229130+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:00.229006+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.229006+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:23.598603+0000","scrub_duration":0.002074916,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"29'38","reported_seq":71,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:06.662391+0000","last_change":"2023-08-10T10:34:06.662447+0000","last_active":"2023-08-10T10:34:06.662391+0000","last_peered":"2023-08-10T10:34:06.662391+0000","last_clean":"2023-08-10T10:34:06.662391+0000","last_became_active":"2023-08-10T10:30:34.334654+0000","last_became_peered":"2023-08-10T10:30:34.334654+0000","last_unstale":"2023-08-10T10:34:06.662391+0000","last_undegraded":"2023-08-10T10:34:06.662391+0000","last_fullsized":"2023-08-10T10:34:06.662391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'38","last_scrub_stamp":"2023-08-10T10:34:06.662309+0000","last_deep_scrub":"29'38","last_deep_scrub_stamp":"2023-08-10T10:34:06.662309+0000","last_clean_scrub_stamp":"2023-08-10T10:34:06.662309+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:48:48.780773+0000","scrub_duration":0.0020288139999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"29'36","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.107239+0000","last_change":"2023-08-10T10:34:02.107288+0000","last_active":"2023-08-10T10:34:02.107239+0000","last_peered":"2023-08-10T10:34:02.107239+0000","last_clean":"2023-08-10T10:34:02.107239+0000","last_became_active":"2023-08-10T10:30:34.341260+0000","last_became_peered":"2023-08-10T10:30:34.341260+0000","last_unstale":"2023-08-10T10:34:02.107239+0000","last_undegraded":"2023-08-10T10:34:02.107239+0000","last_fullsized":"2023-08-10T10:34:02.107239+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-08-10T10:34:02.107165+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.107165+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:27.755425+0000","scrub_duration":0.0016039889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.585707+0000","last_change":"2023-08-10T10:33:27.585762+0000","last_active":"2023-08-10T10:33:27.585707+0000","last_peered":"2023-08-10T10:33:27.585707+0000","last_clean":"2023-08-10T10:33:27.585707+0000","last_became_active":"2023-08-10T10:30:34.334998+0000","last_became_peered":"2023-08-10T10:30:34.334998+0000","last_unstale":"2023-08-10T10:33:27.585707+0000","last_undegraded":"2023-08-10T10:33:27.585707+0000","last_fullsized":"2023-08-10T10:33:27.585707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:27.585622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.585622+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:18.903219+0000","scrub_duration":0.0017968820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.813816+0000","last_change":"2023-08-10T10:33:39.813869+0000","last_active":"2023-08-10T10:33:39.813816+0000","last_peered":"2023-08-10T10:33:39.813816+0000","last_clean":"2023-08-10T10:33:39.813816+0000","last_became_active":"2023-08-10T10:30:34.338434+0000","last_became_peered":"2023-08-10T10:30:34.338434+0000","last_unstale":"2023-08-10T10:33:39.813816+0000","last_undegraded":"2023-08-10T10:33:39.813816+0000","last_fullsized":"2023-08-10T10:33:39.813816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:39.813733+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.813733+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:53:37.309818+0000","scrub_duration":0.0023901679999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"29'34","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.581199+0000","last_change":"2023-08-10T10:33:31.581251+0000","last_active":"2023-08-10T10:33:31.581199+0000","last_peered":"2023-08-10T10:33:31.581199+0000","last_clean":"2023-08-10T10:33:31.581199+0000","last_became_active":"2023-08-10T10:30:34.352461+0000","last_became_peered":"2023-08-10T10:30:34.352461+0000","last_unstale":"2023-08-10T10:33:31.581199+0000","last_undegraded":"2023-08-10T10:33:31.581199+0000","last_fullsized":"2023-08-10T10:33:31.581199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:31.581116+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.581116+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:27.046813+0000","scrub_duration":0.0015992249999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"29'41","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:09.203092+0000","last_change":"2023-08-10T10:34:09.203148+0000","last_active":"2023-08-10T10:34:09.203092+0000","last_peered":"2023-08-10T10:34:09.203092+0000","last_clean":"2023-08-10T10:34:09.203092+0000","last_became_active":"2023-08-10T10:30:34.337765+0000","last_became_peered":"2023-08-10T10:30:34.337765+0000","last_unstale":"2023-08-10T10:34:09.203092+0000","last_undegraded":"2023-08-10T10:34:09.203092+0000","last_fullsized":"2023-08-10T10:34:09.203092+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-08-10T10:34:09.203007+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-08-10T10:34:09.203007+0000","last_clean_scrub_stamp":"2023-08-10T10:34:09.203007+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:57.714776+0000","scrub_duration":0.0023523020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:39.940798+0000","last_change":"2023-08-10T10:33:39.940853+0000","last_active":"2023-08-10T10:33:39.940798+0000","last_peered":"2023-08-10T10:33:39.940798+0000","last_clean":"2023-08-10T10:33:39.940798+0000","last_became_active":"2023-08-10T10:30:34.335582+0000","last_became_peered":"2023-08-10T10:30:34.335582+0000","last_unstale":"2023-08-10T10:33:39.940798+0000","last_undegraded":"2023-08-10T10:33:39.940798+0000","last_fullsized":"2023-08-10T10:33:39.940798+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:33:39.940687+0000","last_clean_scrub_stamp":"2023-08-10T10:33:39.940687+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:46.721896+0000","scrub_duration":0.00155013,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"29'35","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:31.161482+0000","last_change":"2023-08-10T10:33:31.161534+0000","last_active":"2023-08-10T10:33:31.161482+0000","last_peered":"2023-08-10T10:33:31.161482+0000","last_clean":"2023-08-10T10:33:31.161482+0000","last_became_active":"2023-08-10T10:30:34.333943+0000","last_became_peered":"2023-08-10T10:30:34.333943+0000","last_unstale":"2023-08-10T10:33:31.161482+0000","last_undegraded":"2023-08-10T10:33:31.161482+0000","last_fullsized":"2023-08-10T10:33:31.161482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'35","last_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_deep_scrub":"29'35","last_deep_scrub_stamp":"2023-08-10T10:33:31.161398+0000","last_clean_scrub_stamp":"2023-08-10T10:33:31.161398+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:36.341462+0000","scrub_duration":0.0014948749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:12.223270+0000","last_change":"2023-08-10T10:34:12.223348+0000","last_active":"2023-08-10T10:34:12.223270+0000","last_peered":"2023-08-10T10:34:12.223270+0000","last_clean":"2023-08-10T10:34:12.223270+0000","last_became_active":"2023-08-10T10:30:34.336221+0000","last_became_peered":"2023-08-10T10:30:34.336221+0000","last_unstale":"2023-08-10T10:34:12.223270+0000","last_undegraded":"2023-08-10T10:34:12.223270+0000","last_fullsized":"2023-08-10T10:34:12.223270+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:34:12.223186+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:34:12.223186+0000","last_clean_scrub_stamp":"2023-08-10T10:34:12.223186+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:23.242336+0000","scrub_duration":0.001906004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.648876+0000","last_change":"2023-08-10T10:33:51.648966+0000","last_active":"2023-08-10T10:33:51.648876+0000","last_peered":"2023-08-10T10:33:51.648876+0000","last_clean":"2023-08-10T10:33:51.648876+0000","last_became_active":"2023-08-10T10:30:34.349780+0000","last_became_peered":"2023-08-10T10:30:34.349780+0000","last_unstale":"2023-08-10T10:33:51.648876+0000","last_undegraded":"2023-08-10T10:33:51.648876+0000","last_fullsized":"2023-08-10T10:33:51.648876+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:51.648764+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.648764+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:35.551430+0000","scrub_duration":0.0021019300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"29'37","reported_seq":70,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.711548+0000","last_change":"2023-08-10T10:33:45.711619+0000","last_active":"2023-08-10T10:33:45.711548+0000","last_peered":"2023-08-10T10:33:45.711548+0000","last_clean":"2023-08-10T10:33:45.711548+0000","last_became_active":"2023-08-10T10:30:34.336493+0000","last_became_peered":"2023-08-10T10:30:34.336493+0000","last_unstale":"2023-08-10T10:33:45.711548+0000","last_undegraded":"2023-08-10T10:33:45.711548+0000","last_fullsized":"2023-08-10T10:33:45.711548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'37","last_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_deep_scrub":"29'37","last_deep_scrub_stamp":"2023-08-10T10:33:45.711454+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.711454+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:52.492664+0000","scrub_duration":0.0016896599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.042561+0000","last_change":"2023-08-10T10:33:29.042633+0000","last_active":"2023-08-10T10:33:29.042561+0000","last_peered":"2023-08-10T10:33:29.042561+0000","last_clean":"2023-08-10T10:33:29.042561+0000","last_became_active":"2023-08-10T10:30:34.341403+0000","last_became_peered":"2023-08-10T10:30:34.341403+0000","last_unstale":"2023-08-10T10:33:29.042561+0000","last_undegraded":"2023-08-10T10:33:29.042561+0000","last_fullsized":"2023-08-10T10:33:29.042561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:33:29.042483+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.042483+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:19.511552+0000","scrub_duration":0.001545306,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1c","version":"29'444","reported_seq":471,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:35.843747+0000","last_change":"2023-08-10T10:34:35.843874+0000","last_active":"2023-08-10T10:34:35.843747+0000","last_peered":"2023-08-10T10:34:35.843747+0000","last_clean":"2023-08-10T10:34:35.843747+0000","last_became_active":"2023-08-10T10:30:38.404573+0000","last_became_peered":"2023-08-10T10:30:38.404573+0000","last_unstale":"2023-08-10T10:34:35.843747+0000","last_undegraded":"2023-08-10T10:34:35.843747+0000","last_fullsized":"2023-08-10T10:34:35.843747+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'444","last_scrub_stamp":"2023-08-10T10:34:35.843657+0000","last_deep_scrub":"29'444","last_deep_scrub_stamp":"2023-08-10T10:34:35.843657+0000","last_clean_scrub_stamp":"2023-08-10T10:34:35.843657+0000","objects_scrubbed":1,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:01:54.277832+0000","scrub_duration":0.0075250630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2,0],"acting":[4,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.623062+0000","last_change":"2023-08-10T10:34:02.623115+0000","last_active":"2023-08-10T10:34:02.623062+0000","last_peered":"2023-08-10T10:34:02.623062+0000","last_clean":"2023-08-10T10:34:02.623062+0000","last_became_active":"2023-08-10T10:30:33.321062+0000","last_became_peered":"2023-08-10T10:30:33.321062+0000","last_unstale":"2023-08-10T10:34:02.623062+0000","last_undegraded":"2023-08-10T10:34:02.623062+0000","last_fullsized":"2023-08-10T10:34:02.623062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:34:02.622978+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.622978+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:44.380373+0000","scrub_duration":0.001989092,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"29'39","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:16.445164+0000","last_change":"2023-08-10T10:34:16.445241+0000","last_active":"2023-08-10T10:34:16.445164+0000","last_peered":"2023-08-10T10:34:16.445164+0000","last_clean":"2023-08-10T10:34:16.445164+0000","last_became_active":"2023-08-10T10:30:34.335544+0000","last_became_peered":"2023-08-10T10:30:34.335544+0000","last_unstale":"2023-08-10T10:34:16.445164+0000","last_undegraded":"2023-08-10T10:34:16.445164+0000","last_fullsized":"2023-08-10T10:34:16.445164+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-08-10T10:34:16.445061+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-08-10T10:34:16.445061+0000","last_clean_scrub_stamp":"2023-08-10T10:34:16.445061+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:08:58.202456+0000","scrub_duration":0.00167884,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"29'473","reported_seq":501,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:02.679172+0000","last_change":"2023-08-10T10:34:02.679172+0000","last_active":"2023-08-10T10:34:02.679172+0000","last_peered":"2023-08-10T10:34:02.679172+0000","last_clean":"2023-08-10T10:34:02.679172+0000","last_became_active":"2023-08-10T10:30:38.403439+0000","last_became_peered":"2023-08-10T10:30:38.403439+0000","last_unstale":"2023-08-10T10:34:02.679172+0000","last_undegraded":"2023-08-10T10:34:02.679172+0000","last_fullsized":"2023-08-10T10:34:02.679172+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:34:02.679000+0000","last_clean_scrub_stamp":"2023-08-10T10:34:02.679000+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:46.106964+0000","scrub_duration":0.0058418979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,3,7],"acting":[6,4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.715152+0000","last_change":"2023-08-10T10:33:33.715201+0000","last_active":"2023-08-10T10:33:33.715152+0000","last_peered":"2023-08-10T10:33:33.715152+0000","last_clean":"2023-08-10T10:33:33.715152+0000","last_became_active":"2023-08-10T10:30:33.321280+0000","last_became_peered":"2023-08-10T10:30:33.321280+0000","last_unstale":"2023-08-10T10:33:33.715152+0000","last_undegraded":"2023-08-10T10:33:33.715152+0000","last_fullsized":"2023-08-10T10:33:33.715152+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:33.715068+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.715068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:04.044108+0000","scrub_duration":0.0015745259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"29'31","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.054296+0000","last_change":"2023-08-10T10:33:48.054296+0000","last_active":"2023-08-10T10:33:48.054296+0000","last_peered":"2023-08-10T10:33:48.054296+0000","last_clean":"2023-08-10T10:33:48.054296+0000","last_became_active":"2023-08-10T10:30:34.331157+0000","last_became_peered":"2023-08-10T10:30:34.331157+0000","last_unstale":"2023-08-10T10:33:48.054296+0000","last_undegraded":"2023-08-10T10:33:48.054296+0000","last_fullsized":"2023-08-10T10:33:48.054296+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:48.054163+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.054163+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:31.956829+0000","scrub_duration":0.0021941999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1e","version":"29'477","reported_seq":505,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:18.301365+0000","last_change":"2023-08-10T10:34:18.301365+0000","last_active":"2023-08-10T10:34:18.301365+0000","last_peered":"2023-08-10T10:34:18.301365+0000","last_clean":"2023-08-10T10:34:18.301365+0000","last_became_active":"2023-08-10T10:30:38.387728+0000","last_became_peered":"2023-08-10T10:30:38.387728+0000","last_unstale":"2023-08-10T10:34:18.301365+0000","last_undegraded":"2023-08-10T10:34:18.301365+0000","last_fullsized":"2023-08-10T10:34:18.301365+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'477","last_scrub_stamp":"2023-08-10T10:34:18.301120+0000","last_deep_scrub":"29'477","last_deep_scrub_stamp":"2023-08-10T10:34:18.301120+0000","last_clean_scrub_stamp":"2023-08-10T10:34:18.301120+0000","objects_scrubbed":2,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:46.240254+0000","scrub_duration":0.012152744,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,1,2],"acting":[0,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:56.307143+0000","last_change":"2023-08-10T10:33:56.307192+0000","last_active":"2023-08-10T10:33:56.307143+0000","last_peered":"2023-08-10T10:33:56.307143+0000","last_clean":"2023-08-10T10:33:56.307143+0000","last_became_active":"2023-08-10T10:30:33.317864+0000","last_became_peered":"2023-08-10T10:30:33.317864+0000","last_unstale":"2023-08-10T10:33:56.307143+0000","last_undegraded":"2023-08-10T10:33:56.307143+0000","last_fullsized":"2023-08-10T10:33:56.307143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:56.307064+0000","last_clean_scrub_stamp":"2023-08-10T10:33:56.307064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:19.676661+0000","scrub_duration":0.001379796,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"29'30","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.850385+0000","last_change":"2023-08-10T10:33:47.850385+0000","last_active":"2023-08-10T10:33:47.850385+0000","last_peered":"2023-08-10T10:33:47.850385+0000","last_clean":"2023-08-10T10:33:47.850385+0000","last_became_active":"2023-08-10T10:30:34.339941+0000","last_became_peered":"2023-08-10T10:30:34.339941+0000","last_unstale":"2023-08-10T10:33:47.850385+0000","last_undegraded":"2023-08-10T10:33:47.850385+0000","last_fullsized":"2023-08-10T10:33:47.850385+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:47.850250+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.850250+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:26.814272+0000","scrub_duration":0.0016867119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.11","version":"29'461","reported_seq":488,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:00.698975+0000","last_change":"2023-08-10T10:34:00.699070+0000","last_active":"2023-08-10T10:34:00.698975+0000","last_peered":"2023-08-10T10:34:00.698975+0000","last_clean":"2023-08-10T10:34:00.698975+0000","last_became_active":"2023-08-10T10:30:38.397893+0000","last_became_peered":"2023-08-10T10:30:38.397893+0000","last_unstale":"2023-08-10T10:34:00.698975+0000","last_undegraded":"2023-08-10T10:34:00.698975+0000","last_fullsized":"2023-08-10T10:34:00.698975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'461","last_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_deep_scrub":"29'461","last_deep_scrub_stamp":"2023-08-10T10:34:00.698874+0000","last_clean_scrub_stamp":"2023-08-10T10:34:00.698874+0000","objects_scrubbed":1,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:31.027914+0000","scrub_duration":0.0070033159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7,1],"acting":[6,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.008482+0000","last_change":"2023-08-10T10:33:34.008533+0000","last_active":"2023-08-10T10:33:34.008482+0000","last_peered":"2023-08-10T10:33:34.008482+0000","last_clean":"2023-08-10T10:33:34.008482+0000","last_became_active":"2023-08-10T10:30:33.326029+0000","last_became_peered":"2023-08-10T10:30:33.326029+0000","last_unstale":"2023-08-10T10:33:34.008482+0000","last_undegraded":"2023-08-10T10:33:34.008482+0000","last_fullsized":"2023-08-10T10:33:34.008482+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.008392+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.008392+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:21.852519+0000","scrub_duration":0.002546034,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"29'27","reported_seq":60,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.171650+0000","last_change":"2023-08-10T10:33:34.171704+0000","last_active":"2023-08-10T10:33:34.171650+0000","last_peered":"2023-08-10T10:33:34.171650+0000","last_clean":"2023-08-10T10:33:34.171650+0000","last_became_active":"2023-08-10T10:30:34.332677+0000","last_became_peered":"2023-08-10T10:30:34.332677+0000","last_unstale":"2023-08-10T10:33:34.171650+0000","last_undegraded":"2023-08-10T10:33:34.171650+0000","last_fullsized":"2023-08-10T10:33:34.171650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'27","last_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_deep_scrub":"29'27","last_deep_scrub_stamp":"2023-08-10T10:33:34.171561+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.171561+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:40.952770+0000","scrub_duration":0.001549545,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"29'465","reported_seq":492,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:16.254095+0000","last_change":"2023-08-10T10:34:16.254174+0000","last_active":"2023-08-10T10:34:16.254095+0000","last_peered":"2023-08-10T10:34:16.254095+0000","last_clean":"2023-08-10T10:34:16.254095+0000","last_became_active":"2023-08-10T10:30:38.403639+0000","last_became_peered":"2023-08-10T10:30:38.403639+0000","last_unstale":"2023-08-10T10:34:16.254095+0000","last_undegraded":"2023-08-10T10:34:16.254095+0000","last_fullsized":"2023-08-10T10:34:16.254095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'465","last_scrub_stamp":"2023-08-10T10:34:16.254009+0000","last_deep_scrub":"29'465","last_deep_scrub_stamp":"2023-08-10T10:34:16.254009+0000","last_clean_scrub_stamp":"2023-08-10T10:34:16.254009+0000","objects_scrubbed":0,"log_size":465,"log_dups_size":0,"ondisk_log_size":465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:44.193143+0000","scrub_duration":0.0022438100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":55296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,0],"acting":[7,4,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.005191+0000","last_change":"2023-08-10T10:33:54.005241+0000","last_active":"2023-08-10T10:33:54.005191+0000","last_peered":"2023-08-10T10:33:54.005191+0000","last_clean":"2023-08-10T10:33:54.005191+0000","last_became_active":"2023-08-10T10:30:33.327378+0000","last_became_peered":"2023-08-10T10:30:33.327378+0000","last_unstale":"2023-08-10T10:33:54.005191+0000","last_undegraded":"2023-08-10T10:33:54.005191+0000","last_fullsized":"2023-08-10T10:33:54.005191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.005110+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.005110+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:13:01.830167+0000","scrub_duration":0.001665653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"29'36","reported_seq":69,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:11.450134+0000","last_change":"2023-08-10T10:34:11.450223+0000","last_active":"2023-08-10T10:34:11.450134+0000","last_peered":"2023-08-10T10:34:11.450134+0000","last_clean":"2023-08-10T10:34:11.450134+0000","last_became_active":"2023-08-10T10:30:34.334417+0000","last_became_peered":"2023-08-10T10:30:34.334417+0000","last_unstale":"2023-08-10T10:34:11.450134+0000","last_undegraded":"2023-08-10T10:34:11.450134+0000","last_fullsized":"2023-08-10T10:34:11.450134+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'36","last_scrub_stamp":"2023-08-10T10:34:11.450029+0000","last_deep_scrub":"29'36","last_deep_scrub_stamp":"2023-08-10T10:34:11.450029+0000","last_clean_scrub_stamp":"2023-08-10T10:34:11.450029+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:39.389164+0000","scrub_duration":0.0022280490000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"29'458","reported_seq":485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:35.621224+0000","last_change":"2023-08-10T10:34:35.621299+0000","last_active":"2023-08-10T10:34:35.621224+0000","last_peered":"2023-08-10T10:34:35.621224+0000","last_clean":"2023-08-10T10:34:35.621224+0000","last_became_active":"2023-08-10T10:30:38.397997+0000","last_became_peered":"2023-08-10T10:30:38.397997+0000","last_unstale":"2023-08-10T10:34:35.621224+0000","last_undegraded":"2023-08-10T10:34:35.621224+0000","last_fullsized":"2023-08-10T10:34:35.621224+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'458","last_scrub_stamp":"2023-08-10T10:34:35.621133+0000","last_deep_scrub":"29'458","last_deep_scrub_stamp":"2023-08-10T10:34:35.621133+0000","last_clean_scrub_stamp":"2023-08-10T10:34:35.621133+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:34:24.006950+0000","scrub_duration":0.0023495809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,5],"acting":[3,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.340567+0000","last_change":"2023-08-10T10:33:48.340677+0000","last_active":"2023-08-10T10:33:48.340567+0000","last_peered":"2023-08-10T10:33:48.340567+0000","last_clean":"2023-08-10T10:33:48.340567+0000","last_became_active":"2023-08-10T10:30:33.325445+0000","last_became_peered":"2023-08-10T10:30:33.325445+0000","last_unstale":"2023-08-10T10:33:48.340567+0000","last_undegraded":"2023-08-10T10:33:48.340567+0000","last_fullsized":"2023-08-10T10:33:48.340567+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:48.340462+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.340462+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:32.243128+0000","scrub_duration":0.0055728410000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"29'42","reported_seq":75,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.699136+0000","last_change":"2023-08-10T10:33:40.699214+0000","last_active":"2023-08-10T10:33:40.699136+0000","last_peered":"2023-08-10T10:33:40.699136+0000","last_clean":"2023-08-10T10:33:40.699136+0000","last_became_active":"2023-08-10T10:30:34.349789+0000","last_became_peered":"2023-08-10T10:30:34.349789+0000","last_unstale":"2023-08-10T10:33:40.699136+0000","last_undegraded":"2023-08-10T10:33:40.699136+0000","last_fullsized":"2023-08-10T10:33:40.699136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'42","last_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_deep_scrub":"29'42","last_deep_scrub_stamp":"2023-08-10T10:33:40.699048+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.699048+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:29.397615+0000","scrub_duration":0.0021018759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"29'455","reported_seq":482,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:06.619339+0000","last_change":"2023-08-10T10:34:06.619454+0000","last_active":"2023-08-10T10:34:06.619339+0000","last_peered":"2023-08-10T10:34:06.619339+0000","last_clean":"2023-08-10T10:34:06.619339+0000","last_became_active":"2023-08-10T10:30:38.392797+0000","last_became_peered":"2023-08-10T10:30:38.392797+0000","last_unstale":"2023-08-10T10:34:06.619339+0000","last_undegraded":"2023-08-10T10:34:06.619339+0000","last_fullsized":"2023-08-10T10:34:06.619339+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'455","last_scrub_stamp":"2023-08-10T10:34:06.619226+0000","last_deep_scrub":"29'455","last_deep_scrub_stamp":"2023-08-10T10:34:06.619226+0000","last_clean_scrub_stamp":"2023-08-10T10:34:06.619226+0000","objects_scrubbed":2,"log_size":455,"log_dups_size":0,"ondisk_log_size":455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:29.988822+0000","scrub_duration":0.0091010469999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,7],"acting":[1,5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"29'627","reported_seq":662,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:58.493785+0000","last_change":"2023-08-10T10:33:58.493843+0000","last_active":"2023-08-10T10:33:58.493785+0000","last_peered":"2023-08-10T10:33:58.493785+0000","last_clean":"2023-08-10T10:33:58.493785+0000","last_became_active":"2023-08-10T10:30:33.321784+0000","last_became_peered":"2023-08-10T10:30:33.321784+0000","last_unstale":"2023-08-10T10:33:58.493785+0000","last_undegraded":"2023-08-10T10:33:58.493785+0000","last_fullsized":"2023-08-10T10:33:58.493785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'627","last_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_deep_scrub":"29'627","last_deep_scrub_stamp":"2023-08-10T10:33:58.493691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:58.493691+0000","objects_scrubbed":4,"log_size":627,"log_dups_size":0,"ondisk_log_size":627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:26.432825+0000","scrub_duration":0.012523909,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2142065,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":624,"num_write_kb":2548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"29'41","reported_seq":74,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:29.850973+0000","last_change":"2023-08-10T10:34:29.851022+0000","last_active":"2023-08-10T10:34:29.850973+0000","last_peered":"2023-08-10T10:34:29.850973+0000","last_clean":"2023-08-10T10:34:29.850973+0000","last_became_active":"2023-08-10T10:30:34.344376+0000","last_became_peered":"2023-08-10T10:30:34.344376+0000","last_unstale":"2023-08-10T10:34:29.850973+0000","last_undegraded":"2023-08-10T10:34:29.850973+0000","last_fullsized":"2023-08-10T10:34:29.850973+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'41","last_scrub_stamp":"2023-08-10T10:34:29.850882+0000","last_deep_scrub":"29'41","last_deep_scrub_stamp":"2023-08-10T10:34:29.850882+0000","last_clean_scrub_stamp":"2023-08-10T10:34:29.850882+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:49:35.630804+0000","scrub_duration":0.0017669160000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"29'489","reported_seq":516,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:19.834024+0000","last_change":"2023-08-10T10:34:19.834097+0000","last_active":"2023-08-10T10:34:19.834024+0000","last_peered":"2023-08-10T10:34:19.834024+0000","last_clean":"2023-08-10T10:34:19.834024+0000","last_became_active":"2023-08-10T10:30:38.397451+0000","last_became_peered":"2023-08-10T10:30:38.397451+0000","last_unstale":"2023-08-10T10:34:19.834024+0000","last_undegraded":"2023-08-10T10:34:19.834024+0000","last_fullsized":"2023-08-10T10:34:19.834024+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'489","last_scrub_stamp":"2023-08-10T10:34:19.833934+0000","last_deep_scrub":"29'489","last_deep_scrub_stamp":"2023-08-10T10:34:19.833934+0000","last_clean_scrub_stamp":"2023-08-10T10:34:19.833934+0000","objects_scrubbed":0,"log_size":489,"log_dups_size":0,"ondisk_log_size":489,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:28:47.773068+0000","scrub_duration":0.002739043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3,0],"acting":[5,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.358720+0000","last_change":"2023-08-10T10:33:47.358774+0000","last_active":"2023-08-10T10:33:47.358720+0000","last_peered":"2023-08-10T10:33:47.358720+0000","last_clean":"2023-08-10T10:33:47.358720+0000","last_became_active":"2023-08-10T10:30:33.324689+0000","last_became_peered":"2023-08-10T10:30:33.324689+0000","last_unstale":"2023-08-10T10:33:47.358720+0000","last_undegraded":"2023-08-10T10:33:47.358720+0000","last_fullsized":"2023-08-10T10:33:47.358720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:47.358645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.358645+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:12.879510+0000","scrub_duration":0.0040639780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"29'29","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.233719+0000","last_change":"2023-08-10T10:33:28.233783+0000","last_active":"2023-08-10T10:33:28.233719+0000","last_peered":"2023-08-10T10:33:28.233719+0000","last_clean":"2023-08-10T10:33:28.233719+0000","last_became_active":"2023-08-10T10:31:15.343784+0000","last_became_peered":"2023-08-10T10:31:15.343784+0000","last_unstale":"2023-08-10T10:33:28.233719+0000","last_undegraded":"2023-08-10T10:33:28.233719+0000","last_fullsized":"2023-08-10T10:33:28.233719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:28.233641+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.233641+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:16.077769+0000","scrub_duration":0.0020674529999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"29'456","reported_seq":483,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:43.506035+0000","last_change":"2023-08-10T10:34:43.506145+0000","last_active":"2023-08-10T10:34:43.506035+0000","last_peered":"2023-08-10T10:34:43.506035+0000","last_clean":"2023-08-10T10:34:43.506035+0000","last_became_active":"2023-08-10T10:30:38.390081+0000","last_became_peered":"2023-08-10T10:30:38.390081+0000","last_unstale":"2023-08-10T10:34:43.506035+0000","last_undegraded":"2023-08-10T10:34:43.506035+0000","last_fullsized":"2023-08-10T10:34:43.506035+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'456","last_scrub_stamp":"2023-08-10T10:34:43.505942+0000","last_deep_scrub":"29'456","last_deep_scrub_stamp":"2023-08-10T10:34:43.505942+0000","last_clean_scrub_stamp":"2023-08-10T10:34:43.505942+0000","objects_scrubbed":1,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:59:51.762110+0000","scrub_duration":0.0077954390000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2,1],"acting":[3,7,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.007534+0000","last_change":"2023-08-10T10:33:36.007599+0000","last_active":"2023-08-10T10:33:36.007534+0000","last_peered":"2023-08-10T10:33:36.007534+0000","last_clean":"2023-08-10T10:33:36.007534+0000","last_became_active":"2023-08-10T10:30:33.321485+0000","last_became_peered":"2023-08-10T10:30:33.321485+0000","last_unstale":"2023-08-10T10:33:36.007534+0000","last_undegraded":"2023-08-10T10:33:36.007534+0000","last_fullsized":"2023-08-10T10:33:36.007534+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:36.007457+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.007457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:38:24.706023+0000","scrub_duration":0.002469873,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.992559+0000","last_change":"2023-08-10T10:34:03.992622+0000","last_active":"2023-08-10T10:34:03.992559+0000","last_peered":"2023-08-10T10:34:03.992559+0000","last_clean":"2023-08-10T10:34:03.992559+0000","last_became_active":"2023-08-10T10:30:34.341049+0000","last_became_peered":"2023-08-10T10:30:34.341049+0000","last_unstale":"2023-08-10T10:34:03.992559+0000","last_undegraded":"2023-08-10T10:34:03.992559+0000","last_fullsized":"2023-08-10T10:34:03.992559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:34:03.992472+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.992472+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:29.640732+0000","scrub_duration":0.0016651019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.17","version":"29'445","reported_seq":472,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:33.698298+0000","last_change":"2023-08-10T10:34:33.698395+0000","last_active":"2023-08-10T10:34:33.698298+0000","last_peered":"2023-08-10T10:34:33.698298+0000","last_clean":"2023-08-10T10:34:33.698298+0000","last_became_active":"2023-08-10T10:30:38.389887+0000","last_became_peered":"2023-08-10T10:30:38.389887+0000","last_unstale":"2023-08-10T10:34:33.698298+0000","last_undegraded":"2023-08-10T10:34:33.698298+0000","last_fullsized":"2023-08-10T10:34:33.698298+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'445","last_scrub_stamp":"2023-08-10T10:34:33.698195+0000","last_deep_scrub":"29'445","last_deep_scrub_stamp":"2023-08-10T10:34:33.698195+0000","last_clean_scrub_stamp":"2023-08-10T10:34:33.698195+0000","objects_scrubbed":2,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:34:12.037933+0000","scrub_duration":0.011652445000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,0],"acting":[3,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.321985+0000","last_change":"2023-08-10T10:33:45.322039+0000","last_active":"2023-08-10T10:33:45.321985+0000","last_peered":"2023-08-10T10:33:45.321985+0000","last_clean":"2023-08-10T10:33:45.321985+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:45.321985+0000","last_undegraded":"2023-08-10T10:33:45.321985+0000","last_fullsized":"2023-08-10T10:33:45.321985+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:45.321894+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.321894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:36.639491+0000","scrub_duration":0.0016593409999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"29'39","reported_seq":72,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:03.155840+0000","last_change":"2023-08-10T10:34:03.155890+0000","last_active":"2023-08-10T10:34:03.155840+0000","last_peered":"2023-08-10T10:34:03.155840+0000","last_clean":"2023-08-10T10:34:03.155840+0000","last_became_active":"2023-08-10T10:30:34.337779+0000","last_became_peered":"2023-08-10T10:30:34.337779+0000","last_unstale":"2023-08-10T10:34:03.155840+0000","last_undegraded":"2023-08-10T10:34:03.155840+0000","last_fullsized":"2023-08-10T10:34:03.155840+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'39","last_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_deep_scrub":"29'39","last_deep_scrub_stamp":"2023-08-10T10:34:03.155763+0000","last_clean_scrub_stamp":"2023-08-10T10:34:03.155763+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:26.525360+0000","scrub_duration":0.0016010919999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"29'510","reported_seq":537,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:32.885330+0000","last_change":"2023-08-10T10:34:32.885421+0000","last_active":"2023-08-10T10:34:32.885330+0000","last_peered":"2023-08-10T10:34:32.885330+0000","last_clean":"2023-08-10T10:34:32.885330+0000","last_became_active":"2023-08-10T10:30:38.409019+0000","last_became_peered":"2023-08-10T10:30:38.409019+0000","last_unstale":"2023-08-10T10:34:32.885330+0000","last_undegraded":"2023-08-10T10:34:32.885330+0000","last_fullsized":"2023-08-10T10:34:32.885330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'510","last_scrub_stamp":"2023-08-10T10:34:32.885248+0000","last_deep_scrub":"29'510","last_deep_scrub_stamp":"2023-08-10T10:34:32.885248+0000","last_clean_scrub_stamp":"2023-08-10T10:34:32.885248+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:59.686080+0000","scrub_duration":0.00229686,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,6],"acting":[5,3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:33.909944+0000","last_change":"2023-08-10T10:33:33.910006+0000","last_active":"2023-08-10T10:33:33.909944+0000","last_peered":"2023-08-10T10:33:33.909944+0000","last_clean":"2023-08-10T10:33:33.909944+0000","last_became_active":"2023-08-10T10:30:33.316994+0000","last_became_peered":"2023-08-10T10:30:33.316994+0000","last_unstale":"2023-08-10T10:33:33.909944+0000","last_undegraded":"2023-08-10T10:33:33.909944+0000","last_fullsized":"2023-08-10T10:33:33.909944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:33.909866+0000","last_clean_scrub_stamp":"2023-08-10T10:33:33.909866+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:07:52.137280+0000","scrub_duration":0.0047131780000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:07.359893+0000","last_change":"2023-08-10T10:34:07.359957+0000","last_active":"2023-08-10T10:34:07.359893+0000","last_peered":"2023-08-10T10:34:07.359893+0000","last_clean":"2023-08-10T10:34:07.359893+0000","last_became_active":"2023-08-10T10:30:34.340230+0000","last_became_peered":"2023-08-10T10:30:34.340230+0000","last_unstale":"2023-08-10T10:34:07.359893+0000","last_undegraded":"2023-08-10T10:34:07.359893+0000","last_fullsized":"2023-08-10T10:34:07.359893+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:07.359815+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:07.359815+0000","last_clean_scrub_stamp":"2023-08-10T10:34:07.359815+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:18.378966+0000","scrub_duration":0.0021041499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.9","version":"29'484","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:24.197809+0000","last_change":"2023-08-10T10:34:24.197907+0000","last_active":"2023-08-10T10:34:24.197809+0000","last_peered":"2023-08-10T10:34:24.197809+0000","last_clean":"2023-08-10T10:34:24.197809+0000","last_became_active":"2023-08-10T10:30:38.395767+0000","last_became_peered":"2023-08-10T10:30:38.395767+0000","last_unstale":"2023-08-10T10:34:24.197809+0000","last_undegraded":"2023-08-10T10:34:24.197809+0000","last_fullsized":"2023-08-10T10:34:24.197809+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'484","last_scrub_stamp":"2023-08-10T10:34:24.197712+0000","last_deep_scrub":"29'484","last_deep_scrub_stamp":"2023-08-10T10:34:24.197712+0000","last_clean_scrub_stamp":"2023-08-10T10:34:24.197712+0000","objects_scrubbed":2,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:33:56.755849+0000","scrub_duration":0.0096465149999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":39936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3,4],"acting":[7,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.286658+0000","last_change":"2023-08-10T10:33:35.286714+0000","last_active":"2023-08-10T10:33:35.286658+0000","last_peered":"2023-08-10T10:33:35.286658+0000","last_clean":"2023-08-10T10:33:35.286658+0000","last_became_active":"2023-08-10T10:30:33.323696+0000","last_became_peered":"2023-08-10T10:30:33.323696+0000","last_unstale":"2023-08-10T10:33:35.286658+0000","last_undegraded":"2023-08-10T10:33:35.286658+0000","last_fullsized":"2023-08-10T10:33:35.286658+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:35.286568+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.286568+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:23.130695+0000","scrub_duration":0.0033667300000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:13.982648+0000","last_change":"2023-08-10T10:34:13.982700+0000","last_active":"2023-08-10T10:34:13.982648+0000","last_peered":"2023-08-10T10:34:13.982648+0000","last_clean":"2023-08-10T10:34:13.982648+0000","last_became_active":"2023-08-10T10:30:34.350352+0000","last_became_peered":"2023-08-10T10:30:34.350352+0000","last_unstale":"2023-08-10T10:34:13.982648+0000","last_undegraded":"2023-08-10T10:34:13.982648+0000","last_fullsized":"2023-08-10T10:34:13.982648+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:34:13.982555+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:34:13.982555+0000","last_clean_scrub_stamp":"2023-08-10T10:34:13.982555+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:02.494323+0000","scrub_duration":0.001656755,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"29'497","reported_seq":524,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:46.780481+0000","last_change":"2023-08-10T10:33:46.780614+0000","last_active":"2023-08-10T10:33:46.780481+0000","last_peered":"2023-08-10T10:33:46.780481+0000","last_clean":"2023-08-10T10:33:46.780481+0000","last_became_active":"2023-08-10T10:30:38.398911+0000","last_became_peered":"2023-08-10T10:30:38.398911+0000","last_unstale":"2023-08-10T10:33:46.780481+0000","last_undegraded":"2023-08-10T10:33:46.780481+0000","last_fullsized":"2023-08-10T10:33:46.780481+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'497","last_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_deep_scrub":"29'497","last_deep_scrub_stamp":"2023-08-10T10:33:46.780378+0000","last_clean_scrub_stamp":"2023-08-10T10:33:46.780378+0000","objects_scrubbed":2,"log_size":497,"log_dups_size":0,"ondisk_log_size":497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:38:26.660886+0000","scrub_duration":0.010450968999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":56320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,5],"acting":[2,0,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.274812+0000","last_change":"2023-08-10T10:33:51.274878+0000","last_active":"2023-08-10T10:33:51.274812+0000","last_peered":"2023-08-10T10:33:51.274812+0000","last_clean":"2023-08-10T10:33:51.274812+0000","last_became_active":"2023-08-10T10:30:33.323842+0000","last_became_peered":"2023-08-10T10:30:33.323842+0000","last_unstale":"2023-08-10T10:33:51.274812+0000","last_undegraded":"2023-08-10T10:33:51.274812+0000","last_fullsized":"2023-08-10T10:33:51.274812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:51.274730+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.274730+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:59.099787+0000","scrub_duration":0.0029352610000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:13.792386+0000","last_change":"2023-08-10T10:34:13.792458+0000","last_active":"2023-08-10T10:34:13.792386+0000","last_peered":"2023-08-10T10:34:13.792386+0000","last_clean":"2023-08-10T10:34:13.792386+0000","last_became_active":"2023-08-10T10:30:34.333731+0000","last_became_peered":"2023-08-10T10:30:34.333731+0000","last_unstale":"2023-08-10T10:34:13.792386+0000","last_undegraded":"2023-08-10T10:34:13.792386+0000","last_fullsized":"2023-08-10T10:34:13.792386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:13.792301+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:13.792301+0000","last_clean_scrub_stamp":"2023-08-10T10:34:13.792301+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:17.772770+0000","scrub_duration":0.002485765,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.b","version":"29'473","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.753624+0000","last_change":"2023-08-10T10:33:54.753735+0000","last_active":"2023-08-10T10:33:54.753624+0000","last_peered":"2023-08-10T10:33:54.753624+0000","last_clean":"2023-08-10T10:33:54.753624+0000","last_became_active":"2023-08-10T10:30:38.399043+0000","last_became_peered":"2023-08-10T10:30:38.399043+0000","last_unstale":"2023-08-10T10:33:54.753624+0000","last_undegraded":"2023-08-10T10:33:54.753624+0000","last_fullsized":"2023-08-10T10:33:54.753624+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'473","last_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_deep_scrub":"29'473","last_deep_scrub_stamp":"2023-08-10T10:33:54.753507+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.753507+0000","objects_scrubbed":1,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:21.530219+0000","scrub_duration":0.0074936170000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,6],"acting":[2,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"29'2","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.347637+0000","last_change":"2023-08-10T10:33:49.347692+0000","last_active":"2023-08-10T10:33:49.347637+0000","last_peered":"2023-08-10T10:33:49.347637+0000","last_clean":"2023-08-10T10:33:49.347637+0000","last_became_active":"2023-08-10T10:30:33.327518+0000","last_became_peered":"2023-08-10T10:30:33.327518+0000","last_unstale":"2023-08-10T10:33:49.347637+0000","last_undegraded":"2023-08-10T10:33:49.347637+0000","last_fullsized":"2023-08-10T10:33:49.347637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:49.347549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.347549+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.813246+0000","scrub_duration":0.0030245340000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"29'33","reported_seq":66,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:57.750541+0000","last_change":"2023-08-10T10:33:57.750610+0000","last_active":"2023-08-10T10:33:57.750541+0000","last_peered":"2023-08-10T10:33:57.750541+0000","last_clean":"2023-08-10T10:33:57.750541+0000","last_became_active":"2023-08-10T10:30:34.337739+0000","last_became_peered":"2023-08-10T10:30:34.337739+0000","last_unstale":"2023-08-10T10:33:57.750541+0000","last_undegraded":"2023-08-10T10:33:57.750541+0000","last_fullsized":"2023-08-10T10:33:57.750541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'33","last_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_deep_scrub":"29'33","last_deep_scrub_stamp":"2023-08-10T10:33:57.750444+0000","last_clean_scrub_stamp":"2023-08-10T10:33:57.750444+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:51:26.899141+0000","scrub_duration":0.0025147009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"29'459","reported_seq":486,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:51.682718+0000","last_change":"2023-08-10T10:33:51.682788+0000","last_active":"2023-08-10T10:33:51.682718+0000","last_peered":"2023-08-10T10:33:51.682718+0000","last_clean":"2023-08-10T10:33:51.682718+0000","last_became_active":"2023-08-10T10:30:38.406209+0000","last_became_peered":"2023-08-10T10:30:38.406209+0000","last_unstale":"2023-08-10T10:33:51.682718+0000","last_undegraded":"2023-08-10T10:33:51.682718+0000","last_fullsized":"2023-08-10T10:33:51.682718+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'459","last_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_deep_scrub":"29'459","last_deep_scrub_stamp":"2023-08-10T10:33:51.682645+0000","last_clean_scrub_stamp":"2023-08-10T10:33:51.682645+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:47:30.646667+0000","scrub_duration":0.002161919,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,6],"acting":[2,4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.058424+0000","last_change":"2023-08-10T10:33:49.058472+0000","last_active":"2023-08-10T10:33:49.058424+0000","last_peered":"2023-08-10T10:33:49.058424+0000","last_clean":"2023-08-10T10:33:49.058424+0000","last_became_active":"2023-08-10T10:30:33.328966+0000","last_became_peered":"2023-08-10T10:30:33.328966+0000","last_unstale":"2023-08-10T10:33:49.058424+0000","last_undegraded":"2023-08-10T10:33:49.058424+0000","last_fullsized":"2023-08-10T10:33:49.058424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:49.058345+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.058345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.151225+0000","scrub_duration":0.0024074959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:27.950114+0000","last_change":"2023-08-10T10:33:27.950155+0000","last_active":"2023-08-10T10:33:27.950114+0000","last_peered":"2023-08-10T10:33:27.950114+0000","last_clean":"2023-08-10T10:33:27.950114+0000","last_became_active":"2023-08-10T10:30:34.335515+0000","last_became_peered":"2023-08-10T10:30:34.335515+0000","last_unstale":"2023-08-10T10:33:27.950114+0000","last_undegraded":"2023-08-10T10:33:27.950114+0000","last_fullsized":"2023-08-10T10:33:27.950114+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:27.950050+0000","last_clean_scrub_stamp":"2023-08-10T10:33:27.950050+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:52.895642+0000","scrub_duration":0.0013175579999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"29'441","reported_seq":468,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:47.750589+0000","last_change":"2023-08-10T10:33:47.750695+0000","last_active":"2023-08-10T10:33:47.750589+0000","last_peered":"2023-08-10T10:33:47.750589+0000","last_clean":"2023-08-10T10:33:47.750589+0000","last_became_active":"2023-08-10T10:30:38.399937+0000","last_became_peered":"2023-08-10T10:30:38.399937+0000","last_unstale":"2023-08-10T10:33:47.750589+0000","last_undegraded":"2023-08-10T10:33:47.750589+0000","last_fullsized":"2023-08-10T10:33:47.750589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'441","last_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_deep_scrub":"29'441","last_deep_scrub_stamp":"2023-08-10T10:33:47.750477+0000","last_clean_scrub_stamp":"2023-08-10T10:33:47.750477+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:09:44.745054+0000","scrub_duration":0.0026848639999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5,6],"acting":[2,7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.270842+0000","last_change":"2023-08-10T10:33:40.270896+0000","last_active":"2023-08-10T10:33:40.270842+0000","last_peered":"2023-08-10T10:33:40.270842+0000","last_clean":"2023-08-10T10:33:40.270842+0000","last_became_active":"2023-08-10T10:30:33.317792+0000","last_became_peered":"2023-08-10T10:30:33.317792+0000","last_unstale":"2023-08-10T10:33:40.270842+0000","last_undegraded":"2023-08-10T10:33:40.270842+0000","last_fullsized":"2023-08-10T10:33:40.270842+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:40.270765+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.270765+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:05.791630+0000","scrub_duration":0.0031293139999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"29'26","reported_seq":59,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:11.739851+0000","last_change":"2023-08-10T10:34:11.739904+0000","last_active":"2023-08-10T10:34:11.739851+0000","last_peered":"2023-08-10T10:34:11.739851+0000","last_clean":"2023-08-10T10:34:11.739851+0000","last_became_active":"2023-08-10T10:30:34.336803+0000","last_became_peered":"2023-08-10T10:30:34.336803+0000","last_unstale":"2023-08-10T10:34:11.739851+0000","last_undegraded":"2023-08-10T10:34:11.739851+0000","last_fullsized":"2023-08-10T10:34:11.739851+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'26","last_scrub_stamp":"2023-08-10T10:34:11.739708+0000","last_deep_scrub":"29'26","last_deep_scrub_stamp":"2023-08-10T10:34:11.739708+0000","last_clean_scrub_stamp":"2023-08-10T10:34:11.739708+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:38.540541+0000","scrub_duration":0.0024274370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"29'479","reported_seq":506,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:14.464765+0000","last_change":"2023-08-10T10:34:14.464838+0000","last_active":"2023-08-10T10:34:14.464765+0000","last_peered":"2023-08-10T10:34:14.464765+0000","last_clean":"2023-08-10T10:34:14.464765+0000","last_became_active":"2023-08-10T10:30:38.406206+0000","last_became_peered":"2023-08-10T10:30:38.406206+0000","last_unstale":"2023-08-10T10:34:14.464765+0000","last_undegraded":"2023-08-10T10:34:14.464765+0000","last_fullsized":"2023-08-10T10:34:14.464765+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'479","last_scrub_stamp":"2023-08-10T10:34:14.464686+0000","last_deep_scrub":"29'479","last_deep_scrub_stamp":"2023-08-10T10:34:14.464686+0000","last_clean_scrub_stamp":"2023-08-10T10:34:14.464686+0000","objects_scrubbed":0,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:59:02.976455+0000","scrub_duration":0.0021581220000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0,6],"acting":[1,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.952739+0000","last_change":"2023-08-10T10:33:35.952798+0000","last_active":"2023-08-10T10:33:35.952739+0000","last_peered":"2023-08-10T10:33:35.952739+0000","last_clean":"2023-08-10T10:33:35.952739+0000","last_became_active":"2023-08-10T10:30:33.326282+0000","last_became_peered":"2023-08-10T10:30:33.326282+0000","last_unstale":"2023-08-10T10:33:35.952739+0000","last_undegraded":"2023-08-10T10:33:35.952739+0000","last_fullsized":"2023-08-10T10:33:35.952739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:35.952663+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.952663+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:26.124104+0000","scrub_duration":0.0015171099999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"29'30","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.580971+0000","last_change":"2023-08-10T10:33:30.581025+0000","last_active":"2023-08-10T10:33:30.580971+0000","last_peered":"2023-08-10T10:33:30.580971+0000","last_clean":"2023-08-10T10:33:30.580971+0000","last_became_active":"2023-08-10T10:30:34.334401+0000","last_became_peered":"2023-08-10T10:30:34.334401+0000","last_unstale":"2023-08-10T10:33:30.580971+0000","last_undegraded":"2023-08-10T10:33:30.580971+0000","last_fullsized":"2023-08-10T10:33:30.580971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'30","last_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_deep_scrub":"29'30","last_deep_scrub_stamp":"2023-08-10T10:33:30.580850+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.580850+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:14.483516+0000","scrub_duration":0.0024261040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"29'458","reported_seq":485,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:26.841725+0000","last_change":"2023-08-10T10:34:26.841842+0000","last_active":"2023-08-10T10:34:26.841725+0000","last_peered":"2023-08-10T10:34:26.841725+0000","last_clean":"2023-08-10T10:34:26.841725+0000","last_became_active":"2023-08-10T10:30:38.406649+0000","last_became_peered":"2023-08-10T10:30:38.406649+0000","last_unstale":"2023-08-10T10:34:26.841725+0000","last_undegraded":"2023-08-10T10:34:26.841725+0000","last_fullsized":"2023-08-10T10:34:26.841725+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'458","last_scrub_stamp":"2023-08-10T10:34:26.841621+0000","last_deep_scrub":"29'458","last_deep_scrub_stamp":"2023-08-10T10:34:26.841621+0000","last_clean_scrub_stamp":"2023-08-10T10:34:26.841621+0000","objects_scrubbed":1,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:33:59.399758+0000","scrub_duration":0.0070739849999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":30720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6,2],"acting":[5,4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"29'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:54.519905+0000","last_change":"2023-08-10T10:33:54.519965+0000","last_active":"2023-08-10T10:33:54.519905+0000","last_peered":"2023-08-10T10:33:54.519905+0000","last_clean":"2023-08-10T10:33:54.519905+0000","last_became_active":"2023-08-10T10:30:33.320960+0000","last_became_peered":"2023-08-10T10:30:33.320960+0000","last_unstale":"2023-08-10T10:33:54.519905+0000","last_undegraded":"2023-08-10T10:33:54.519905+0000","last_fullsized":"2023-08-10T10:33:54.519905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:54.519822+0000","last_clean_scrub_stamp":"2023-08-10T10:33:54.519822+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:05.538972+0000","scrub_duration":0.00232088,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"29'17","reported_seq":50,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.617446+0000","last_change":"2023-08-10T10:33:29.617535+0000","last_active":"2023-08-10T10:33:29.617446+0000","last_peered":"2023-08-10T10:33:29.617446+0000","last_clean":"2023-08-10T10:33:29.617446+0000","last_became_active":"2023-08-10T10:30:34.345228+0000","last_became_peered":"2023-08-10T10:30:34.345228+0000","last_unstale":"2023-08-10T10:33:29.617446+0000","last_undegraded":"2023-08-10T10:33:29.617446+0000","last_fullsized":"2023-08-10T10:33:29.617446+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'17","last_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_deep_scrub":"29'17","last_deep_scrub_stamp":"2023-08-10T10:33:29.617330+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.617330+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:33:55.138195+0000","scrub_duration":0.0018756619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"29'462","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:34.825736+0000","last_change":"2023-08-10T10:34:34.825826+0000","last_active":"2023-08-10T10:34:34.825736+0000","last_peered":"2023-08-10T10:34:34.825736+0000","last_clean":"2023-08-10T10:34:34.825736+0000","last_became_active":"2023-08-10T10:30:38.408556+0000","last_became_peered":"2023-08-10T10:30:38.408556+0000","last_unstale":"2023-08-10T10:34:34.825736+0000","last_undegraded":"2023-08-10T10:34:34.825736+0000","last_fullsized":"2023-08-10T10:34:34.825736+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:34:34.825627+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:34:34.825627+0000","last_clean_scrub_stamp":"2023-08-10T10:34:34.825627+0000","objects_scrubbed":1,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:39:53.181012+0000","scrub_duration":0.0070650970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0,2],"acting":[4,5,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":35,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:45.404468+0000","last_change":"2023-08-10T10:33:45.404519+0000","last_active":"2023-08-10T10:33:45.404468+0000","last_peered":"2023-08-10T10:33:45.404468+0000","last_clean":"2023-08-10T10:33:45.404468+0000","last_became_active":"2023-08-10T10:30:33.322160+0000","last_became_peered":"2023-08-10T10:30:33.322160+0000","last_unstale":"2023-08-10T10:33:45.404468+0000","last_undegraded":"2023-08-10T10:33:45.404468+0000","last_fullsized":"2023-08-10T10:33:45.404468+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:45.404381+0000","last_clean_scrub_stamp":"2023-08-10T10:33:45.404381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:12:53.229438+0000","scrub_duration":0.0015625789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"29'28","reported_seq":61,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.693014+0000","last_change":"2023-08-10T10:33:49.693066+0000","last_active":"2023-08-10T10:33:49.693014+0000","last_peered":"2023-08-10T10:33:49.693014+0000","last_clean":"2023-08-10T10:33:49.693014+0000","last_became_active":"2023-08-10T10:30:34.343790+0000","last_became_peered":"2023-08-10T10:30:34.343790+0000","last_unstale":"2023-08-10T10:33:49.693014+0000","last_undegraded":"2023-08-10T10:33:49.693014+0000","last_fullsized":"2023-08-10T10:33:49.693014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'28","last_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_deep_scrub":"29'28","last_deep_scrub_stamp":"2023-08-10T10:33:49.692931+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.692931+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:41:31.785811+0000","scrub_duration":0.001711401,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"29'466","reported_seq":494,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:14.255802+0000","last_change":"2023-08-10T10:34:14.255802+0000","last_active":"2023-08-10T10:34:14.255802+0000","last_peered":"2023-08-10T10:34:14.255802+0000","last_clean":"2023-08-10T10:34:14.255802+0000","last_became_active":"2023-08-10T10:30:38.394998+0000","last_became_peered":"2023-08-10T10:30:38.394998+0000","last_unstale":"2023-08-10T10:34:14.255802+0000","last_undegraded":"2023-08-10T10:34:14.255802+0000","last_fullsized":"2023-08-10T10:34:14.255802+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'466","last_scrub_stamp":"2023-08-10T10:34:14.255638+0000","last_deep_scrub":"29'466","last_deep_scrub_stamp":"2023-08-10T10:34:14.255638+0000","last_clean_scrub_stamp":"2023-08-10T10:34:14.255638+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:33:25.274788+0000","scrub_duration":0.0022907560000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,5],"acting":[0,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.710720+0000","last_change":"2023-08-10T10:33:30.710720+0000","last_active":"2023-08-10T10:33:30.710720+0000","last_peered":"2023-08-10T10:33:30.710720+0000","last_clean":"2023-08-10T10:33:30.710720+0000","last_became_active":"2023-08-10T10:30:28.301852+0000","last_became_peered":"2023-08-10T10:30:28.301852+0000","last_unstale":"2023-08-10T10:33:30.710720+0000","last_undegraded":"2023-08-10T10:33:30.710720+0000","last_fullsized":"2023-08-10T10:33:30.710720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:30.710529+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.710529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:50:59.859226+0000","scrub_duration":0.0012663329999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"29'2","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.009755+0000","last_change":"2023-08-10T10:33:52.009755+0000","last_active":"2023-08-10T10:33:52.009755+0000","last_peered":"2023-08-10T10:33:52.009755+0000","last_clean":"2023-08-10T10:33:52.009755+0000","last_became_active":"2023-08-10T10:30:33.328361+0000","last_became_peered":"2023-08-10T10:30:33.328361+0000","last_unstale":"2023-08-10T10:33:52.009755+0000","last_undegraded":"2023-08-10T10:33:52.009755+0000","last_fullsized":"2023-08-10T10:33:52.009755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'2","last_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_deep_scrub":"29'2","last_deep_scrub_stamp":"2023-08-10T10:33:52.009622+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.009622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:47.475319+0000","scrub_duration":0.002330159,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"29'29","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.696778+0000","last_change":"2023-08-10T10:33:38.696778+0000","last_active":"2023-08-10T10:33:38.696778+0000","last_peered":"2023-08-10T10:33:38.696778+0000","last_clean":"2023-08-10T10:33:38.696778+0000","last_became_active":"2023-08-10T10:30:34.341392+0000","last_became_peered":"2023-08-10T10:30:34.341392+0000","last_unstale":"2023-08-10T10:33:38.696778+0000","last_undegraded":"2023-08-10T10:33:38.696778+0000","last_fullsized":"2023-08-10T10:33:38.696778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:38.696559+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.696559+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:37:26.540686+0000","scrub_duration":0.0024199579999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"29'462","reported_seq":490,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:19.269727+0000","last_change":"2023-08-10T10:34:19.269727+0000","last_active":"2023-08-10T10:34:19.269727+0000","last_peered":"2023-08-10T10:34:19.269727+0000","last_clean":"2023-08-10T10:34:19.269727+0000","last_became_active":"2023-08-10T10:30:38.399970+0000","last_became_peered":"2023-08-10T10:30:38.399970+0000","last_unstale":"2023-08-10T10:34:19.269727+0000","last_undegraded":"2023-08-10T10:34:19.269727+0000","last_fullsized":"2023-08-10T10:34:19.269727+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:34:19.269531+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:34:19.269531+0000","last_clean_scrub_stamp":"2023-08-10T10:34:19.269531+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:27:19.423933+0000","scrub_duration":0.0022145950000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,6],"acting":[0,1,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:37.948688+0000","last_change":"2023-08-10T10:33:37.948688+0000","last_active":"2023-08-10T10:33:37.948688+0000","last_peered":"2023-08-10T10:33:37.948688+0000","last_clean":"2023-08-10T10:33:37.948688+0000","last_became_active":"2023-08-10T10:30:28.286892+0000","last_became_peered":"2023-08-10T10:30:28.286892+0000","last_unstale":"2023-08-10T10:33:37.948688+0000","last_undegraded":"2023-08-10T10:33:37.948688+0000","last_fullsized":"2023-08-10T10:33:37.948688+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:37.948513+0000","last_clean_scrub_stamp":"2023-08-10T10:33:37.948513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:54.150578+0000","scrub_duration":0.002318966,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:59.532081+0000","last_change":"2023-08-10T10:33:59.532081+0000","last_active":"2023-08-10T10:33:59.532081+0000","last_peered":"2023-08-10T10:33:59.532081+0000","last_clean":"2023-08-10T10:33:59.532081+0000","last_became_active":"2023-08-10T10:30:33.321648+0000","last_became_peered":"2023-08-10T10:30:33.321648+0000","last_unstale":"2023-08-10T10:33:59.532081+0000","last_undegraded":"2023-08-10T10:33:59.532081+0000","last_fullsized":"2023-08-10T10:33:59.532081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:59.531926+0000","last_clean_scrub_stamp":"2023-08-10T10:33:59.531926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T20:26:59.686329+0000","scrub_duration":0.001805404,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"29'29","reported_seq":63,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.718685+0000","last_change":"2023-08-10T10:33:41.718685+0000","last_active":"2023-08-10T10:33:41.718685+0000","last_peered":"2023-08-10T10:33:41.718685+0000","last_clean":"2023-08-10T10:33:41.718685+0000","last_became_active":"2023-08-10T10:30:34.339375+0000","last_became_peered":"2023-08-10T10:30:34.339375+0000","last_unstale":"2023-08-10T10:33:41.718685+0000","last_undegraded":"2023-08-10T10:33:41.718685+0000","last_fullsized":"2023-08-10T10:33:41.718685+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:41.718538+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.718538+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:53.207796+0000","scrub_duration":0.001658145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'418","reported_seq":445,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:48.707475+0000","last_change":"2023-08-10T10:33:48.707580+0000","last_active":"2023-08-10T10:33:48.707475+0000","last_peered":"2023-08-10T10:33:48.707475+0000","last_clean":"2023-08-10T10:33:48.707475+0000","last_became_active":"2023-08-10T10:30:38.398954+0000","last_became_peered":"2023-08-10T10:30:38.398954+0000","last_unstale":"2023-08-10T10:33:48.707475+0000","last_undegraded":"2023-08-10T10:33:48.707475+0000","last_fullsized":"2023-08-10T10:33:48.707475+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'418","last_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_deep_scrub":"29'418","last_deep_scrub_stamp":"2023-08-10T10:33:48.707382+0000","last_clean_scrub_stamp":"2023-08-10T10:33:48.707382+0000","objects_scrubbed":1,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:01:23.533062+0000","scrub_duration":0.0072502089999999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1,7],"acting":[2,5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:26.879152+0000","last_change":"2023-08-10T10:33:26.879152+0000","last_active":"2023-08-10T10:33:26.879152+0000","last_peered":"2023-08-10T10:33:26.879152+0000","last_clean":"2023-08-10T10:33:26.879152+0000","last_became_active":"2023-08-10T10:30:28.305562+0000","last_became_peered":"2023-08-10T10:30:28.305562+0000","last_unstale":"2023-08-10T10:33:26.879152+0000","last_undegraded":"2023-08-10T10:33:26.879152+0000","last_fullsized":"2023-08-10T10:33:26.879152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:26.879039+0000","last_clean_scrub_stamp":"2023-08-10T10:33:26.879039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:12:12.596625+0000","scrub_duration":0.001274535,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:34.701154+0000","last_change":"2023-08-10T10:33:34.701154+0000","last_active":"2023-08-10T10:33:34.701154+0000","last_peered":"2023-08-10T10:33:34.701154+0000","last_clean":"2023-08-10T10:33:34.701154+0000","last_became_active":"2023-08-10T10:30:33.318260+0000","last_became_peered":"2023-08-10T10:30:33.318260+0000","last_unstale":"2023-08-10T10:33:34.701154+0000","last_undegraded":"2023-08-10T10:33:34.701154+0000","last_fullsized":"2023-08-10T10:33:34.701154+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:34.701006+0000","last_clean_scrub_stamp":"2023-08-10T10:33:34.701006+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:58.432269+0000","scrub_duration":0.001815002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.665797+0000","last_change":"2023-08-10T10:33:50.665836+0000","last_active":"2023-08-10T10:33:50.665797+0000","last_peered":"2023-08-10T10:33:50.665797+0000","last_clean":"2023-08-10T10:33:50.665797+0000","last_became_active":"2023-08-10T10:30:34.343655+0000","last_became_peered":"2023-08-10T10:30:34.343655+0000","last_unstale":"2023-08-10T10:33:50.665797+0000","last_undegraded":"2023-08-10T10:33:50.665797+0000","last_fullsized":"2023-08-10T10:33:50.665797+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:50.665732+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.665732+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:16.186597+0000","scrub_duration":0.002561823,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"29'454","reported_seq":482,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:26.217209+0000","last_change":"2023-08-10T10:34:26.217209+0000","last_active":"2023-08-10T10:34:26.217209+0000","last_peered":"2023-08-10T10:34:26.217209+0000","last_clean":"2023-08-10T10:34:26.217209+0000","last_became_active":"2023-08-10T10:30:38.392721+0000","last_became_peered":"2023-08-10T10:30:38.392721+0000","last_unstale":"2023-08-10T10:34:26.217209+0000","last_undegraded":"2023-08-10T10:34:26.217209+0000","last_fullsized":"2023-08-10T10:34:26.217209+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'454","last_scrub_stamp":"2023-08-10T10:34:26.217016+0000","last_deep_scrub":"29'454","last_deep_scrub_stamp":"2023-08-10T10:34:26.217016+0000","last_clean_scrub_stamp":"2023-08-10T10:34:26.217016+0000","objects_scrubbed":2,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:08.335479+0000","scrub_duration":0.011650261,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5,3],"acting":[7,2,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.003425+0000","last_change":"2023-08-10T10:33:40.003425+0000","last_active":"2023-08-10T10:33:40.003425+0000","last_peered":"2023-08-10T10:33:40.003425+0000","last_clean":"2023-08-10T10:33:40.003425+0000","last_became_active":"2023-08-10T10:30:28.289135+0000","last_became_peered":"2023-08-10T10:30:28.289135+0000","last_unstale":"2023-08-10T10:33:40.003425+0000","last_undegraded":"2023-08-10T10:33:40.003425+0000","last_fullsized":"2023-08-10T10:33:40.003425+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:40.003286+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.003286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:45.183349+0000","scrub_duration":0.0025616390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"29'119","reported_seq":200,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.300593+0000","last_change":"2023-08-10T10:33:36.300593+0000","last_active":"2023-08-10T10:33:36.300593+0000","last_peered":"2023-08-10T10:33:36.300593+0000","last_clean":"2023-08-10T10:33:36.300593+0000","last_became_active":"2023-08-10T10:30:21.351448+0000","last_became_peered":"2023-08-10T10:30:21.351448+0000","last_unstale":"2023-08-10T10:33:36.300593+0000","last_undegraded":"2023-08-10T10:33:36.300593+0000","last_fullsized":"2023-08-10T10:33:36.300593+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'119","last_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_deep_scrub":"29'119","last_deep_scrub_stamp":"2023-08-10T10:33:36.300423+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.300423+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:52.502488+0000","scrub_duration":0.0062505190000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.276073+0000","last_change":"2023-08-10T10:33:38.276073+0000","last_active":"2023-08-10T10:33:38.276073+0000","last_peered":"2023-08-10T10:33:38.276073+0000","last_clean":"2023-08-10T10:33:38.276073+0000","last_became_active":"2023-08-10T10:30:33.324436+0000","last_became_peered":"2023-08-10T10:30:33.324436+0000","last_unstale":"2023-08-10T10:33:38.276073+0000","last_undegraded":"2023-08-10T10:33:38.276073+0000","last_fullsized":"2023-08-10T10:33:38.276073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.275922+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.275922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:29.593519+0000","scrub_duration":0.002303009,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"29'31","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.794377+0000","last_change":"2023-08-10T10:33:50.794377+0000","last_active":"2023-08-10T10:33:50.794377+0000","last_peered":"2023-08-10T10:33:50.794377+0000","last_clean":"2023-08-10T10:33:50.794377+0000","last_became_active":"2023-08-10T10:30:34.347715+0000","last_became_peered":"2023-08-10T10:30:34.347715+0000","last_unstale":"2023-08-10T10:33:50.794377+0000","last_undegraded":"2023-08-10T10:33:50.794377+0000","last_fullsized":"2023-08-10T10:33:50.794377+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:50.794244+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.794244+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:44:17.570956+0000","scrub_duration":0.0016971849999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"29'427","reported_seq":454,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:28.888589+0000","last_change":"2023-08-10T10:34:28.888675+0000","last_active":"2023-08-10T10:34:28.888589+0000","last_peered":"2023-08-10T10:34:28.888589+0000","last_clean":"2023-08-10T10:34:28.888589+0000","last_became_active":"2023-08-10T10:30:38.410657+0000","last_became_peered":"2023-08-10T10:30:38.410657+0000","last_unstale":"2023-08-10T10:34:28.888589+0000","last_undegraded":"2023-08-10T10:34:28.888589+0000","last_fullsized":"2023-08-10T10:34:28.888589+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'427","last_scrub_stamp":"2023-08-10T10:34:28.888496+0000","last_deep_scrub":"29'427","last_deep_scrub_stamp":"2023-08-10T10:34:28.888496+0000","last_clean_scrub_stamp":"2023-08-10T10:34:28.888496+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:11.006960+0000","scrub_duration":0.0022536040000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0,4],"acting":[5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:38.298484+0000","last_change":"2023-08-10T10:33:38.298484+0000","last_active":"2023-08-10T10:33:38.298484+0000","last_peered":"2023-08-10T10:33:38.298484+0000","last_clean":"2023-08-10T10:33:38.298484+0000","last_became_active":"2023-08-10T10:30:28.283699+0000","last_became_peered":"2023-08-10T10:30:28.283699+0000","last_unstale":"2023-08-10T10:33:38.298484+0000","last_undegraded":"2023-08-10T10:33:38.298484+0000","last_fullsized":"2023-08-10T10:33:38.298484+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:38.298353+0000","last_clean_scrub_stamp":"2023-08-10T10:33:38.298353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:39:43.478416+0000","scrub_duration":0.002283045,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"29'16","reported_seq":67,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.996902+0000","last_change":"2023-08-10T10:33:30.996902+0000","last_active":"2023-08-10T10:33:30.996902+0000","last_peered":"2023-08-10T10:33:30.996902+0000","last_clean":"2023-08-10T10:33:30.996902+0000","last_became_active":"2023-08-10T10:30:33.324090+0000","last_became_peered":"2023-08-10T10:30:33.324090+0000","last_unstale":"2023-08-10T10:33:30.996902+0000","last_undegraded":"2023-08-10T10:33:30.996902+0000","last_fullsized":"2023-08-10T10:33:30.996902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'16","last_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_deep_scrub":"29'16","last_deep_scrub_stamp":"2023-08-10T10:33:30.996769+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.996769+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:14.424734+0000","scrub_duration":0.0026543970000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7752,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":15,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"29'29","reported_seq":62,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.986781+0000","last_change":"2023-08-10T10:33:43.986851+0000","last_active":"2023-08-10T10:33:43.986781+0000","last_peered":"2023-08-10T10:33:43.986781+0000","last_clean":"2023-08-10T10:33:43.986781+0000","last_became_active":"2023-08-10T10:30:34.335346+0000","last_became_peered":"2023-08-10T10:30:34.335346+0000","last_unstale":"2023-08-10T10:33:43.986781+0000","last_undegraded":"2023-08-10T10:33:43.986781+0000","last_fullsized":"2023-08-10T10:33:43.986781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'29","last_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_deep_scrub":"29'29","last_deep_scrub_stamp":"2023-08-10T10:33:43.986673+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.986673+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:08:35.304270+0000","scrub_duration":0.001579366,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"29'472","reported_seq":500,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:01.658788+0000","last_change":"2023-08-10T10:34:01.658788+0000","last_active":"2023-08-10T10:34:01.658788+0000","last_peered":"2023-08-10T10:34:01.658788+0000","last_clean":"2023-08-10T10:34:01.658788+0000","last_became_active":"2023-08-10T10:30:38.392452+0000","last_became_peered":"2023-08-10T10:30:38.392452+0000","last_unstale":"2023-08-10T10:34:01.658788+0000","last_undegraded":"2023-08-10T10:34:01.658788+0000","last_fullsized":"2023-08-10T10:34:01.658788+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'472","last_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_deep_scrub":"29'472","last_deep_scrub_stamp":"2023-08-10T10:34:01.658617+0000","last_clean_scrub_stamp":"2023-08-10T10:34:01.658617+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:08:25.389881+0000","scrub_duration":0.0024055499999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":26624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,2],"acting":[6,0,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.330818+0000","last_change":"2023-08-10T10:33:41.330818+0000","last_active":"2023-08-10T10:33:41.330818+0000","last_peered":"2023-08-10T10:33:41.330818+0000","last_clean":"2023-08-10T10:33:41.330818+0000","last_became_active":"2023-08-10T10:30:28.301944+0000","last_became_peered":"2023-08-10T10:30:28.301944+0000","last_unstale":"2023-08-10T10:33:41.330818+0000","last_undegraded":"2023-08-10T10:33:41.330818+0000","last_fullsized":"2023-08-10T10:33:41.330818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:41.330658+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.330658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:14:48.111867+0000","scrub_duration":0.001792685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"29'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:35.662823+0000","last_change":"2023-08-10T10:33:35.662823+0000","last_active":"2023-08-10T10:33:35.662823+0000","last_peered":"2023-08-10T10:33:35.662823+0000","last_clean":"2023-08-10T10:33:35.662823+0000","last_became_active":"2023-08-10T10:30:33.318170+0000","last_became_peered":"2023-08-10T10:30:33.318170+0000","last_unstale":"2023-08-10T10:33:35.662823+0000","last_undegraded":"2023-08-10T10:33:35.662823+0000","last_fullsized":"2023-08-10T10:33:35.662823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'1","last_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_deep_scrub":"29'1","last_deep_scrub_stamp":"2023-08-10T10:33:35.662682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:35.662682+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:26:19.090646+0000","scrub_duration":0.0017149699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"29'34","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:49.073816+0000","last_change":"2023-08-10T10:33:49.073816+0000","last_active":"2023-08-10T10:33:49.073816+0000","last_peered":"2023-08-10T10:33:49.073816+0000","last_clean":"2023-08-10T10:33:49.073816+0000","last_became_active":"2023-08-10T10:30:34.336871+0000","last_became_peered":"2023-08-10T10:30:34.336871+0000","last_unstale":"2023-08-10T10:33:49.073816+0000","last_undegraded":"2023-08-10T10:33:49.073816+0000","last_fullsized":"2023-08-10T10:33:49.073816+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:33:49.073691+0000","last_clean_scrub_stamp":"2023-08-10T10:33:49.073691+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:44.539389+0000","scrub_duration":0.002661442,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"29'511","reported_seq":539,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:32.847438+0000","last_change":"2023-08-10T10:34:32.847438+0000","last_active":"2023-08-10T10:34:32.847438+0000","last_peered":"2023-08-10T10:34:32.847438+0000","last_clean":"2023-08-10T10:34:32.847438+0000","last_became_active":"2023-08-10T10:30:38.402150+0000","last_became_peered":"2023-08-10T10:30:38.402150+0000","last_unstale":"2023-08-10T10:34:32.847438+0000","last_undegraded":"2023-08-10T10:34:32.847438+0000","last_fullsized":"2023-08-10T10:34:32.847438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'511","last_scrub_stamp":"2023-08-10T10:34:32.847265+0000","last_deep_scrub":"29'511","last_deep_scrub_stamp":"2023-08-10T10:34:32.847265+0000","last_clean_scrub_stamp":"2023-08-10T10:34:32.847265+0000","objects_scrubbed":1,"log_size":511,"log_dups_size":0,"ondisk_log_size":511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T10:44:46.742487+0000","scrub_duration":0.0076731890000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7,0],"acting":[4,3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"29'4","reported_seq":39,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:41.311638+0000","last_change":"2023-08-10T10:33:41.311696+0000","last_active":"2023-08-10T10:33:41.311638+0000","last_peered":"2023-08-10T10:33:41.311638+0000","last_clean":"2023-08-10T10:33:41.311638+0000","last_became_active":"2023-08-10T10:30:33.322369+0000","last_became_peered":"2023-08-10T10:30:33.322369+0000","last_unstale":"2023-08-10T10:33:41.311638+0000","last_undegraded":"2023-08-10T10:33:41.311638+0000","last_fullsized":"2023-08-10T10:33:41.311638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'4","last_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_deep_scrub":"29'4","last_deep_scrub_stamp":"2023-08-10T10:33:41.311549+0000","last_clean_scrub_stamp":"2023-08-10T10:33:41.311549+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:25.214215+0000","scrub_duration":0.0039921610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:32.706856+0000","last_change":"2023-08-10T10:33:32.706856+0000","last_active":"2023-08-10T10:33:32.706856+0000","last_peered":"2023-08-10T10:33:32.706856+0000","last_clean":"2023-08-10T10:33:32.706856+0000","last_became_active":"2023-08-10T10:30:28.287534+0000","last_became_peered":"2023-08-10T10:30:28.287534+0000","last_unstale":"2023-08-10T10:33:32.706856+0000","last_undegraded":"2023-08-10T10:33:32.706856+0000","last_fullsized":"2023-08-10T10:33:32.706856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:32.706726+0000","last_clean_scrub_stamp":"2023-08-10T10:33:32.706726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:24:57.652318+0000","scrub_duration":0.002258688,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"29'24","reported_seq":58,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.211173+0000","last_change":"2023-08-10T10:33:29.211173+0000","last_active":"2023-08-10T10:33:29.211173+0000","last_peered":"2023-08-10T10:33:29.211173+0000","last_clean":"2023-08-10T10:33:29.211173+0000","last_became_active":"2023-08-10T10:30:34.333921+0000","last_became_peered":"2023-08-10T10:30:34.333921+0000","last_unstale":"2023-08-10T10:33:29.211173+0000","last_undegraded":"2023-08-10T10:33:29.211173+0000","last_fullsized":"2023-08-10T10:33:29.211173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:29.211063+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.211063+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:47:45.413129+0000","scrub_duration":0.0022425100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"29'450","reported_seq":478,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:28.675083+0000","last_change":"2023-08-10T10:34:28.675083+0000","last_active":"2023-08-10T10:34:28.675083+0000","last_peered":"2023-08-10T10:34:28.675083+0000","last_clean":"2023-08-10T10:34:28.675083+0000","last_became_active":"2023-08-10T10:30:38.404332+0000","last_became_peered":"2023-08-10T10:30:38.404332+0000","last_unstale":"2023-08-10T10:34:28.675083+0000","last_undegraded":"2023-08-10T10:34:28.675083+0000","last_fullsized":"2023-08-10T10:34:28.675083+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'450","last_scrub_stamp":"2023-08-10T10:34:28.674912+0000","last_deep_scrub":"29'450","last_deep_scrub_stamp":"2023-08-10T10:34:28.674912+0000","last_clean_scrub_stamp":"2023-08-10T10:34:28.674912+0000","objects_scrubbed":1,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:35:32.655381+0000","scrub_duration":0.0068997290000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,0],"acting":[3,1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":42,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:29.820813+0000","last_change":"2023-08-10T10:33:29.820813+0000","last_active":"2023-08-10T10:33:29.820813+0000","last_peered":"2023-08-10T10:33:29.820813+0000","last_clean":"2023-08-10T10:33:29.820813+0000","last_became_active":"2023-08-10T10:30:28.288220+0000","last_became_peered":"2023-08-10T10:30:28.288220+0000","last_unstale":"2023-08-10T10:33:29.820813+0000","last_undegraded":"2023-08-10T10:33:29.820813+0000","last_fullsized":"2023-08-10T10:33:29.820813+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-10T10:33:29.820682+0000","last_clean_scrub_stamp":"2023-08-10T10:33:29.820682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:29:15.382461+0000","scrub_duration":0.0016165769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"29'13","reported_seq":48,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:30.024844+0000","last_change":"2023-08-10T10:33:30.024886+0000","last_active":"2023-08-10T10:33:30.024844+0000","last_peered":"2023-08-10T10:33:30.024844+0000","last_clean":"2023-08-10T10:33:30.024844+0000","last_became_active":"2023-08-10T10:30:33.322038+0000","last_became_peered":"2023-08-10T10:30:33.322038+0000","last_unstale":"2023-08-10T10:33:30.024844+0000","last_undegraded":"2023-08-10T10:33:30.024844+0000","last_fullsized":"2023-08-10T10:33:30.024844+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'13","last_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_deep_scrub":"29'13","last_deep_scrub_stamp":"2023-08-10T10:33:30.024779+0000","last_clean_scrub_stamp":"2023-08-10T10:33:30.024779+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:07:53.756043+0000","scrub_duration":0.001678323,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"29'22","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:05.628254+0000","last_change":"2023-08-10T10:34:05.628254+0000","last_active":"2023-08-10T10:34:05.628254+0000","last_peered":"2023-08-10T10:34:05.628254+0000","last_clean":"2023-08-10T10:34:05.628254+0000","last_became_active":"2023-08-10T10:30:34.341623+0000","last_became_peered":"2023-08-10T10:30:34.341623+0000","last_unstale":"2023-08-10T10:34:05.628254+0000","last_undegraded":"2023-08-10T10:34:05.628254+0000","last_fullsized":"2023-08-10T10:34:05.628254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'22","last_scrub_stamp":"2023-08-10T10:34:05.628079+0000","last_deep_scrub":"29'22","last_deep_scrub_stamp":"2023-08-10T10:34:05.628079+0000","last_clean_scrub_stamp":"2023-08-10T10:34:05.628079+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:23:59.234795+0000","scrub_duration":0.0018251680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"29'436","reported_seq":463,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.730477+0000","last_change":"2023-08-10T10:33:55.730594+0000","last_active":"2023-08-10T10:33:55.730477+0000","last_peered":"2023-08-10T10:33:55.730477+0000","last_clean":"2023-08-10T10:33:55.730477+0000","last_became_active":"2023-08-10T10:30:38.396782+0000","last_became_peered":"2023-08-10T10:30:38.396782+0000","last_unstale":"2023-08-10T10:33:55.730477+0000","last_undegraded":"2023-08-10T10:33:55.730477+0000","last_fullsized":"2023-08-10T10:33:55.730477+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'436","last_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_deep_scrub":"29'436","last_deep_scrub_stamp":"2023-08-10T10:33:55.730389+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.730389+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T17:18:17.182651+0000","scrub_duration":0.0023941240000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,0],"acting":[1,3,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":36,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:28.996535+0000","last_change":"2023-08-10T10:33:28.996619+0000","last_active":"2023-08-10T10:33:28.996535+0000","last_peered":"2023-08-10T10:33:28.996535+0000","last_clean":"2023-08-10T10:33:28.996535+0000","last_became_active":"2023-08-10T10:30:33.323476+0000","last_became_peered":"2023-08-10T10:30:33.323476+0000","last_unstale":"2023-08-10T10:33:28.996535+0000","last_undegraded":"2023-08-10T10:33:28.996535+0000","last_fullsized":"2023-08-10T10:33:28.996535+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:28.996417+0000","last_clean_scrub_stamp":"2023-08-10T10:33:28.996417+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:49:59.325457+0000","scrub_duration":0.00214364,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.761702+0000","last_change":"2023-08-10T10:33:43.761757+0000","last_active":"2023-08-10T10:33:43.761702+0000","last_peered":"2023-08-10T10:33:43.761702+0000","last_clean":"2023-08-10T10:33:43.761702+0000","last_became_active":"2023-08-10T10:30:34.332106+0000","last_became_peered":"2023-08-10T10:30:34.332106+0000","last_unstale":"2023-08-10T10:33:43.761702+0000","last_undegraded":"2023-08-10T10:33:43.761702+0000","last_fullsized":"2023-08-10T10:33:43.761702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:43.761621+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.761621+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T22:18:33.933062+0000","scrub_duration":0.0016532879999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"29'485","reported_seq":512,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:21.297908+0000","last_change":"2023-08-10T10:34:21.297989+0000","last_active":"2023-08-10T10:34:21.297908+0000","last_peered":"2023-08-10T10:34:21.297908+0000","last_clean":"2023-08-10T10:34:21.297908+0000","last_became_active":"2023-08-10T10:30:38.406584+0000","last_became_peered":"2023-08-10T10:30:38.406584+0000","last_unstale":"2023-08-10T10:34:21.297908+0000","last_undegraded":"2023-08-10T10:34:21.297908+0000","last_fullsized":"2023-08-10T10:34:21.297908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'485","last_scrub_stamp":"2023-08-10T10:34:21.297813+0000","last_deep_scrub":"29'485","last_deep_scrub_stamp":"2023-08-10T10:34:21.297813+0000","last_clean_scrub_stamp":"2023-08-10T10:34:21.297813+0000","objects_scrubbed":2,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T19:09:03.055208+0000","scrub_duration":0.012121412999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1,6],"acting":[7,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"29'3","reported_seq":38,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.019552+0000","last_change":"2023-08-10T10:33:50.019623+0000","last_active":"2023-08-10T10:33:50.019552+0000","last_peered":"2023-08-10T10:33:50.019552+0000","last_clean":"2023-08-10T10:33:50.019552+0000","last_became_active":"2023-08-10T10:30:33.326367+0000","last_became_peered":"2023-08-10T10:30:33.326367+0000","last_unstale":"2023-08-10T10:33:50.019552+0000","last_undegraded":"2023-08-10T10:33:50.019552+0000","last_fullsized":"2023-08-10T10:33:50.019552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'3","last_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_deep_scrub":"29'3","last_deep_scrub_stamp":"2023-08-10T10:33:50.019471+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.019471+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:34:15.540336+0000","scrub_duration":0.0030648339999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"29'24","reported_seq":57,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:44.471463+0000","last_change":"2023-08-10T10:33:44.471546+0000","last_active":"2023-08-10T10:33:44.471463+0000","last_peered":"2023-08-10T10:33:44.471463+0000","last_clean":"2023-08-10T10:33:44.471463+0000","last_became_active":"2023-08-10T10:30:34.336093+0000","last_became_peered":"2023-08-10T10:30:34.336093+0000","last_unstale":"2023-08-10T10:33:44.471463+0000","last_undegraded":"2023-08-10T10:33:44.471463+0000","last_fullsized":"2023-08-10T10:33:44.471463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'24","last_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_deep_scrub":"29'24","last_deep_scrub_stamp":"2023-08-10T10:33:44.471356+0000","last_clean_scrub_stamp":"2023-08-10T10:33:44.471356+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:21:07.840953+0000","scrub_duration":0.0024103369999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"29'484","reported_seq":511,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:22.859098+0000","last_change":"2023-08-10T10:34:22.859178+0000","last_active":"2023-08-10T10:34:22.859098+0000","last_peered":"2023-08-10T10:34:22.859098+0000","last_clean":"2023-08-10T10:34:22.859098+0000","last_became_active":"2023-08-10T10:30:38.406514+0000","last_became_peered":"2023-08-10T10:30:38.406514+0000","last_unstale":"2023-08-10T10:34:22.859098+0000","last_undegraded":"2023-08-10T10:34:22.859098+0000","last_fullsized":"2023-08-10T10:34:22.859098+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'484","last_scrub_stamp":"2023-08-10T10:34:22.859001+0000","last_deep_scrub":"29'484","last_deep_scrub_stamp":"2023-08-10T10:34:22.859001+0000","last_clean_scrub_stamp":"2023-08-10T10:34:22.859001+0000","objects_scrubbed":2,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:57:11.952489+0000","scrub_duration":0.011800982999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7,4],"acting":[5,0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1d","version":"29'5","reported_seq":40,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:50.974225+0000","last_change":"2023-08-10T10:33:50.974281+0000","last_active":"2023-08-10T10:33:50.974225+0000","last_peered":"2023-08-10T10:33:50.974225+0000","last_clean":"2023-08-10T10:33:50.974225+0000","last_became_active":"2023-08-10T10:30:33.326310+0000","last_became_peered":"2023-08-10T10:30:33.326310+0000","last_unstale":"2023-08-10T10:33:50.974225+0000","last_undegraded":"2023-08-10T10:33:50.974225+0000","last_fullsized":"2023-08-10T10:33:50.974225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'5","last_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_deep_scrub":"29'5","last_deep_scrub_stamp":"2023-08-10T10:33:50.974148+0000","last_clean_scrub_stamp":"2023-08-10T10:33:50.974148+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T13:05:34.876814+0000","scrub_duration":0.0029544839999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"29'23","reported_seq":56,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:43.421729+0000","last_change":"2023-08-10T10:33:43.421786+0000","last_active":"2023-08-10T10:33:43.421729+0000","last_peered":"2023-08-10T10:33:43.421729+0000","last_clean":"2023-08-10T10:33:43.421729+0000","last_became_active":"2023-08-10T10:30:34.336188+0000","last_became_peered":"2023-08-10T10:30:34.336188+0000","last_unstale":"2023-08-10T10:33:43.421729+0000","last_undegraded":"2023-08-10T10:33:43.421729+0000","last_fullsized":"2023-08-10T10:33:43.421729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'23","last_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_deep_scrub":"29'23","last_deep_scrub_stamp":"2023-08-10T10:33:43.421640+0000","last_clean_scrub_stamp":"2023-08-10T10:33:43.421640+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:09.069900+0000","scrub_duration":0.0020388680000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"29'470","reported_seq":497,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:36.798559+0000","last_change":"2023-08-10T10:34:36.798656+0000","last_active":"2023-08-10T10:34:36.798559+0000","last_peered":"2023-08-10T10:34:36.798559+0000","last_clean":"2023-08-10T10:34:36.798559+0000","last_became_active":"2023-08-10T10:30:38.406312+0000","last_became_peered":"2023-08-10T10:30:38.406312+0000","last_unstale":"2023-08-10T10:34:36.798559+0000","last_undegraded":"2023-08-10T10:34:36.798559+0000","last_fullsized":"2023-08-10T10:34:36.798559+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'470","last_scrub_stamp":"2023-08-10T10:34:36.798431+0000","last_deep_scrub":"29'470","last_deep_scrub_stamp":"2023-08-10T10:34:36.798431+0000","last_clean_scrub_stamp":"2023-08-10T10:34:36.798431+0000","objects_scrubbed":1,"log_size":470,"log_dups_size":0,"ondisk_log_size":470,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T21:36:47.371945+0000","scrub_duration":0.0066695510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,2],"acting":[4,6,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":37,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:55.286501+0000","last_change":"2023-08-10T10:33:55.286501+0000","last_active":"2023-08-10T10:33:55.286501+0000","last_peered":"2023-08-10T10:33:55.286501+0000","last_clean":"2023-08-10T10:33:55.286501+0000","last_became_active":"2023-08-10T10:30:33.317481+0000","last_became_peered":"2023-08-10T10:30:33.317481+0000","last_unstale":"2023-08-10T10:33:55.286501+0000","last_undegraded":"2023-08-10T10:33:55.286501+0000","last_fullsized":"2023-08-10T10:33:55.286501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"22'1","last_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_deep_scrub":"22'1","last_deep_scrub_stamp":"2023-08-10T10:33:55.286354+0000","last_clean_scrub_stamp":"2023-08-10T10:33:55.286354+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:43:20.934614+0000","scrub_duration":0.0020151869999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"29'32","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:22.579185+0000","last_change":"2023-08-10T10:34:22.579240+0000","last_active":"2023-08-10T10:34:22.579185+0000","last_peered":"2023-08-10T10:34:22.579185+0000","last_clean":"2023-08-10T10:34:22.579185+0000","last_became_active":"2023-08-10T10:30:34.335067+0000","last_became_peered":"2023-08-10T10:30:34.335067+0000","last_unstale":"2023-08-10T10:34:22.579185+0000","last_undegraded":"2023-08-10T10:34:22.579185+0000","last_fullsized":"2023-08-10T10:34:22.579185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'32","last_scrub_stamp":"2023-08-10T10:34:22.579103+0000","last_deep_scrub":"29'32","last_deep_scrub_stamp":"2023-08-10T10:34:22.579103+0000","last_clean_scrub_stamp":"2023-08-10T10:34:22.579103+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T14:49:04.697567+0000","scrub_duration":0.0015950129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"29'462","reported_seq":489,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.689362+0000","last_change":"2023-08-10T10:33:52.689490+0000","last_active":"2023-08-10T10:33:52.689362+0000","last_peered":"2023-08-10T10:33:52.689362+0000","last_clean":"2023-08-10T10:33:52.689362+0000","last_became_active":"2023-08-10T10:30:38.392454+0000","last_became_peered":"2023-08-10T10:30:38.392454+0000","last_unstale":"2023-08-10T10:33:52.689362+0000","last_undegraded":"2023-08-10T10:33:52.689362+0000","last_fullsized":"2023-08-10T10:33:52.689362+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'462","last_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_deep_scrub":"29'462","last_deep_scrub_stamp":"2023-08-10T10:33:52.689260+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.689260+0000","objects_scrubbed":1,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T11:49:48.154957+0000","scrub_duration":0.0069198020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":35840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,2],"acting":[1,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1f","version":"29'7","reported_seq":43,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:36.996650+0000","last_change":"2023-08-10T10:33:36.996650+0000","last_active":"2023-08-10T10:33:36.996650+0000","last_peered":"2023-08-10T10:33:36.996650+0000","last_clean":"2023-08-10T10:33:36.996650+0000","last_became_active":"2023-08-10T10:30:33.326156+0000","last_became_peered":"2023-08-10T10:30:33.326156+0000","last_unstale":"2023-08-10T10:33:36.996650+0000","last_undegraded":"2023-08-10T10:33:36.996650+0000","last_fullsized":"2023-08-10T10:33:36.996650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'7","last_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_deep_scrub":"29'7","last_deep_scrub_stamp":"2023-08-10T10:33:36.996505+0000","last_clean_scrub_stamp":"2023-08-10T10:33:36.996505+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:48.485764+0000","scrub_duration":0.004534967,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"29'43","reported_seq":76,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:52.491588+0000","last_change":"2023-08-10T10:33:52.491684+0000","last_active":"2023-08-10T10:33:52.491588+0000","last_peered":"2023-08-10T10:33:52.491588+0000","last_clean":"2023-08-10T10:33:52.491588+0000","last_became_active":"2023-08-10T10:30:34.344511+0000","last_became_peered":"2023-08-10T10:30:34.344511+0000","last_unstale":"2023-08-10T10:33:52.491588+0000","last_undegraded":"2023-08-10T10:33:52.491588+0000","last_fullsized":"2023-08-10T10:33:52.491588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'43","last_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_deep_scrub":"29'43","last_deep_scrub_stamp":"2023-08-10T10:33:52.491476+0000","last_clean_scrub_stamp":"2023-08-10T10:33:52.491476+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:41.003245+0000","scrub_duration":0.0016911809999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"29'48","reported_seq":82,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:40.879272+0000","last_change":"2023-08-10T10:33:40.879272+0000","last_active":"2023-08-10T10:33:40.879272+0000","last_peered":"2023-08-10T10:33:40.879272+0000","last_clean":"2023-08-10T10:33:40.879272+0000","last_became_active":"2023-08-10T10:30:34.346295+0000","last_became_peered":"2023-08-10T10:30:34.346295+0000","last_unstale":"2023-08-10T10:33:40.879272+0000","last_undegraded":"2023-08-10T10:33:40.879272+0000","last_fullsized":"2023-08-10T10:33:40.879272+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'48","last_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_deep_scrub":"29'48","last_deep_scrub_stamp":"2023-08-10T10:33:40.879137+0000","last_clean_scrub_stamp":"2023-08-10T10:33:40.879137+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T12:03:38.333811+0000","scrub_duration":0.0022235739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"29'46","reported_seq":80,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:26.605875+0000","last_change":"2023-08-10T10:34:26.605875+0000","last_active":"2023-08-10T10:34:26.605875+0000","last_peered":"2023-08-10T10:34:26.605875+0000","last_clean":"2023-08-10T10:34:26.605875+0000","last_became_active":"2023-08-10T10:30:34.335647+0000","last_became_peered":"2023-08-10T10:30:34.335647+0000","last_unstale":"2023-08-10T10:34:26.605875+0000","last_undegraded":"2023-08-10T10:34:26.605875+0000","last_fullsized":"2023-08-10T10:34:26.605875+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'46","last_scrub_stamp":"2023-08-10T10:34:26.605734+0000","last_deep_scrub":"29'46","last_deep_scrub_stamp":"2023-08-10T10:34:26.605734+0000","last_clean_scrub_stamp":"2023-08-10T10:34:26.605734+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T15:48:53.406567+0000","scrub_duration":0.0015678619999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"29'34","reported_seq":68,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:18.831014+0000","last_change":"2023-08-10T10:34:18.831014+0000","last_active":"2023-08-10T10:34:18.831014+0000","last_peered":"2023-08-10T10:34:18.831014+0000","last_clean":"2023-08-10T10:34:18.831014+0000","last_became_active":"2023-08-10T10:30:34.344397+0000","last_became_peered":"2023-08-10T10:30:34.344397+0000","last_unstale":"2023-08-10T10:34:18.831014+0000","last_undegraded":"2023-08-10T10:34:18.831014+0000","last_fullsized":"2023-08-10T10:34:18.831014+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'34","last_scrub_stamp":"2023-08-10T10:34:18.830848+0000","last_deep_scrub":"29'34","last_deep_scrub_stamp":"2023-08-10T10:34:18.830848+0000","last_clean_scrub_stamp":"2023-08-10T10:34:18.830848+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:33:57.170586+0000","scrub_duration":0.001692795,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"29'31","reported_seq":65,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:34:05.281001+0000","last_change":"2023-08-10T10:34:05.281001+0000","last_active":"2023-08-10T10:34:05.281001+0000","last_peered":"2023-08-10T10:34:05.281001+0000","last_clean":"2023-08-10T10:34:05.281001+0000","last_became_active":"2023-08-10T10:30:34.350718+0000","last_became_peered":"2023-08-10T10:30:34.350718+0000","last_unstale":"2023-08-10T10:34:05.281001+0000","last_undegraded":"2023-08-10T10:34:05.281001+0000","last_fullsized":"2023-08-10T10:34:05.281001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:34:05.280866+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:34:05.280866+0000","last_clean_scrub_stamp":"2023-08-10T10:34:05.280866+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T18:58:53.792635+0000","scrub_duration":0.002470163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"29'31","reported_seq":64,"reported_epoch":29,"state":"active+clean","last_fresh":"2023-08-10T10:33:25.806229+0000","last_change":"2023-08-10T10:33:25.806268+0000","last_active":"2023-08-10T10:33:25.806229+0000","last_peered":"2023-08-10T10:33:25.806229+0000","last_clean":"2023-08-10T10:33:25.806229+0000","last_became_active":"2023-08-10T10:30:34.344763+0000","last_became_peered":"2023-08-10T10:30:34.344763+0000","last_unstale":"2023-08-10T10:33:25.806229+0000","last_undegraded":"2023-08-10T10:33:25.806229+0000","last_fullsized":"2023-08-10T10:33:25.806229+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"29'31","last_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_deep_scrub":"29'31","last_deep_scrub_stamp":"2023-08-10T10:33:25.806161+0000","last_clean_scrub_stamp":"2023-08-10T10:33:25.806161+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-08-11T16:49:38.537991+0000","scrub_duration":0.0024102640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":111149056,"num_objects":28,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":511,"num_write_kb":1076224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":222298112,"data_stored":222298112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14883,"ondisk_log_size":14883,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2048,"ondisk_log_size":2048,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2150615,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":15,"num_read_kb":18,"num_write":712,"num_write_kb":2599,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4358144,"data_stored":4301230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":728,"ondisk_log_size":728,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":76612,"kb_used_data":41404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94295228,"statfs":{"total":96636764160,"available":96558313472,"internally_reserved":0,"allocated":42397696,"data_stored":42188424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":1.097,"15min":0.78600000000000003},"min":{"1min":0.42699999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.98999999999999999,"5min":9.3949999999999996,"15min":9.3949999999999996},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73199999999999998,"5min":1.2130000000000001,"15min":0.79300000000000004},"min":{"1min":0.52400000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98999999999999999,"5min":22.190999999999999,"15min":22.190999999999999},"last":0.75}]},{"osd":1,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":1.115,"15min":0.77500000000000002},"min":{"1min":0.55000000000000004,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92800000000000005,"5min":17.917000000000002,"15min":17.917000000000002},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":1.167,"15min":0.85399999999999998},"min":{"1min":0.53000000000000003,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.877,"5min":12.194000000000001,"15min":12.194000000000001},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.2649999999999999,"15min":0.93100000000000005},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":0.94999999999999996,"5min":21.042999999999999,"15min":21.042999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.3300000000000001,"15min":0.92200000000000004},"min":{"1min":0.5,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.98499999999999999,"5min":22.148,"15min":22.148},"last":0.81000000000000005}]},{"osd":3,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":1.1240000000000001,"15min":0.82599999999999996},"min":{"1min":0.52200000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.89800000000000002,"5min":10.237,"15min":10.237},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.78800000000000003,"5min":1.27,"15min":0.94299999999999995},"min":{"1min":0.60499999999999998,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.95799999999999996,"5min":9.4320000000000004,"15min":9.4320000000000004},"last":0.79500000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.92000000000000004,"15min":0.75800000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77500000000000002,"5min":7.4500000000000002,"15min":7.4500000000000002},"last":0.442},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.999,"15min":0.79200000000000004},"min":{"1min":0.48999999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.83599999999999997,"5min":11.779,"15min":11.779},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.84599999999999997,"15min":0.80500000000000005},"min":{"1min":0.44400000000000001,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.86499999999999999,"5min":7.3700000000000001,"15min":7.3700000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.98899999999999999,"15min":0.85099999999999998},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.79700000000000004,"5min":9.1950000000000003,"15min":9.1950000000000003},"last":0.56999999999999995}]},{"osd":6,"last update":"Thu Aug 10 10:34:29 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":1.0640000000000001,"15min":0.88800000000000001},"min":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.88300000000000001,"5min":8.4290000000000003,"15min":8.4290000000000003},"last":0.501},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.94399999999999995,"15min":0.79200000000000004},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86499999999999999,"5min":7.3460000000000001,"15min":7.3460000000000001},"last":0.41499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48316,"kb_used_data":17204,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94323524,"statfs":{"total":96636764160,"available":96587288576,"internally_reserved":0,"allocated":17616896,"data_stored":17435679,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.3069999999999999,"15min":0.91600000000000004},"min":{"1min":0.58499999999999996,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.93400000000000005,"5min":9.5030000000000001,"15min":9.5030000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":1.331,"15min":0.95399999999999996},"min":{"1min":0.54400000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.034,"5min":11.911,"15min":11.911},"last":0.65400000000000003}]},{"osd":1,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":1.5429999999999999,"15min":1.0049999999999999},"min":{"1min":0.45800000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.874,"5min":14.93,"15min":14.93},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.75700000000000001,"5min":1.286,"15min":0.93000000000000005},"min":{"1min":0.46000000000000002,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.95199999999999996,"5min":11.836,"15min":11.836},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.3580000000000001,"15min":0.92400000000000004},"min":{"1min":0.50800000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.89600000000000002,"5min":19.654,"15min":19.654},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.79900000000000004,"5min":1.393,"15min":0.94999999999999996},"min":{"1min":0.58999999999999997,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97899999999999998,"5min":12.848000000000001,"15min":12.848000000000001},"last":0.748}]},{"osd":3,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":1.5740000000000001,"15min":1.036},"min":{"1min":0.51800000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89700000000000002,"5min":16.934000000000001,"15min":16.934000000000001},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.75900000000000001,"5min":1.427,"15min":0.998},"min":{"1min":0.56299999999999994,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.012,"5min":19.907,"15min":19.907},"last":0.67000000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.95099999999999996,"15min":0.749},"min":{"1min":0.42099999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.751,"5min":5.984,"15min":5.984},"last":0.629},{"interface":"front","average":{"1min":0.622,"5min":0.998,"15min":0.80400000000000005},"min":{"1min":0.45800000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.81200000000000006,"5min":11.94,"15min":11.94},"last":0.41899999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.96199999999999997,"15min":0.78300000000000003},"min":{"1min":0.47199999999999998,"5min":0.435,"15min":0.435},"max":{"1min":0.78600000000000003,"5min":6.0510000000000002,"15min":6.0510000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.94699999999999995,"15min":0.81399999999999995},"min":{"1min":0.5,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.88600000000000001,"5min":6.0110000000000001,"15min":6.0110000000000001},"last":0.54300000000000004}]},{"osd":7,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.99299999999999999,"15min":0.83899999999999997},"min":{"1min":0.57699999999999996,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.85699999999999998,"5min":5.577,"15min":5.577},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.1100000000000001,"15min":0.879},"min":{"1min":0.52100000000000002,"5min":0.502,"15min":0.502},"max":{"1min":0.89000000000000001,"5min":8.1639999999999997,"15min":8.1639999999999997},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":66748,"kb_used_data":31540,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94305092,"statfs":{"total":96636764160,"available":96568414208,"internally_reserved":0,"allocated":32296960,"data_stored":32115743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.44800000000000001,"5min":0.68200000000000005,"15min":0.50800000000000001},"min":{"1min":0.307,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.627,"5min":10.212999999999999,"15min":10.212999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.73999999999999999,"15min":0.54000000000000004},"min":{"1min":0.32700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.59099999999999997,"5min":6.46,"15min":6.46},"last":0.5}]},{"osd":2,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.95799999999999996,"15min":0.622},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.65000000000000002,"5min":13.24,"15min":13.24},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.80900000000000005,"15min":0.621},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77700000000000002,"5min":5.0270000000000001,"15min":5.0270000000000001},"last":0.60699999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.73899999999999999,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":5.0970000000000004,"15min":5.0970000000000004},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.71799999999999997,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.84399999999999997,"5min":8.4930000000000003,"15min":8.4930000000000003},"last":0.67600000000000005}]},{"osd":4,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":1.351,"15min":0.93300000000000005},"min":{"1min":0.498,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.92100000000000004,"5min":11.635,"15min":11.635},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":1.518,"15min":1.006},"min":{"1min":0.57699999999999996,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.052,"5min":14.271000000000001,"15min":14.271000000000001},"last":0.93999999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":1.292,"15min":0.91300000000000003},"min":{"1min":0.57599999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.022,"5min":10.444000000000001,"15min":10.444000000000001},"last":1.0569999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":1.7709999999999999,"15min":1.119},"min":{"1min":0.56000000000000005,"5min":0.505,"15min":0.505},"max":{"1min":0.96599999999999997,"5min":21.681999999999999,"15min":21.681999999999999},"last":1.071}]},{"osd":6,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":1.1719999999999999,"15min":0.92600000000000005},"min":{"1min":0.60699999999999998,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.95699999999999996,"5min":10.516,"15min":10.516},"last":1.0900000000000001},{"interface":"front","average":{"1min":0.78600000000000003,"5min":1.4930000000000001,"15min":1.044},"min":{"1min":0.59499999999999997,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.0309999999999999,"5min":14.295999999999999,"15min":14.295999999999999},"last":0.89900000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.127,"15min":0.92600000000000005},"min":{"1min":0.60699999999999998,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.089,"5min":6,"15min":6},"last":1.03},{"interface":"front","average":{"1min":0.80500000000000005,"5min":1.6850000000000001,"15min":1.097},"min":{"1min":0.63300000000000001,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0680000000000001,"5min":31.629999999999999,"15min":31.629999999999999},"last":0.99199999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62216,"kb_used_data":27008,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94309624,"statfs":{"total":96636764160,"available":96573054976,"internally_reserved":0,"allocated":27656192,"data_stored":27470546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.81299999999999994,"15min":0.66100000000000003},"min":{"1min":0.29999999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.73199999999999998,"5min":6.0490000000000004,"15min":6.0490000000000004},"last":0.434},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.83199999999999996,"15min":0.83799999999999997},"min":{"1min":0.34000000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.751,"5min":7.9859999999999998,"15min":7.9859999999999998},"last":0.52400000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.96299999999999997,"15min":0.66500000000000004},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.61899999999999999,"5min":8.9179999999999993,"15min":8.9179999999999993},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.91500000000000004,"15min":0.88800000000000001},"min":{"1min":0.36599999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.75700000000000001,"5min":7.8789999999999996,"15min":7.8789999999999996},"last":0.58499999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":1.1950000000000001,"15min":0.879},"min":{"1min":0.371,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.70799999999999996,"5min":19.68,"15min":19.68},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":1.0169999999999999,"15min":0.79000000000000004},"min":{"1min":0.46000000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73499999999999999,"5min":7.0069999999999997,"15min":7.0069999999999997},"last":0.67200000000000004}]},{"osd":4,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":1.7609999999999999,"15min":1.429},"min":{"1min":0.621,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1240000000000001,"5min":44.292000000000002,"15min":44.292000000000002},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.8420000000000001,"15min":1.228},"min":{"1min":0.54000000000000004,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.1180000000000001,"5min":49.887999999999998,"15min":49.887999999999998},"last":0.877}]},{"osd":5,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":2.5390000000000001,"15min":1.319},"min":{"1min":0.55600000000000005,"5min":0.434,"15min":0.434},"max":{"1min":1.0960000000000001,"5min":127.655,"15min":127.655},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":1.839,"15min":1.335},"min":{"1min":0.60299999999999998,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0629999999999999,"5min":65.376000000000005,"15min":65.376000000000005},"last":0.83899999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.5649999999999999,"15min":1.159},"min":{"1min":0.57299999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.05,"5min":17.001999999999999,"15min":17.001999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":1.4390000000000001,"15min":0.97799999999999998},"min":{"1min":0.51800000000000002,"5min":0.499,"15min":0.499},"max":{"1min":1.1930000000000001,"5min":16.331,"15min":16.331},"last":0.76900000000000002}]},{"osd":7,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":1.4199999999999999,"15min":1.1970000000000001},"min":{"1min":0.56999999999999995,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.1739999999999999,"5min":8.9670000000000005,"15min":8.9670000000000005},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.5209999999999999,"15min":1.1779999999999999},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.079,"5min":17.032,"15min":17.032},"last":0.92400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59580,"kb_used_data":28468,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94312260,"statfs":{"total":96636764160,"available":96575754240,"internally_reserved":0,"allocated":29151232,"data_stored":28970015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.82299999999999995,"15min":0.59199999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.70999999999999996,"5min":14.092000000000001,"15min":14.092000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.89500000000000002,"15min":0.59099999999999997},"min":{"1min":0.34799999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.66100000000000003,"5min":13.456,"15min":13.456},"last":0.67500000000000004}]},{"osd":1,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":1.129,"15min":0.70899999999999996},"min":{"1min":0.29999999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.64700000000000002,"5min":15.066000000000001,"15min":15.066000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.879,"15min":0.65100000000000002},"min":{"1min":0.36499999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79200000000000004,"5min":9.2029999999999994,"15min":9.2029999999999994},"last":0.73299999999999998}]},{"osd":3,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.84499999999999997,"15min":0.63700000000000001},"min":{"1min":0.442,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.71199999999999997,"5min":11.715,"15min":11.715},"last":0.873},{"interface":"front","average":{"1min":0.54900000000000004,"5min":1.0149999999999999,"15min":0.73499999999999999},"min":{"1min":0.374,"5min":0.37,"15min":0.37},"max":{"1min":0.82599999999999996,"5min":15.997999999999999,"15min":15.997999999999999},"last":0.85999999999999999}]},{"osd":4,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":1.593,"15min":0.995},"min":{"1min":0.5,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.026,"5min":19.811,"15min":19.811},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.76900000000000002,"5min":1.1910000000000001,"15min":0.872},"min":{"1min":0.57699999999999996,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.96199999999999997,"5min":11.656000000000001,"15min":11.656000000000001},"last":0.94799999999999995}]},{"osd":5,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":1.4239999999999999,"15min":0.97599999999999998},"min":{"1min":0.56000000000000005,"5min":0.499,"15min":0.499},"max":{"1min":0.99299999999999999,"5min":16.045000000000002,"15min":16.045000000000002},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":1.591,"15min":1.038},"min":{"1min":0.58599999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.91700000000000004,"5min":13.414999999999999,"15min":13.414999999999999},"last":0.96999999999999997}]},{"osd":6,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":1.6339999999999999,"15min":1.042},"min":{"1min":0.57699999999999996,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.92200000000000004,"5min":20.692,"15min":20.692},"last":1.02},{"interface":"front","average":{"1min":0.78900000000000003,"5min":1.5129999999999999,"15min":1.024},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.97199999999999998,"5min":10.885999999999999,"15min":10.885999999999999},"last":1.137}]},{"osd":7,"last update":"Thu Aug 10 10:34:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":1.4930000000000001,"15min":1.0349999999999999},"min":{"1min":0.629,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.97699999999999998,"5min":13.516,"15min":13.516},"last":1.0309999999999999},{"interface":"front","average":{"1min":0.79800000000000004,"5min":1.417,"15min":0.98999999999999999},"min":{"1min":0.625,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.008,"5min":20.757999999999999,"15min":20.757999999999999},"last":0.99099999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55488,"kb_used_data":24376,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94316352,"statfs":{"total":96636764160,"available":96579944448,"internally_reserved":0,"allocated":24961024,"data_stored":24775801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":31848715},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.96599999999999997,"15min":0.70599999999999996},"min":{"1min":0.26600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.52800000000000002,"5min":24.925999999999998,"15min":24.925999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.93600000000000005,"15min":0.67100000000000004},"min":{"1min":0.37,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.71299999999999997,"5min":19.779,"15min":19.779},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.93400000000000005,"15min":0.67000000000000004},"min":{"1min":0.35899999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.65300000000000002,"5min":11.143000000000001,"15min":11.143000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":1.165,"15min":1.169},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.63200000000000001,"5min":12.754,"15min":12.754},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":1.0329999999999999,"15min":0.79600000000000004},"min":{"1min":0.41099999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":14.169,"15min":14.169},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":1.149,"15min":0.86699999999999999},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.84299999999999997,"5min":16.927,"15min":16.927},"last":0.63200000000000001}]},{"osd":4,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":1.46,"15min":0.98699999999999999},"min":{"1min":0.53300000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.0880000000000001,"5min":12.779999999999999,"15min":12.779999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.3280000000000001,"15min":0.92800000000000005},"min":{"1min":0.58499999999999996,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.97599999999999998,"5min":14.225,"15min":14.225},"last":0.72299999999999998}]},{"osd":5,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":1.1850000000000001,"15min":0.89800000000000002},"min":{"1min":0.56399999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.97099999999999997,"5min":11.050000000000001,"15min":11.050000000000001},"last":0.745},{"interface":"front","average":{"1min":0.76200000000000001,"5min":1.5329999999999999,"15min":1.05},"min":{"1min":0.61599999999999999,"5min":0.504,"15min":0.504},"max":{"1min":0.995,"5min":24.853999999999999,"15min":24.853999999999999},"last":0.91900000000000004}]},{"osd":6,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":1.466,"15min":1.024},"min":{"1min":0.59099999999999997,"5min":0.5,"15min":0.5},"max":{"1min":1.0529999999999999,"5min":16.919,"15min":16.919},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.3680000000000001,"15min":0.98599999999999999},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":0.996,"5min":12.504,"15min":12.504},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Aug 10 10:34:27 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":1.153,"15min":0.93300000000000005},"min":{"1min":0.67000000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.98899999999999999,"5min":9.5090000000000003,"15min":9.5090000000000003},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.659,"15min":1.101},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0049999999999999,"5min":19.911000000000001,"15min":19.911000000000001},"last":0.81100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64768,"kb_used_data":29560,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94307072,"statfs":{"total":96636764160,"available":96570441728,"internally_reserved":0,"allocated":30269440,"data_stored":30071312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":1.833,"15min":1.0609999999999999},"min":{"1min":0.52000000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.88,"5min":69.530000000000001,"15min":69.530000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.484,"15min":1.075},"min":{"1min":0.55500000000000005,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.96499999999999997,"5min":19.388000000000002,"15min":19.388000000000002},"last":0.70299999999999996}]},{"osd":1,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":1.821,"15min":1.141},"min":{"1min":0.53500000000000003,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.86299999999999999,"5min":64.784999999999997,"15min":64.784999999999997},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":2.613,"15min":1.4530000000000001},"min":{"1min":0.55700000000000005,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.95099999999999996,"5min":120.05,"15min":120.05},"last":0.68200000000000005}]},{"osd":2,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":2.4100000000000001,"15min":1.286},"min":{"1min":0.46100000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.98599999999999999,"5min":119.992,"15min":119.992},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":1.5309999999999999,"15min":1.1950000000000001},"min":{"1min":0.59099999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94399999999999995,"5min":30.984000000000002,"15min":30.984000000000002},"last":0.753}]},{"osd":3,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":1.8680000000000001,"15min":1.1439999999999999},"min":{"1min":0.59099999999999997,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.89600000000000002,"5min":64.823999999999998,"15min":64.823999999999998},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":1.4079999999999999,"15min":1.01},"min":{"1min":0.58899999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92400000000000004,"5min":30.940000000000001,"15min":30.940000000000001},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":2.6909999999999998,"15min":1.4870000000000001},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.91700000000000004,"5min":165.98500000000001,"15min":165.98500000000001},"last":0.879},{"interface":"front","average":{"1min":0.64300000000000002,"5min":2.1760000000000002,"15min":1.266},"min":{"1min":0.45900000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.92100000000000004,"5min":125.369,"15min":125.369},"last":0.66300000000000003}]},{"osd":6,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":2.2959999999999998,"15min":1.7410000000000001},"min":{"1min":0.46600000000000003,"5min":0.31,"15min":0.31},"max":{"1min":0.90200000000000002,"5min":113.884,"15min":113.884},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":2.2040000000000002,"15min":1.2789999999999999},"min":{"1min":0.503,"5min":0.435,"15min":0.435},"max":{"1min":0.94199999999999995,"5min":124.836,"15min":124.836},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Aug 10 10:34:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":1.5669999999999999,"15min":1.111},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.877,"5min":67.281999999999996,"15min":67.281999999999996},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.72599999999999998,"5min":2.1309999999999998,"15min":1.2629999999999999},"min":{"1min":0.52900000000000003,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96799999999999997,"5min":125.12,"15min":125.12},"last":0.85299999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":60612,"kb_used_data":25404,"kb_used_omap":1,"kb_used_meta":35198,"kb_avail":94311228,"statfs":{"total":96636764160,"available":96574697472,"internally_reserved":0,"allocated":26013696,"data_stored":25824939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":36043019},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":1.6419999999999999,"15min":1.2230000000000001},"min":{"1min":0.52700000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89700000000000002,"5min":15.749000000000001,"15min":15.749000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.73799999999999999,"5min":1.3169999999999999,"15min":1.115},"min":{"1min":0.55100000000000005,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.93500000000000005,"5min":12.596,"15min":12.596},"last":0.86499999999999999}]},{"osd":1,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":1.681,"15min":1.341},"min":{"1min":0.48099999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95799999999999996,"5min":20.193999999999999,"15min":20.193999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":1.5669999999999999,"15min":1.1830000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.92000000000000004,"5min":15.708,"15min":15.708},"last":0.76700000000000002}]},{"osd":2,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":1.387,"15min":1.1639999999999999},"min":{"1min":0.47799999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93799999999999994,"5min":10.949,"15min":10.949},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":1.5509999999999999,"15min":1.1830000000000001},"min":{"1min":0.48399999999999999,"5min":0.435,"15min":0.435},"max":{"1min":0.90400000000000003,"5min":20.224,"15min":20.224},"last":0.83199999999999996}]},{"osd":3,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":1.1759999999999999,"15min":1.1160000000000001},"min":{"1min":0.52600000000000002,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.96199999999999997,"5min":10.978,"15min":10.978},"last":0.748},{"interface":"front","average":{"1min":0.78300000000000003,"5min":1.867,"15min":1.4810000000000001},"min":{"1min":0.53400000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.95199999999999996,"5min":20.114999999999998,"15min":20.114999999999998},"last":0.78500000000000003}]},{"osd":4,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.97099999999999997,"15min":0.72899999999999998},"min":{"1min":0.38200000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.85699999999999998,"5min":15.784000000000001,"15min":15.784000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.84699999999999998,"15min":0.70099999999999996},"min":{"1min":0.42799999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.88900000000000001,"5min":11.006,"15min":11.006},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.93000000000000005,"15min":0.73299999999999998},"min":{"1min":0.49399999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90600000000000003,"5min":9.9979999999999993,"15min":9.9979999999999993},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":1.012,"15min":0.78900000000000003},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83599999999999997,"5min":15.815,"15min":15.815},"last":0.84999999999999998}]},{"osd":7,"last update":"Thu Aug 10 10:34:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":1.014,"15min":0.82199999999999995},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.92500000000000004,"5min":11.037000000000001,"15min":11.037000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.78200000000000003,"5min":1.3160000000000001,"15min":0.94699999999999995},"min":{"1min":0.58999999999999997,"5min":0.438,"15min":0.438},"max":{"1min":0.93999999999999995,"5min":20.161000000000001,"15min":20.161000000000001},"last":0.88400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":8334,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2149873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":2166784,"data_stored":2142281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":26738688,"data_stored":26738688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":31981568,"data_stored":31981568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":28835840,"data_stored":28835840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24641536,"data_stored":24641536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":27787264,"data_stored":27787264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25690112,"data_stored":25690112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17301504,"data_stored":17301504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":39321600,"data_stored":39321600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-10T10:34:51.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-10T10:34:51.953 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.953+0000 7f12635ff700 1 Processor -- start 2023-08-10T10:34:51.954 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.953+0000 7f12635ff700 1 -- start start 2023-08-10T10:34:51.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.954+0000 7f12635ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f125c0cd560 0x7f125c06aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.954+0000 7f12635ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c06b3a0 con 0x7f125c06af40 2023-08-10T10:34:51.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.954+0000 7f12635ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c0cdab0 con 0x7f125c156f70 2023-08-10T10:34:51.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.954+0000 7f12635ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c06d480 con 0x7f125c0cd560 2023-08-10T10:34:51.955 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1261b9c700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f125c06af40 0x7f125c0c3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:60326/0 (socket says 172.21.15.88:60326) 2023-08-10T10:34:51.956 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1261b9c700 1 -- 172.21.15.88:0/2304798768 learned_addr learned my addr 172.21.15.88:0/2304798768 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:34:51.957 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1260b9a700 1 --2- 172.21.15.88:0/2304798768 >> v2:172.21.15.187:3300/0 conn(0x7f125c0cd560 0x7f125c06aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1509117598 0 0) 0x7f125c06b3a0 con 0x7f125c06af40 2023-08-10T10:34:51.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12480035b0 con 0x7f125c06af40 2023-08-10T10:34:51.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896383384 0 0) 0x7f125c0cdab0 con 0x7f125c156f70 2023-08-10T10:34:51.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f125c06b3a0 con 0x7f125c156f70 2023-08-10T10:34:51.958 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3142976587 0 0) 0x7f12480035b0 con 0x7f125c06af40 2023-08-10T10:34:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1260b9a700 1 -- 172.21.15.88:0/2304798768 >> v1:172.21.15.187:6789/0 conn(0x7f125c156f70 legacy=0x7f125c15a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1260b9a700 1 -- 172.21.15.88:0/2304798768 >> v1:172.21.15.88:6789/0 conn(0x7f125c06af40 legacy=0x7f125c0c3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.955+0000 7f1260b9a700 1 -- 172.21.15.88:0/2304798768 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0cdd90 con 0x7f125c0cd560 2023-08-10T10:34:51.959 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f1260b9a700 1 --2- 172.21.15.88:0/2304798768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c0cd560 0x7f125c06aa00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f124c00a9e0 tx=0x7f124c00acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cdf5ad1c40b2cfa server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12540019f0 con 0x7f125c0cd560 2023-08-10T10:34:51.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c00ae80 con 0x7f125c0cd560 2023-08-10T10:34:51.960 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f1253fff700 1 -- 172.21.15.88:0/2304798768 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c004250 con 0x7f125c0cd560 2023-08-10T10:34:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f12635ff700 1 -- 172.21.15.88:0/2304798768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c0cd560 msgr2=0x7f125c06aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.961 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.956+0000 7f12635ff700 1 --2- 172.21.15.88:0/2304798768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c0cd560 0x7f125c06aa00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f124c00a9e0 tx=0x7f124c00acf0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.957+0000 7f12635ff700 1 -- 172.21.15.88:0/2304798768 shutdown_connections 2023-08-10T10:34:51.962 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.957+0000 7f12635ff700 1 --2- 172.21.15.88:0/2304798768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c0cd560 0x7f125c06aa00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.957+0000 7f12635ff700 1 -- 172.21.15.88:0/2304798768 >> 172.21.15.88:0/2304798768 conn(0x7f125c0cb570 msgr2=0x7f125c0cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:51.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.957+0000 7f12635ff700 1 -- 172.21.15.88:0/2304798768 shutdown_connections 2023-08-10T10:34:51.963 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.957+0000 7f12635ff700 1 -- 172.21.15.88:0/2304798768 wait complete. 2023-08-10T10:34:51.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.958+0000 7f12635ff700 1 Processor -- start 2023-08-10T10:34:51.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.958+0000 7f12635ff700 1 -- start start 2023-08-10T10:34:51.968 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 0x7f125c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.969 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 0x7f125c0ca0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c148a80 con 0x7f125c0cd560 2023-08-10T10:34:51.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c1527e0 con 0x7f125c06af40 2023-08-10T10:34:51.970 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.959+0000 7f12635ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c151eb0 con 0x7f125c156f70 2023-08-10T10:34:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:53684/0 (socket says 172.21.15.88:53684) 2023-08-10T10:34:51.971 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 -- 172.21.15.88:0/907397036 learned_addr learned my addr 172.21.15.88:0/907397036 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 -- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 msgr2=0x7f125c0ca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1261b9c700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 0x7f125c0ca0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f126139b700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 0x7f125c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 0x7f125c0ca0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.972 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 -- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 msgr2=0x7f125c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 0x7f125c152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 -- 172.21.15.88:0/907397036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f124c00a640 con 0x7f125c0cd560 2023-08-10T10:34:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1261b9c700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 0x7f125c0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:34:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f126139b700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 0x7f125c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:34:51.973 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1260b9a700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f124c00a1c0 tx=0x7f124c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.960+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c01e070 con 0x7f125c0cd560 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.961+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f124c0036a0 con 0x7f125c0cd560 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.961+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c152190 con 0x7f125c0cd560 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.961+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c003a50 con 0x7f125c0cd560 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.961+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c151b60 con 0x7f125c0cd560 2023-08-10T10:34:51.974 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.962+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c0743a0 con 0x7f125c0cd560 2023-08-10T10:34:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.962+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f124c003bb0 con 0x7f125c0cd560 2023-08-10T10:34:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.963+0000 7f1251ffb700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 0x7f124006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.963+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f124c08aa30 con 0x7f125c0cd560 2023-08-10T10:34:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.964+0000 7f126139b700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 0x7f124006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:51.975 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.964+0000 7f126139b700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 0x7f124006d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f12580011e0 tx=0x7f1258009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:51.976 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:51.968+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f124c055850 con 0x7f125c0cd560 2023-08-10T10:34:52.165 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.165+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f125c152920 con 0x7f125c0cd560 2023-08-10T10:34:52.169 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.169+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f124c055850 con 0x7f125c0cd560 2023-08-10T10:34:52.170 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.170+0000 7f1251ffb700 1 -- 172.21.15.88:0/907397036 <== mon.0 v2:172.21.15.88:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) v1 ==== 123+0+0 (secure 0 0 0) 0x7f124c003e60 con 0x7f125c0cd560 2023-08-10T10:34:52.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.172+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 msgr2=0x7f124006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.173 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.172+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 0x7f124006d1a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f12580011e0 tx=0x7f1258009040 comp rx=0 tx=0).stop 2023-08-10T10:34:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.172+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 msgr2=0x7f125c148540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.172+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f124c00a1c0 tx=0x7f124c0047c0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 shutdown_connections 2023-08-10T10:34:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f124006ace0 0x7f124006d1a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.174 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f125c156f70 0x7f125c0ca0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c06af40 0x7f125c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 --2- 172.21.15.88:0/907397036 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f125c0cd560 0x7f125c148540 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 >> 172.21.15.88:0/907397036 conn(0x7f125c0cb570 msgr2=0x7f125c0c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 shutdown_connections 2023-08-10T10:34:52.175 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.173+0000 7f12635ff700 1 -- 172.21.15.88:0/907397036 wait complete. 2023-08-10T10:34:52.192 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-10T10:34:52.193 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:34:52.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.389+0000 7f4c46fff700 1 Processor -- start 2023-08-10T10:34:52.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.389+0000 7f4c46fff700 1 -- start start 2023-08-10T10:34:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.390+0000 7f4c46fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4c400afd50 0x7f4c400b0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.390+0000 7f4c46fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c4015e740 0x7f4c400cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.391 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.390+0000 7f4c46fff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c4006c2d0 con 0x7f4c4015ebd0 2023-08-10T10:34:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.390+0000 7f4c46fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4006c5b0 con 0x7f4c4015e740 2023-08-10T10:34:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.390+0000 7f4c46fff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4006c890 con 0x7f4c400afd50 2023-08-10T10:34:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c4015e740 0x7f4c400cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4c4015e740 0x7f4c400cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48686/0 (socket says 172.21.15.88:48686) 2023-08-10T10:34:52.392 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 -- 172.21.15.88:0/4237112885 learned_addr learned my addr 172.21.15.88:0/4237112885 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:52.393 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c44d9b700 1 --2- 172.21.15.88:0/4237112885 >> v2:172.21.15.187:3300/0 conn(0x7f4c400afd50 0x7f4c400b0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 -- 172.21.15.88:0/4237112885 >> v2:172.21.15.187:3300/0 conn(0x7f4c400afd50 msgr2=0x7f4c400b0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:52.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 --2- 172.21.15.88:0/4237112885 >> v2:172.21.15.187:3300/0 conn(0x7f4c400afd50 0x7f4c400b0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.394 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 -- 172.21.15.88:0/4237112885 >> v1:172.21.15.187:6789/0 conn(0x7f4c4015ebd0 legacy=0x7f4c4006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 -- 172.21.15.88:0/4237112885 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4006cb70 con 0x7f4c4015e740 2023-08-10T10:34:52.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3ffff700 1 --2- 172.21.15.88:0/4237112885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015e740 0x7f4c400cf020 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c400ce5c0 tx=0x7f4c2c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930b4e2dca4885ac server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.391+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/4237112885 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00b870 con 0x7f4c4015e740 2023-08-10T10:34:52.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/4237112885 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4c2c00b9d0 con 0x7f4c4015e740 2023-08-10T10:34:52.395 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c3f7fe700 1 -- 172.21.15.88:0/4237112885 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c2c00bd80 con 0x7f4c4015e740 2023-08-10T10:34:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 -- 172.21.15.88:0/4237112885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015e740 msgr2=0x7f4c400cf020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 --2- 172.21.15.88:0/4237112885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015e740 0x7f4c400cf020 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f4c400ce5c0 tx=0x7f4c2c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 -- 172.21.15.88:0/4237112885 shutdown_connections 2023-08-10T10:34:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 --2- 172.21.15.88:0/4237112885 >> v2:172.21.15.187:3300/0 conn(0x7f4c400afd50 0x7f4c400b0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.396 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 --2- 172.21.15.88:0/4237112885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015e740 0x7f4c400cf020 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 -- 172.21.15.88:0/4237112885 >> 172.21.15.88:0/4237112885 conn(0x7f4c4006f200 msgr2=0x7f4c4006f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 -- 172.21.15.88:0/4237112885 shutdown_connections 2023-08-10T10:34:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.392+0000 7f4c46fff700 1 -- 172.21.15.88:0/4237112885 wait complete. 2023-08-10T10:34:52.397 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.394+0000 7f4c46fff700 1 Processor -- start 2023-08-10T10:34:52.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.394+0000 7f4c46fff700 1 -- start start 2023-08-10T10:34:52.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 0x7f4c400ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c4015e740 0x7f4c401e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.399 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c40156350 con 0x7f4c4015ebd0 2023-08-10T10:34:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401e6a70 con 0x7f4c400afd50 2023-08-10T10:34:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c46fff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401e6d50 con 0x7f4c4015e740 2023-08-10T10:34:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c4559c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.400 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c4559c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48692/0 (socket says 172.21.15.88:48692) 2023-08-10T10:34:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.395+0000 7f4c4559c700 1 -- 172.21.15.88:0/3187975238 learned_addr learned my addr 172.21.15.88:0/3187975238 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c44d9b700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 0x7f4c400ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c3ffff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c4015e740 0x7f4c401e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 -- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c4015e740 msgr2=0x7f4c401e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.401 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c4015e740 0x7f4c401e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 -- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 msgr2=0x7f4c400ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 0x7f4c400ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 -- 172.21.15.88:0/3187975238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c2c009550 con 0x7f4c4015ebd0 2023-08-10T10:34:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c44d9b700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 0x7f4c400ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:52.402 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c4559c700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800cb50 tx=0x7f4c3800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38003c00 con 0x7f4c4015ebd0 2023-08-10T10:34:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4c38003d60 con 0x7f4c4015ebd0 2023-08-10T10:34:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c401e7030 con 0x7f4c4015ebd0 2023-08-10T10:34:52.403 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3800aae0 con 0x7f4c4015ebd0 2023-08-10T10:34:52.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.396+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c401e7830 con 0x7f4c4015ebd0 2023-08-10T10:34:52.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.397+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4004ecc0 con 0x7f4c4015ebd0 2023-08-10T10:34:52.404 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.398+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f4c3800ac40 con 0x7f4c4015ebd0 2023-08-10T10:34:52.405 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.399+0000 7f4c3d7fa700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 0x7f4c2406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.400+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f4c38089850 con 0x7f4c4015ebd0 2023-08-10T10:34:52.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.400+0000 7f4c44d9b700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 0x7f4c2406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.400+0000 7f4c44d9b700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 0x7f4c2406d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ba70 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.406 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.404+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f4c38054530 con 0x7f4c4015ebd0 2023-08-10T10:34:52.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.644+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c4006bbe0 con 0x7f4c4015ebd0 2023-08-10T10:34:52.645 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.645+0000 7f4c3d7fa700 1 -- 172.21.15.88:0/3187975238 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f4c38057b50 con 0x7f4c4015ebd0 2023-08-10T10:34:52.646 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:52.646 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:34:52.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 msgr2=0x7f4c2406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 0x7f4c2406d1a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4c3400ba70 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-08-10T10:34:52.648 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 msgr2=0x7f4c401e8780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800cb50 tx=0x7f4c3800ce60 comp rx=0 tx=0).stop 2023-08-10T10:34:52.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 shutdown_connections 2023-08-10T10:34:52.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4c4015ebd0 0x7f4c401e8780 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.649 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c400afd50 0x7f4c400ccb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f4c2406ace0 0x7f4c2406d1a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 --2- 172.21.15.88:0/3187975238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c4015e740 0x7f4c401e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.647+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 >> 172.21.15.88:0/3187975238 conn(0x7f4c4006f200 msgr2=0x7f4c40160d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.648+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 shutdown_connections 2023-08-10T10:34:52.650 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.648+0000 7f4c46fff700 1 -- 172.21.15.88:0/3187975238 wait complete. 2023-08-10T10:34:52.651 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:34:52.666 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-10T10:34:52.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.861+0000 7f3e9edff700 1 Processor -- start 2023-08-10T10:34:52.862 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.861+0000 7f3e9edff700 1 -- start start 2023-08-10T10:34:52.867 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.862+0000 7f3e9edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 0x7f3e980b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.862+0000 7f3e9edff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e980b5040 0x7f3e980d1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.868 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.862+0000 7f3e9edff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e980b5480 con 0x7f3e9815cf20 2023-08-10T10:34:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.862+0000 7f3e9edff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e980cde30 con 0x7f3e980b5040 2023-08-10T10:34:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.862+0000 7f3e9edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980b8e30 con 0x7f3e980b8870 2023-08-10T10:34:52.869 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3e980b5040 0x7f3e980d1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9cb9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f3e9815cf20 0x7f3e9815e050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34010/0 (socket says 172.21.15.88:34010) 2023-08-10T10:34:52.870 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9cb9b700 1 -- 172.21.15.88:0/3969366267 learned_addr learned my addr 172.21.15.88:0/3969366267 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:34:52.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e97fff700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 0x7f3e980b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.871 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 -- 172.21.15.88:0/3969366267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 msgr2=0x7f3e980b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 0x7f3e980b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.872 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 -- 172.21.15.88:0/3969366267 >> v1:172.21.15.88:6789/0 conn(0x7f3e9815cf20 legacy=0x7f3e9815e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 -- 172.21.15.88:0/3969366267 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e980ce010 con 0x7f3e980b5040 2023-08-10T10:34:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e977fe700 1 -- 172.21.15.88:0/3969366267 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1065803450 0 0) 0x7f3e980b5480 con 0x7f3e9815cf20 2023-08-10T10:34:52.873 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e97fff700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 0x7f3e980b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.863+0000 7f3e9d39c700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b5040 0x7f3e980d1350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d90 tx=0x7f3e9000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b56f2356d1388372 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e977fe700 1 -- 172.21.15.88:0/3969366267 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9000e070 con 0x7f3e980b5040 2023-08-10T10:34:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e977fe700 1 -- 172.21.15.88:0/3969366267 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e9000bbd0 con 0x7f3e980b5040 2023-08-10T10:34:52.874 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e977fe700 1 -- 172.21.15.88:0/3969366267 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e90012430 con 0x7f3e980b5040 2023-08-10T10:34:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 -- 172.21.15.88:0/3969366267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b5040 msgr2=0x7f3e980d1350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b5040 0x7f3e980d1350 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009d90 tx=0x7f3e9000b330 comp rx=0 tx=0).stop 2023-08-10T10:34:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 -- 172.21.15.88:0/3969366267 shutdown_connections 2023-08-10T10:34:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b5040 0x7f3e980d1350 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.875 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 --2- 172.21.15.88:0/3969366267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e980b8870 0x7f3e980b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 -- 172.21.15.88:0/3969366267 >> 172.21.15.88:0/3969366267 conn(0x7f3e980d3080 msgr2=0x7f3e980d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 -- 172.21.15.88:0/3969366267 shutdown_connections 2023-08-10T10:34:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.864+0000 7f3e9edff700 1 -- 172.21.15.88:0/3969366267 wait complete. 2023-08-10T10:34:52.876 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.866+0000 7f3e9edff700 1 Processor -- start 2023-08-10T10:34:52.877 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.866+0000 7f3e9edff700 1 -- start start 2023-08-10T10:34:52.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 0x7f3e98159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.879 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e9815cf20 0x7f3e980cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980c7b40 con 0x7f3e980b8870 2023-08-10T10:34:52.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980c7e20 con 0x7f3e980b5040 2023-08-10T10:34:52.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e9edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e980c8100 con 0x7f3e9815cf20 2023-08-10T10:34:52.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.867+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.880 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48706/0 (socket says 172.21.15.88:48706) 2023-08-10T10:34:52.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 -- 172.21.15.88:0/2140925517 learned_addr learned my addr 172.21.15.88:0/2140925517 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:52.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e9cb9b700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 0x7f3e98159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e9d39c700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e9815cf20 0x7f3e980cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.881 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 -- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e9815cf20 msgr2=0x7f3e980cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e9815cf20 0x7f3e980cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 -- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 msgr2=0x7f3e98159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:52.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 0x7f3e98159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:52.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 -- 172.21.15.88:0/2140925517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e90009a70 con 0x7f3e980b8870 2023-08-10T10:34:52.882 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e9cb9b700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 0x7f3e98159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:52.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e97fff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e810 tx=0x7f3e8400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e84004230 con 0x7f3e980b8870 2023-08-10T10:34:52.883 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e84004390 con 0x7f3e980b8870 2023-08-10T10:34:52.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840036a0 con 0x7f3e980b8870 2023-08-10T10:34:52.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.868+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e980c83e0 con 0x7f3e980b8870 2023-08-10T10:34:52.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.869+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e981599a0 con 0x7f3e980b8870 2023-08-10T10:34:52.884 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.870+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e980c8900 con 0x7f3e980b8870 2023-08-10T10:34:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.870+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3e84003820 con 0x7f3e980b8870 2023-08-10T10:34:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.871+0000 7f3e957fa700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 0x7f3e7c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.872+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3e84089380 con 0x7f3e980b8870 2023-08-10T10:34:52.885 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.872+0000 7f3e9cb9b700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 0x7f3e7c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:52.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.872+0000 7f3e9cb9b700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 0x7f3e7c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000f60 tx=0x7f3e8c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:52.886 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:52.875+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3e980c8900 con 0x7f3e980b8870 2023-08-10T10:34:53.116 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.116+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e980c8900 con 0x7f3e980b8870 2023-08-10T10:34:53.117 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.116+0000 7f3e957fa700 1 -- 172.21.15.88:0/2140925517 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f3e980c8900 con 0x7f3e980b8870 2023-08-10T10:34:53.118 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:53.118 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4232,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6837/1896467060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6835","nonce":1896467060},{"type":"v1","addr":"172.21.15.88:6837","nonce":1896467060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4276,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6836/1155013159","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6834","nonce":1155013159},{"type":"v1","addr":"172.21.15.88:6836","nonce":1155013159}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4285,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/92993316","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":92993316},{"type":"v1","addr":"172.21.15.187:6835","nonce":92993316}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-10T10:30:33.791781+0000","modified":"2023-08-10T10:30:55.423262+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4293},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4293":{"gid":4293,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/2975223265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2975223265},{"type":"v1","addr":"172.21.15.187:6834","nonce":2975223265}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4,5],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-10T10:34:53.119 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 msgr2=0x7f3e7c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 0x7f3e7c06d1a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c000f60 tx=0x7f3e8c007d30 comp rx=0 tx=0).stop 2023-08-10T10:34:53.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 msgr2=0x7f3e980cbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3e8400e810 tx=0x7f3e8400ebd0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 shutdown_connections 2023-08-10T10:34:53.120 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3e7c06ace0 0x7f3e7c06d1a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e9815cf20 0x7f3e980cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e980b5040 0x7f3e98159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 --2- 172.21.15.88:0/2140925517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3e980b8870 0x7f3e980cbed0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 >> 172.21.15.88:0/2140925517 conn(0x7f3e980d3080 msgr2=0x7f3e980d1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:53.121 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 shutdown_connections 2023-08-10T10:34:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.119+0000 7f3e9edff700 1 -- 172.21.15.88:0/2140925517 wait complete. 2023-08-10T10:34:53.122 INFO:teuthology.orchestra.run.smithi088.stderr:dumped fsmap epoch 9 2023-08-10T10:34:53.137 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-10T10:34:53.333 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.333+0000 7fab885ff700 1 Processor -- start 2023-08-10T10:34:53.334 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.333+0000 7fab885ff700 1 -- start start 2023-08-10T10:34:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab8015cf20 0x7fab8015e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.335 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab800b8870 0x7fab800b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab800b5040 0x7fab8006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800cde30 con 0x7fab800b8870 2023-08-10T10:34:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800b5480 con 0x7fab800b5040 2023-08-10T10:34:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab885ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8015e590 con 0x7fab8015cf20 2023-08-10T10:34:53.336 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab85b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab800b8870 0x7fab800b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab85b9a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fab800b8870 0x7fab800b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48720/0 (socket says 172.21.15.88:48720) 2023-08-10T10:34:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.334+0000 7fab85b9a700 1 -- 172.21.15.88:0/1146122624 learned_addr learned my addr 172.21.15.88:0/1146122624 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab86b9c700 1 --2- 172.21.15.88:0/1146122624 >> v2:172.21.15.187:3300/0 conn(0x7fab800b5040 0x7fab8006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab8639b700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab8015cf20 0x7fab8015e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.337 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 -- 172.21.15.88:0/1146122624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab8015cf20 msgr2=0x7fab8015e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab8015cf20 0x7fab8015e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 -- 172.21.15.88:0/1146122624 >> v2:172.21.15.187:3300/0 conn(0x7fab800b5040 msgr2=0x7fab8006a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 --2- 172.21.15.88:0/1146122624 >> v2:172.21.15.187:3300/0 conn(0x7fab800b5040 0x7fab8006a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 -- 172.21.15.88:0/1146122624 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800b8e30 con 0x7fab800b8870 2023-08-10T10:34:53.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85b9a700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab800b8870 0x7fab800b4b00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab800d2920 tx=0x7fab70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dce79a0a5eea6e5 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85399700 1 -- 172.21.15.88:0/1146122624 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000b870 con 0x7fab800b8870 2023-08-10T10:34:53.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85399700 1 -- 172.21.15.88:0/1146122624 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fab7000b9d0 con 0x7fab800b8870 2023-08-10T10:34:53.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.335+0000 7fab85399700 1 -- 172.21.15.88:0/1146122624 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7000bd80 con 0x7fab800b8870 2023-08-10T10:34:53.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 -- 172.21.15.88:0/1146122624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab800b8870 msgr2=0x7fab800b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.341 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab800b8870 0x7fab800b4b00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fab800d2920 tx=0x7fab70009bd0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 -- 172.21.15.88:0/1146122624 shutdown_connections 2023-08-10T10:34:53.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 --2- 172.21.15.88:0/1146122624 >> v2:172.21.15.187:3300/0 conn(0x7fab800b5040 0x7fab8006a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab8015cf20 0x7fab8015e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 --2- 172.21.15.88:0/1146122624 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab800b8870 0x7fab800b4b00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.342 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 -- 172.21.15.88:0/1146122624 >> 172.21.15.88:0/1146122624 conn(0x7fab800d3080 msgr2=0x7fab800d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:53.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 -- 172.21.15.88:0/1146122624 shutdown_connections 2023-08-10T10:34:53.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.336+0000 7fab885ff700 1 -- 172.21.15.88:0/1146122624 wait complete. 2023-08-10T10:34:53.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.338+0000 7fab885ff700 1 Processor -- start 2023-08-10T10:34:53.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.338+0000 7fab885ff700 1 -- start start 2023-08-10T10:34:53.343 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab800b5040 0x7fab800b7660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 0x7fab800c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab801f2460 con 0x7fab8015cf20 2023-08-10T10:34:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800cd070 con 0x7fab800b8870 2023-08-10T10:34:53.344 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab885ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab800ccd90 con 0x7fab800b5040 2023-08-10T10:34:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab85b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 0x7fab800c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab8639b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab800b5040 0x7fab800b7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48736/0 (socket says 172.21.15.88:48736) 2023-08-10T10:34:53.345 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab85b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 0x7fab800c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49938/0 (socket says 172.21.15.88:49938) 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 -- 172.21.15.88:0/2681041195 learned_addr learned my addr 172.21.15.88:0/2681041195 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 -- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab800b5040 msgr2=0x7fab800b7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab800b5040 0x7fab800b7660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 -- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 msgr2=0x7fab800c63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 0x7fab800c63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.346 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.340+0000 7fab86b9c700 1 -- 172.21.15.88:0/2681041195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab70009550 con 0x7fab8015cf20 2023-08-10T10:34:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab86b9c700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab78007d10 tx=0x7fab7800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab7800ed30 con 0x7fab8015cf20 2023-08-10T10:34:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fab78007e60 con 0x7fab8015cf20 2023-08-10T10:34:53.348 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab800b6b80 con 0x7fab8015cf20 2023-08-10T10:34:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78014680 con 0x7fab8015cf20 2023-08-10T10:34:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.341+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab800b7140 con 0x7fab8015cf20 2023-08-10T10:34:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.342+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8004ecc0 con 0x7fab8015cf20 2023-08-10T10:34:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.343+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7fab780147e0 con 0x7fab8015cf20 2023-08-10T10:34:53.349 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.344+0000 7fab76ffd700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 0x7fab6406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.344+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7fab78089e10 con 0x7fab8015cf20 2023-08-10T10:34:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.345+0000 7fab8639b700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 0x7fab6406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.345+0000 7fab8639b700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 0x7fab6406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab800c91b0 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.350 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.349+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7fab78054b00 con 0x7fab8015cf20 2023-08-10T10:34:53.545 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.545+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab8006ae80 con 0x7fab8015cf20 2023-08-10T10:34:53.546 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.546+0000 7fab76ffd700 1 -- 172.21.15.88:0/2681041195 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+20180 (secure 0 0 0) 0x7fab78058120 con 0x7fab8015cf20 2023-08-10T10:34:53.547 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-08-10T10:34:53.547 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":29,"fsid":"bc564a8c-b09f-4f9e-8d2e-bdeeeff6154c","created":"2023-08-10T10:30:06.412037+0000","modified":"2023-08-10T10:31:15.291038+0000","last_up_change":"2023-08-10T10:30:18.747755+0000","last_in_change":"2023-08-10T10:30:09.915529+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-10T10:30:19.589864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-10T10:30:26.312395+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-08-10T10:30:32.285848+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-08-10T10:30:32.776165+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data_ec","create_time":"2023-08-10T10:30:36.389300+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d91affde-f99a-4ca8-a0dc-623501d3bfb6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6801","nonce":707783139}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6803","nonce":707783139}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6807","nonce":707783139}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":707783139},{"type":"v1","addr":"172.21.15.88:6805","nonce":707783139}]},"public_addr":"172.21.15.88:6801/707783139","cluster_addr":"172.21.15.88:6803/707783139","heartbeat_back_addr":"172.21.15.88:6807/707783139","heartbeat_front_addr":"172.21.15.88:6805/707783139","state":["exists","up"]},{"osd":1,"uuid":"02326e7b-6d2c-4a3e-a9a7-31df64094245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6809","nonce":4133826760}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6811","nonce":4133826760}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6815","nonce":4133826760}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":4133826760},{"type":"v1","addr":"172.21.15.88:6813","nonce":4133826760}]},"public_addr":"172.21.15.88:6809/4133826760","cluster_addr":"172.21.15.88:6811/4133826760","heartbeat_back_addr":"172.21.15.88:6815/4133826760","heartbeat_front_addr":"172.21.15.88:6813/4133826760","state":["exists","up"]},{"osd":2,"uuid":"04a2dbd5-759e-4973-a6de-958b30cee796","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6817","nonce":2073214128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6819","nonce":2073214128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6823","nonce":2073214128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":2073214128},{"type":"v1","addr":"172.21.15.88:6821","nonce":2073214128}]},"public_addr":"172.21.15.88:6817/2073214128","cluster_addr":"172.21.15.88:6819/2073214128","heartbeat_back_addr":"172.21.15.88:6823/2073214128","heartbeat_front_addr":"172.21.15.88:6821/2073214128","state":["exists","up"]},{"osd":3,"uuid":"5e28043c-0ae3-4a88-9742-8b34fd49f16e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6825","nonce":551215602}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6827","nonce":551215602}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6831","nonce":551215602}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":551215602},{"type":"v1","addr":"172.21.15.88:6829","nonce":551215602}]},"public_addr":"172.21.15.88:6825/551215602","cluster_addr":"172.21.15.88:6827/551215602","heartbeat_back_addr":"172.21.15.88:6831/551215602","heartbeat_front_addr":"172.21.15.88:6829/551215602","state":["exists","up"]},{"osd":4,"uuid":"2c3b68f9-e144-42d5-b97b-6ae32791a1de","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6801","nonce":2556306423}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6803","nonce":2556306423}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6807","nonce":2556306423}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2556306423},{"type":"v1","addr":"172.21.15.187:6805","nonce":2556306423}]},"public_addr":"172.21.15.187:6801/2556306423","cluster_addr":"172.21.15.187:6803/2556306423","heartbeat_back_addr":"172.21.15.187:6807/2556306423","heartbeat_front_addr":"172.21.15.187:6805/2556306423","state":["exists","up"]},{"osd":5,"uuid":"8f487dd6-001e-47ba-a16d-3b80c61b7b29","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6825","nonce":70482310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6827","nonce":70482310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6831","nonce":70482310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":70482310},{"type":"v1","addr":"172.21.15.187:6829","nonce":70482310}]},"public_addr":"172.21.15.187:6825/70482310","cluster_addr":"172.21.15.187:6827/70482310","heartbeat_back_addr":"172.21.15.187:6831/70482310","heartbeat_front_addr":"172.21.15.187:6829/70482310","state":["exists","up"]},{"osd":6,"uuid":"d6f6d892-7d5c-463c-8b02-6936d28b9667","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6817","nonce":2271687941}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6819","nonce":2271687941}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6823","nonce":2271687941}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":2271687941},{"type":"v1","addr":"172.21.15.187:6821","nonce":2271687941}]},"public_addr":"172.21.15.187:6817/2271687941","cluster_addr":"172.21.15.187:6819/2271687941","heartbeat_back_addr":"172.21.15.187:6823/2271687941","heartbeat_front_addr":"172.21.15.187:6821/2271687941","state":["exists","up"]},{"osd":7,"uuid":"cb83ac31-09eb-406e-893f-560f89303076","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6809","nonce":4116934694}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6811","nonce":4116934694}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6815","nonce":4116934694}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":4116934694},{"type":"v1","addr":"172.21.15.187:6813","nonce":4116934694}]},"public_addr":"172.21.15.187:6809/4116934694","cluster_addr":"172.21.15.187:6811/4116934694","heartbeat_back_addr":"172.21.15.187:6815/4116934694","heartbeat_front_addr":"172.21.15.187:6813/4116934694","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.214997+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.426484+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.268951+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.495514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.379779+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.542917+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.252783+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-10T10:30:15.261499+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.14","mappings":[{"from":1,"to":5}]},{"pgid":"4.37","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-10T10:34:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.548+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 msgr2=0x7fab6406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.548+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 0x7fab6406d1a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab800c91b0 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2023-08-10T10:34:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 msgr2=0x7fab800c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fab78007d10 tx=0x7fab7800e3c0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 shutdown_connections 2023-08-10T10:34:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fab8015cf20 0x7fab800c9330 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.550 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7fab6406ace0 0x7fab6406d1a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab800b5040 0x7fab800b7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 --2- 172.21.15.88:0/2681041195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab800b8870 0x7fab800c63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 >> 172.21.15.88:0/2681041195 conn(0x7fab800d3080 msgr2=0x7fab8015a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 shutdown_connections 2023-08-10T10:34:53.551 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.549+0000 7fab885ff700 1 -- 172.21.15.88:0/2681041195 wait complete. 2023-08-10T10:34:53.567 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-10T10:34:53.764 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.763+0000 7f3f2edff700 1 Processor -- start 2023-08-10T10:34:53.765 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.764+0000 7f3f2edff700 1 -- start start 2023-08-10T10:34:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 0x7f3f2806b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.769 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2edff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f2806b770 0x7f3f280b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2edff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f280c9890 con 0x7f3f280b23f0 2023-08-10T10:34:53.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2edff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f280b2840 con 0x7f3f2806b770 2023-08-10T10:34:53.770 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f2815f820 con 0x7f3f2815ad10 2023-08-10T10:34:53.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f27fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f2806b770 0x7f3f280b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2cb9b700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 0x7f3f2806b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f27fff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f2806b770 0x7f3f280b1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.88:49942/0 (socket says 172.21.15.88:49942) 2023-08-10T10:34:53.771 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f27fff700 1 -- 172.21.15.88:0/2774524185 learned_addr learned my addr 172.21.15.88:0/2774524185 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.765+0000 7f3f2d39c700 1 --1- 172.21.15.88:0/2774524185 >> v1:172.21.15.187:6789/0 conn(0x7f3f280b23f0 0x7f3f28070990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.88:51332/0 (socket says 172.21.15.88:51332) 2023-08-10T10:34:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f277fe700 1 -- 172.21.15.88:0/2774524185 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3428862062 0 0) 0x7f3f280c9890 con 0x7f3f280b23f0 2023-08-10T10:34:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f277fe700 1 -- 172.21.15.88:0/2774524185 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f180035b0 con 0x7f3f280b23f0 2023-08-10T10:34:53.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f27fff700 1 -- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 msgr2=0x7f3f2806b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:53.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 0x7f3f2806b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f27fff700 1 -- 172.21.15.88:0/2774524185 >> v1:172.21.15.187:6789/0 conn(0x7f3f280b23f0 legacy=0x7f3f28070990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f27fff700 1 -- 172.21.15.88:0/2774524185 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f2815f540 con 0x7f3f2806b770 2023-08-10T10:34:53.773 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f2cb9b700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 0x7f3f2806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-10T10:34:53.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f27fff700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f280b1eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c45203f4b7d9892 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f277fe700 1 -- 172.21.15.88:0/2774524185 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011830 con 0x7f3f2806b770 2023-08-10T10:34:53.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.766+0000 7f3f277fe700 1 -- 172.21.15.88:0/2774524185 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f14011990 con 0x7f3f2806b770 2023-08-10T10:34:53.774 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f277fe700 1 -- 172.21.15.88:0/2774524185 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14011d40 con 0x7f3f2806b770 2023-08-10T10:34:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 -- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 msgr2=0x7f3f280b1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f280b1eb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3f140098f0 tx=0x7f3f14009c00 comp rx=0 tx=0).stop 2023-08-10T10:34:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 -- 172.21.15.88:0/2774524185 shutdown_connections 2023-08-10T10:34:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2815ad10 0x7f3f2806b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.775 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 --2- 172.21.15.88:0/2774524185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f280b1eb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 -- 172.21.15.88:0/2774524185 >> 172.21.15.88:0/2774524185 conn(0x7f3f280ced50 msgr2=0x7f3f280cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 -- 172.21.15.88:0/2774524185 shutdown_connections 2023-08-10T10:34:53.776 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.767+0000 7f3f2edff700 1 -- 172.21.15.88:0/2774524185 wait complete. 2023-08-10T10:34:53.778 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.769+0000 7f3f2edff700 1 Processor -- start 2023-08-10T10:34:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.769+0000 7f3f2edff700 1 -- start start 2023-08-10T10:34:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f28159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280b23f0 0x7f3f280c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f28159660 con 0x7f3f2815ad10 2023-08-10T10:34:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280c6690 con 0x7f3f2806b770 2023-08-10T10:34:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2edff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f280c6970 con 0x7f3f280b23f0 2023-08-10T10:34:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2d39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2d39c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48740/0 (socket says 172.21.15.88:48740) 2023-08-10T10:34:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2d39c700 1 -- 172.21.15.88:0/978392962 learned_addr learned my addr 172.21.15.88:0/978392962 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f2cb9b700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f28159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.770+0000 7f3f27fff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280b23f0 0x7f3f280c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 -- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280b23f0 msgr2=0x7f3f280c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280b23f0 0x7f3f280c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 -- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 msgr2=0x7f3f28159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:53.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f28159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:53.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 -- 172.21.15.88:0/978392962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0094a0 con 0x7f3f2815ad10 2023-08-10T10:34:53.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2d39c700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc50 tx=0x7f3f2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.782 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f2000aad0 con 0x7f3f2815ad10 2023-08-10T10:34:53.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3f2000ac30 con 0x7f3f2815ad10 2023-08-10T10:34:53.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f14009550 con 0x7f3f2815ad10 2023-08-10T10:34:53.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f20007070 con 0x7f3f2815ad10 2023-08-10T10:34:53.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.771+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f280c6f30 con 0x7f3f2815ad10 2023-08-10T10:34:53.783 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.772+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2804ecc0 con 0x7f3f2815ad10 2023-08-10T10:34:53.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.773+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f3f200071d0 con 0x7f3f2815ad10 2023-08-10T10:34:53.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.774+0000 7f3f257fa700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 0x7f3f0c06d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:53.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.774+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6871+0+0 (secure 0 0 0) 0x7f3f20089750 con 0x7f3f2815ad10 2023-08-10T10:34:53.784 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.775+0000 7f3f2cb9b700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 0x7f3f0c06d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:53.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.775+0000 7f3f2cb9b700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 0x7f3f0c06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f2815ef50 tx=0x7f3f1c009210 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:53.785 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:53.778+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f3f200543a0 con 0x7f3f2815ad10 2023-08-10T10:34:54.017 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.017+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3f28071a60 con 0x7f3f2815ad10 2023-08-10T10:34:54.023 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.023+0000 7f3f257fa700 1 -- 172.21.15.88:0/978392962 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3f20017020 con 0x7f3f2815ad10 2023-08-10T10:34:54.026 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 msgr2=0x7f3f0c06d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 0x7f3f0c06d1a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3f2815ef50 tx=0x7f3f1c009210 comp rx=0 tx=0).stop 2023-08-10T10:34:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 msgr2=0x7f3f280c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f3f2000cc50 tx=0x7f3f2000cf60 comp rx=0 tx=0).stop 2023-08-10T10:34:54.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 shutdown_connections 2023-08-10T10:34:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f2815ad10 0x7f3f280c80e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f2806b770 0x7f3f28159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f3f0c06ace0 0x7f3f0c06d1a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 --2- 172.21.15.88:0/978392962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f280b23f0 0x7f3f280c5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 >> 172.21.15.88:0/978392962 conn(0x7f3f280ced50 msgr2=0x7f3f280b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 shutdown_connections 2023-08-10T10:34:54.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.026+0000 7f3f2edff700 1 -- 172.21.15.88:0/978392962 wait complete. 2023-08-10T10:34:54.030 INFO:teuthology.orchestra.run.smithi088.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-10T10:34:54.044 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-10T10:34:54.096 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-08-10T10:34:54.246 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.246+0000 7f6e1cdff700 1 Processor -- start 2023-08-10T10:34:54.247 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.246+0000 7f6e1cdff700 1 -- start start 2023-08-10T10:34:54.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.247+0000 7f6e1cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e1806fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.247+0000 7f6e1cdff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180cc110 con 0x7f6e180d0580 2023-08-10T10:34:54.248 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.247+0000 7f6e1cdff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e180cb7e0 con 0x7f6e180cc5a0 2023-08-10T10:34:54.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.247+0000 7f6e1cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e1806ff60 con 0x7f6e1806bde0 2023-08-10T10:34:54.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e16d9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f6e180d0580 0x7f6e180ccc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34014/0 (socket says 172.21.15.88:34014) 2023-08-10T10:34:54.249 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e16d9d700 1 -- 172.21.15.88:0/1523456884 learned_addr learned my addr 172.21.15.88:0/1523456884 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:34:54.251 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191028062 0 0) 0x7f6e180cc110 con 0x7f6e180d0580 2023-08-10T10:34:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1659c700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e1806fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e000035b0 con 0x7f6e180d0580 2023-08-10T10:34:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2316972093 0 0) 0x7f6e000035b0 con 0x7f6e180d0580 2023-08-10T10:34:54.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 msgr2=0x7f6e1806fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e1806fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 >> v1:172.21.15.187:6789/0 conn(0x7f6e180cc5a0 legacy=0x7f6e1815c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e180cbac0 con 0x7f6e180d0580 2023-08-10T10:34:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3961890671 0 0) 0x7f6e100019f0 con 0x7f6e180d0580 2023-08-10T10:34:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.248+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 >> v1:172.21.15.88:6789/0 conn(0x7f6e180d0580 legacy=0x7f6e180ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e00003a30 0x7f6e00003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00004850 0x7f6e00004cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.256 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e00005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0000bac0 con 0x7f6e00003a30 2023-08-10T10:34:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0000bc00 con 0x7f6e00004850 2023-08-10T10:34:54.257 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0000bd70 con 0x7f6e1806bde0 2023-08-10T10:34:54.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e00003a30 0x7f6e00003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e15d9b700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00004850 0x7f6e00004cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e16d9d700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e00005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 -- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 msgr2=0x7f6e00005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e00005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 -- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00004850 msgr2=0x7f6e00004cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:54.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00004850 0x7f6e00004cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 -- 172.21.15.88:0/1523456884 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000035b0 con 0x7f6e00003a30 2023-08-10T10:34:54.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e16d9d700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e1806bde0 0x7f6e00005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.249+0000 7f6e1659c700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e00003a30 0x7f6e00003e10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009b30 tx=0x7f6e00005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcb4bd7f8953fc4 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800e660 con 0x7f6e00003a30 2023-08-10T10:34:54.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6e0800e7c0 con 0x7f6e00003a30 2023-08-10T10:34:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1559a700 1 -- 172.21.15.88:0/1523456884 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0800eb50 con 0x7f6e00003a30 2023-08-10T10:34:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 -- 172.21.15.88:0/1523456884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e00003a30 msgr2=0x7f6e00003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/1523456884 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e00003a30 0x7f6e00003e10 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6e08009b30 tx=0x7f6e00005880 comp rx=0 tx=0).stop 2023-08-10T10:34:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e16d9d700 1 -- 172.21.15.88:0/1523456884 reap_dead start 2023-08-10T10:34:54.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 -- 172.21.15.88:0/1523456884 shutdown_connections 2023-08-10T10:34:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 -- 172.21.15.88:0/1523456884 >> 172.21.15.88:0/1523456884 conn(0x7f6e180b2810 msgr2=0x7f6e180b2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 -- 172.21.15.88:0/1523456884 shutdown_connections 2023-08-10T10:34:54.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.250+0000 7f6e1cdff700 1 -- 172.21.15.88:0/1523456884 wait complete. 2023-08-10T10:34:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.252+0000 7f6e1cdff700 1 Processor -- start 2023-08-10T10:34:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.252+0000 7f6e1cdff700 1 -- start start 2023-08-10T10:34:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00003a30 0x7f6e181f6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e180c8110 0x7f6e181548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e180cabb0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e18155de0 con 0x7f6e00003a30 2023-08-10T10:34:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.253+0000 7f6e1cdff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e181f7130 con 0x7f6e180c8110 2023-08-10T10:34:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48752/0 (socket says 172.21.15.88:48752) 2023-08-10T10:34:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 -- 172.21.15.88:0/850025804 learned_addr learned my addr 172.21.15.88:0/850025804 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e1659c700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00003a30 0x7f6e181f6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e15d9b700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e180c8110 0x7f6e181548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 -- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e180c8110 msgr2=0x7f6e181548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e180c8110 0x7f6e181548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 -- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00003a30 msgr2=0x7f6e181f6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00003a30 0x7f6e181f6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 -- 172.21.15.88:0/850025804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e181f2bf0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.254+0000 7f6e16d9d700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e10001f60 tx=0x7f6e1000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.255+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e1000ebc0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.255+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f6e1000ed40 con 0x7f6e180ca1e0 2023-08-10T10:34:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.255+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e10013680 con 0x7f6e180ca1e0 2023-08-10T10:34:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.255+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e180c8610 con 0x7f6e180ca1e0 2023-08-10T10:34:54.274 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.255+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e181f3190 con 0x7f6e180ca1e0 2023-08-10T10:34:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.256+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e180670e0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.257+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f6e100137e0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.275 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.258+0000 7f6e06ffd700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 0x7f6df806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.258+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f6e10089e20 con 0x7f6e180ca1e0 2023-08-10T10:34:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.258+0000 7f6e1659c700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 0x7f6df806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.258+0000 7f6e1659c700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 0x7f6df806d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e080090b0 tx=0x7f6e08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:54.276 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.262+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f6e10054ae0 con 0x7f6e180ca1e0 2023-08-10T10:34:54.506 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:54.505+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6e180cb460 con 0x7f6e180ca1e0 2023-08-10T10:34:55.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.024+0000 7f6e06ffd700 1 -- 172.21.15.88:0/850025804 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6e10058100 con 0x7f6e180ca1e0 2023-08-10T10:34:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.026+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 msgr2=0x7f6df806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.027 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.026+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 0x7f6df806d1a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6e080090b0 tx=0x7f6e08008030 comp rx=0 tx=0).stop 2023-08-10T10:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.026+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 msgr2=0x7f6e180ca670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.026+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f6e10001f60 tx=0x7f6e1000e440 comp rx=0 tx=0).stop 2023-08-10T10:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 shutdown_connections 2023-08-10T10:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e180ca1e0 0x7f6e180ca670 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.028 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e00003a30 0x7f6e181f6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f6df806ace0 0x7f6df806d1a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 --2- 172.21.15.88:0/850025804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e180c8110 0x7f6e181548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 >> 172.21.15.88:0/850025804 conn(0x7f6e180b2810 msgr2=0x7f6e18160060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 shutdown_connections 2023-08-10T10:34:55.029 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.027+0000 7f6e1cdff700 1 -- 172.21.15.88:0/850025804 wait complete. 2023-08-10T10:34:55.047 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-10T10:34:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.249+0000 7f98ca9ff700 1 Processor -- start 2023-08-10T10:34:55.250 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.249+0000 7f98ca9ff700 1 -- start start 2023-08-10T10:34:55.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.250+0000 7f98ca9ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98c4143810 0x7f98c40c4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98ca9ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98c406dca0 0x7f98c40c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98ca9ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98c40c43a0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98ca9ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c40c4960 con 0x7f98c4143810 2023-08-10T10:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98ca9ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98c406e8c0 con 0x7f98c406dca0 2023-08-10T10:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c3fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f98c4143810 0x7f98c40c4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c37fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f98c40cc6c0 0x7f98c40cde80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34022/0 (socket says 172.21.15.88:34022) 2023-08-10T10:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c37fe700 1 -- 172.21.15.88:0/3900371122 learned_addr learned my addr 172.21.15.88:0/3900371122 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-08-10T10:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c8f9c700 1 --2- 172.21.15.88:0/3900371122 >> v2:172.21.15.187:3300/0 conn(0x7f98c406dca0 0x7f98c40c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c3fff700 1 -- 172.21.15.88:0/3900371122 >> v2:172.21.15.187:3300/0 conn(0x7f98c406dca0 msgr2=0x7f98c40c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c3fff700 1 --2- 172.21.15.88:0/3900371122 >> v2:172.21.15.187:3300/0 conn(0x7f98c406dca0 0x7f98c40c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c3fff700 1 -- 172.21.15.88:0/3900371122 >> v1:172.21.15.88:6789/0 conn(0x7f98c40cc6c0 legacy=0x7f98c40cde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c3fff700 1 -- 172.21.15.88:0/3900371122 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c406eba0 con 0x7f98c4143810 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.251+0000 7f98c2ffd700 1 -- 172.21.15.88:0/3900371122 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882388619 0 0) 0x7f98c40c43a0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98c3fff700 1 --2- 172.21.15.88:0/3900371122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c4143810 0x7f98c40c4df0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98c4070270 tx=0x7f98b4009b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e9f587c446ef03 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98c2ffd700 1 -- 172.21.15.88:0/3900371122 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400f8a0 con 0x7f98c4143810 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98c2ffd700 1 -- 172.21.15.88:0/3900371122 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f98b400fa00 con 0x7f98c4143810 2023-08-10T10:34:55.255 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98c2ffd700 1 -- 172.21.15.88:0/3900371122 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b400fdb0 con 0x7f98c4143810 2023-08-10T10:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3900371122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c4143810 msgr2=0x7f98c40c4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3900371122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c4143810 0x7f98c40c4df0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f98c4070270 tx=0x7f98b4009b20 comp rx=0 tx=0).stop 2023-08-10T10:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3900371122 shutdown_connections 2023-08-10T10:34:55.258 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3900371122 >> v2:172.21.15.187:3300/0 conn(0x7f98c406dca0 0x7f98c40c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3900371122 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c4143810 0x7f98c40c4df0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3900371122 >> 172.21.15.88:0/3900371122 conn(0x7f98c40cb570 msgr2=0x7f98c40cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:55.259 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.252+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3900371122 shutdown_connections 2023-08-10T10:34:55.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.253+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3900371122 wait complete. 2023-08-10T10:34:55.260 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.254+0000 7f98ca9ff700 1 Processor -- start 2023-08-10T10:34:55.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.254+0000 7f98ca9ff700 1 -- start start 2023-08-10T10:34:55.261 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c406dca0 0x7f98c413b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 0x7f98c415a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.262 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c4159e50 con 0x7f98c40cc6c0 2023-08-10T10:34:55.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98c413bc40 con 0x7f98c4143810 2023-08-10T10:34:55.263 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.255+0000 7f98ca9ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c40abd80 con 0x7f98c406dca0 2023-08-10T10:34:55.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.264 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48774/0 (socket says 172.21.15.88:48774) 2023-08-10T10:34:55.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 -- 172.21.15.88:0/3834077200 learned_addr learned my addr 172.21.15.88:0/3834077200 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:55.265 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c3fff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c406dca0 0x7f98c413b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c8f9c700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 0x7f98c415a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.266 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 -- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c406dca0 msgr2=0x7f98c413b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c406dca0 0x7f98c413b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.267 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 -- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 msgr2=0x7f98c415a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:55.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 0x7f98c415a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:55.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 -- 172.21.15.88:0/3834077200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b40094a0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.268 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c8f9c700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 0x7f98c415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:55.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.256+0000 7f98c37fe700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c540 tx=0x7f98b800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:55.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.257+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8004c80 con 0x7f98c40cc6c0 2023-08-10T10:34:55.269 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.257+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f98b8004de0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.257+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98c40ac060 con 0x7f98c40cc6c0 2023-08-10T10:34:55.270 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.257+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98b8007330 con 0x7f98c40cc6c0 2023-08-10T10:34:55.271 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.257+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98c40ac620 con 0x7f98c40cc6c0 2023-08-10T10:34:55.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.258+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98c40cd7e0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.259+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f98b8007490 con 0x7f98c40cc6c0 2023-08-10T10:34:55.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.259+0000 7f98c0ff9700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 0x7f98b006d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:55.272 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.260+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6957+0+0 (secure 0 0 0) 0x7f98b80894e0 con 0x7f98c40cc6c0 2023-08-10T10:34:55.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.260+0000 7f98c3fff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 0x7f98b006d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:55.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.260+0000 7f98c3fff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 0x7f98b006d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98b40090b0 tx=0x7f98b401b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:55.273 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.264+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f98b8054210 con 0x7f98c40cc6c0 2023-08-10T10:34:55.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:55.461+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f98c40743a0 con 0x7f98c40cc6c0 2023-08-10T10:34:56.193 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.193+0000 7f98c0ff9700 1 -- 172.21.15.88:0/3834077200 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f98b8057830 con 0x7f98c40cc6c0 2023-08-10T10:34:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 msgr2=0x7f98b006d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.197 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 0x7f98b006d1a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f98b40090b0 tx=0x7f98b401b040 comp rx=0 tx=0).stop 2023-08-10T10:34:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 msgr2=0x7f98c415a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f98b800c540 tx=0x7f98b800c850 comp rx=0 tx=0).stop 2023-08-10T10:34:56.198 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 shutdown_connections 2023-08-10T10:34:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c4143810 0x7f98c415a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f98b006ace0 0x7f98b006d1a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c406dca0 0x7f98c413b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.199 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 --2- 172.21.15.88:0/3834077200 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f98c40cc6c0 0x7f98c415a3b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 >> 172.21.15.88:0/3834077200 conn(0x7f98c40cb570 msgr2=0x7f98c413fa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 shutdown_connections 2023-08-10T10:34:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.197+0000 7f98ca9ff700 1 -- 172.21.15.88:0/3834077200 wait complete. 2023-08-10T10:34:56.200 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_metadata' removed 2023-08-10T10:34:56.218 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-10T10:34:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.421+0000 7f21223ff700 1 Processor -- start 2023-08-10T10:34:56.421 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.421+0000 7f21223ff700 1 -- start start 2023-08-10T10:34:56.422 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f21223ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f211c0b5060 0x7f211c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f21223ff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0d1840 con 0x7f211c15d1e0 2023-08-10T10:34:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f21223ff700 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0d1b20 con 0x7f211c0d27a0 2023-08-10T10:34:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f21223ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0d2c50 con 0x7f211c0b5060 2023-08-10T10:34:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f212099c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f211c0b5060 0x7f211c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:56.423 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f212099c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f211c0b5060 0x7f211c0b1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48786/0 (socket says 172.21.15.88:48786) 2023-08-10T10:34:56.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f211bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f211c15d1e0 0x7f211c0d1060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:34024/0 (socket says 172.21.15.88:34024) 2023-08-10T10:34:56.424 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.422+0000 7f212099c700 1 -- 172.21.15.88:0/276899341 learned_addr learned my addr 172.21.15.88:0/276899341 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:56.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f212099c700 1 -- 172.21.15.88:0/276899341 >> v1:172.21.15.187:6789/0 conn(0x7f211c0d27a0 legacy=0x7f211c0b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f212099c700 1 -- 172.21.15.88:0/276899341 >> v1:172.21.15.88:6789/0 conn(0x7f211c15d1e0 legacy=0x7f211c0d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.425 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f212099c700 1 -- 172.21.15.88:0/276899341 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0d1e00 con 0x7f211c0b5060 2023-08-10T10:34:56.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f211affd700 1 -- 172.21.15.88:0/276899341 <== mon.0 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4060703883 0 0) 0x7f211c0d1840 con 0x7f211c15d1e0 2023-08-10T10:34:56.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f212099c700 1 --2- 172.21.15.88:0/276899341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c0b1940 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2114009e50 tx=0x7f211400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834716b7532e8819 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:56.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f211affd700 1 -- 172.21.15.88:0/276899341 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400e070 con 0x7f211c0b5060 2023-08-10T10:34:56.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f211affd700 1 -- 172.21.15.88:0/276899341 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f211400b9c0 con 0x7f211c0b5060 2023-08-10T10:34:56.426 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.423+0000 7f211affd700 1 -- 172.21.15.88:0/276899341 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211400bd90 con 0x7f211c0b5060 2023-08-10T10:34:56.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 -- 172.21.15.88:0/276899341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 msgr2=0x7f211c0b1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 --2- 172.21.15.88:0/276899341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c0b1940 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2114009e50 tx=0x7f211400b330 comp rx=0 tx=0).stop 2023-08-10T10:34:56.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 -- 172.21.15.88:0/276899341 shutdown_connections 2023-08-10T10:34:56.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 --2- 172.21.15.88:0/276899341 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c0b1940 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.427 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 -- 172.21.15.88:0/276899341 >> 172.21.15.88:0/276899341 conn(0x7f211c0cf950 msgr2=0x7f211c0cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:56.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 -- 172.21.15.88:0/276899341 shutdown_connections 2023-08-10T10:34:56.428 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.424+0000 7f21223ff700 1 -- 172.21.15.88:0/276899341 wait complete. 2023-08-10T10:34:56.429 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.425+0000 7f21223ff700 1 Processor -- start 2023-08-10T10:34:56.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.426+0000 7f21223ff700 1 -- start start 2023-08-10T10:34:56.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.426+0000 7f21223ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:56.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.426+0000 7f21223ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c0d27a0 0x7f211c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:56.430 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.426+0000 7f21223ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c15d1e0 0x7f211c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:56.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f21223ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c1f3890 con 0x7f211c0b5060 2023-08-10T10:34:56.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f21223ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c1575c0 con 0x7f211c0d27a0 2023-08-10T10:34:56.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f21223ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c1f2cd0 con 0x7f211c15d1e0 2023-08-10T10:34:56.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:56.431 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48802/0 (socket says 172.21.15.88:48802) 2023-08-10T10:34:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 -- 172.21.15.88:0/2182470573 learned_addr learned my addr 172.21.15.88:0/2182470573 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f212099c700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c15d1e0 0x7f211c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211b7fe700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c0d27a0 0x7f211c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 -- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c15d1e0 msgr2=0x7f211c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.432 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c15d1e0 0x7f211c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 -- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c0d27a0 msgr2=0x7f211c1583e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c0d27a0 0x7f211c1583e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 -- 172.21.15.88:0/2182470573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2114009b30 con 0x7f211c0b5060 2023-08-10T10:34:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.427+0000 7f211bfff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c580 tx=0x7f210c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:56.433 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.428+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c004c80 con 0x7f211c0b5060 2023-08-10T10:34:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.428+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f210c004de0 con 0x7f211c0b5060 2023-08-10T10:34:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.428+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c159030 con 0x7f211c0b5060 2023-08-10T10:34:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.428+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c007330 con 0x7f211c0b5060 2023-08-10T10:34:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.428+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c1f60a0 con 0x7f211c0b5060 2023-08-10T10:34:56.434 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.429+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c1f39d0 con 0x7f211c0b5060 2023-08-10T10:34:56.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.430+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f210c007490 con 0x7f211c0b5060 2023-08-10T10:34:56.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.431+0000 7f2118ff9700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 0x7f210806d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:56.435 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.431+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f210c0893c0 con 0x7f211c0b5060 2023-08-10T10:34:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.431+0000 7f211b7fe700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 0x7f210806d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.432+0000 7f211b7fe700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 0x7f210806d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2110000f60 tx=0x7f2110009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:56.436 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.436+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f210c054200 con 0x7f211c0b5060 2023-08-10T10:34:56.632 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:56.631+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f211c0743a0 con 0x7f211c0b5060 2023-08-10T10:34:57.098 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:57.103 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:34:57.354 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.353+0000 7f2118ff9700 1 -- 172.21.15.88:0/2182470573 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7f210c057820 con 0x7f211c0b5060 2023-08-10T10:34:57.356 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.356+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 msgr2=0x7f210806d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:57.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.356+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 0x7f210806d1a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2110000f60 tx=0x7f2110009040 comp rx=0 tx=0).stop 2023-08-10T10:34:57.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.356+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 msgr2=0x7f211c1f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:57.357 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.356+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f210c00c580 tx=0x7f210c00c940 comp rx=0 tx=0).stop 2023-08-10T10:34:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 shutdown_connections 2023-08-10T10:34:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f210806ace0 0x7f210806d1a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.358 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c15d1e0 0x7f211c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f211c0b5060 0x7f211c1f5b60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 --2- 172.21.15.88:0/2182470573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c0d27a0 0x7f211c1583e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 >> 172.21.15.88:0/2182470573 conn(0x7f211c0cf950 msgr2=0x7f211c0d3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 shutdown_connections 2023-08-10T10:34:57.359 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.357+0000 7f21223ff700 1 -- 172.21.15.88:0/2182470573 wait complete. 2023-08-10T10:34:57.360 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data' removed 2023-08-10T10:34:57.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-10T10:34:57.577 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.577+0000 7f7d777ff700 1 Processor -- start 2023-08-10T10:34:57.578 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.577+0000 7f7d777ff700 1 -- start start 2023-08-10T10:34:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d700ccf90 0x7f7d7006a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 0x7f7d7006a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.579 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 0x7f7d700cae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d7015b600 con 0x7f7d700ccf90 2023-08-10T10:34:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d700cb3a0 con 0x7f7d700ca9d0 2023-08-10T10:34:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.578+0000 7f7d777ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d7006ad80 con 0x7f7d700cd370 2023-08-10T10:34:57.580 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d700ccf90 0x7f7d7006a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7d700ccf90 0x7f7d7006a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48810/0 (socket says 172.21.15.88:48810) 2023-08-10T10:34:57.581 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 -- 172.21.15.88:0/38021135 learned_addr learned my addr 172.21.15.88:0/38021135 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:57.582 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d75d9c700 1 --2- 172.21.15.88:0/38021135 >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 0x7f7d700cae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 -- 172.21.15.88:0/38021135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 msgr2=0x7f7d7006a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d74d9a700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 0x7f7d7006a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 0x7f7d7006a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 -- 172.21.15.88:0/38021135 >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 msgr2=0x7f7d700cae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-10T10:34:57.583 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 --2- 172.21.15.88:0/38021135 >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 0x7f7d700cae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 -- 172.21.15.88:0/38021135 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d7006b060 con 0x7f7d700ccf90 2023-08-10T10:34:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d75d9c700 1 --2- 172.21.15.88:0/38021135 >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 0x7f7d700cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:34:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d74d9a700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 0x7f7d7006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-10T10:34:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.579+0000 7f7d7559b700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700ccf90 0x7f7d7006a170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d70158db0 tx=0x7f7d6c009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf75d1d1c27081ff server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:57.584 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d67fff700 1 -- 172.21.15.88:0/38021135 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00b870 con 0x7f7d700ccf90 2023-08-10T10:34:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d67fff700 1 -- 172.21.15.88:0/38021135 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7d6c00b9d0 con 0x7f7d700ccf90 2023-08-10T10:34:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d67fff700 1 -- 172.21.15.88:0/38021135 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c00bd80 con 0x7f7d700ccf90 2023-08-10T10:34:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 -- 172.21.15.88:0/38021135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700ccf90 msgr2=0x7f7d7006a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:57.585 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700ccf90 0x7f7d7006a170 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7d70158db0 tx=0x7f7d6c009bd0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 -- 172.21.15.88:0/38021135 shutdown_connections 2023-08-10T10:34:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 --2- 172.21.15.88:0/38021135 >> v2:172.21.15.187:3300/0 conn(0x7f7d700ca9d0 0x7f7d700cae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700ccf90 0x7f7d7006a170 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 --2- 172.21.15.88:0/38021135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700cd370 0x7f7d7006a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.586 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 -- 172.21.15.88:0/38021135 >> 172.21.15.88:0/38021135 conn(0x7f7d700cb570 msgr2=0x7f7d700cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:57.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 -- 172.21.15.88:0/38021135 shutdown_connections 2023-08-10T10:34:57.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.580+0000 7f7d777ff700 1 -- 172.21.15.88:0/38021135 wait complete. 2023-08-10T10:34:57.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.582+0000 7f7d777ff700 1 Processor -- start 2023-08-10T10:34:57.587 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.582+0000 7f7d777ff700 1 -- start start 2023-08-10T10:34:57.589 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700ca9d0 0x7f7d70150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 0x7f7d701efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b36a0 con 0x7f7d700cd370 2023-08-10T10:34:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b3980 con 0x7f7d700ccf90 2023-08-10T10:34:57.590 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d777ff700 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d700b3c60 con 0x7f7d700ca9d0 2023-08-10T10:34:57.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d75d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d75d9c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:48812/0 (socket says 172.21.15.88:48812) 2023-08-10T10:34:57.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.583+0000 7f7d75d9c700 1 -- 172.21.15.88:0/1848171059 learned_addr learned my addr 172.21.15.88:0/1848171059 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-08-10T10:34:57.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d7559b700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700ca9d0 0x7f7d70150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.591 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d74d9a700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 0x7f7d701efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 -- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700ca9d0 msgr2=0x7f7d70150940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:57.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700ca9d0 0x7f7d70150940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 -- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 msgr2=0x7f7d701efdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:57.592 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 0x7f7d701efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 -- 172.21.15.88:0/1848171059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c009550 con 0x7f7d700cd370 2023-08-10T10:34:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d74d9a700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 0x7f7d701efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-10T10:34:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d75d9c700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800cef0 tx=0x7f7d6800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d6800adb0 con 0x7f7d700cd370 2023-08-10T10:34:57.593 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7d68015440 con 0x7f7d700cd370 2023-08-10T10:34:57.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d700b3f40 con 0x7f7d700cd370 2023-08-10T10:34:57.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.584+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d68015810 con 0x7f7d700cd370 2023-08-10T10:34:57.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.585+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d701f0330 con 0x7f7d700cd370 2023-08-10T10:34:57.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.586+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d700b4160 con 0x7f7d700cd370 2023-08-10T10:34:57.594 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.587+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 89037+0+0 (secure 0 0 0) 0x7f7d6800d430 con 0x7f7d700cd370 2023-08-10T10:34:57.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.587+0000 7f7d65ffb700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 0x7f7d5406d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-10T10:34:57.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.587+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f7d68089a20 con 0x7f7d700cd370 2023-08-10T10:34:57.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.588+0000 7f7d7559b700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 0x7f7d5406d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-10T10:34:57.595 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.588+0000 7f7d7559b700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 0x7f7d5406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c000c00 tx=0x7f7d6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-10T10:34:57.596 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.592+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176914 (secure 0 0 0) 0x7f7d68054ae0 con 0x7f7d700cd370 2023-08-10T10:34:57.794 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:57.793+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d700743a0 con 0x7f7d700cd370 2023-08-10T10:34:58.360 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.360+0000 7f7d65ffb700 1 -- 172.21.15.88:0/1848171059 <== mon.0 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f7d6801a0d0 con 0x7f7d700cd370 2023-08-10T10:34:58.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 msgr2=0x7f7d5406d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:58.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 0x7f7d5406d1a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c000c00 tx=0x7f7d6c008030 comp rx=0 tx=0).stop 2023-08-10T10:34:58.364 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 msgr2=0x7f7d701f3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-10T10:34:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800cef0 tx=0x7f7d6800cf20 comp rx=0 tx=0).stop 2023-08-10T10:34:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 shutdown_connections 2023-08-10T10:34:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7d700cd370 0x7f7d701f3bc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:58.365 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.88:6832/1444548676,v1:172.21.15.88:6833/1444548676] conn(0x7f7d5406ace0 0x7f7d5406d1a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:58.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d700ca9d0 0x7f7d70150940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:58.366 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 --2- 172.21.15.88:0/1848171059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d700ccf90 0x7f7d701efdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-10T10:34:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.363+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 >> 172.21.15.88:0/1848171059 conn(0x7f7d700cb570 msgr2=0x7f7d700c7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-10T10:34:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.364+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 shutdown_connections 2023-08-10T10:34:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:2023-08-10T10:34:58.364+0000 7f7d777ff700 1 -- 172.21.15.88:0/1848171059 wait complete. 2023-08-10T10:34:58.367 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'cephfs_data_ec' removed 2023-08-10T10:34:58.389 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-10T10:34:58.390 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-10T10:34:58.390 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.408 INFO:tasks.ceph.mds.a:Stopped 2023-08-10T10:34:58.408 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-10T10:34:58.409 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.463 INFO:tasks.ceph.mds.c:Stopped 2023-08-10T10:34:58.464 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-10T10:34:58.464 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.479 INFO:tasks.ceph.mds.b:Stopped 2023-08-10T10:34:58.479 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-10T10:34:58.480 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.534 INFO:tasks.ceph.mds.d:Stopped 2023-08-10T10:34:58.534 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-10T10:34:58.535 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-10T10:34:58.535 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.581 INFO:tasks.ceph.osd.0:Stopped 2023-08-10T10:34:58.581 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-10T10:34:58.582 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.634 INFO:tasks.ceph.osd.1:Stopped 2023-08-10T10:34:58.635 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-10T10:34:58.635 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.682 INFO:tasks.ceph.osd.2:Stopped 2023-08-10T10:34:58.683 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-10T10:34:58.683 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.743 INFO:tasks.ceph.osd.3:Stopped 2023-08-10T10:34:58.743 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-10T10:34:58.744 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.795 INFO:tasks.ceph.osd.4:Stopped 2023-08-10T10:34:58.795 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-10T10:34:58.796 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.849 INFO:tasks.ceph.osd.5:Stopped 2023-08-10T10:34:58.850 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-10T10:34:58.850 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.905 INFO:tasks.ceph.osd.6:Stopped 2023-08-10T10:34:58.906 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-10T10:34:58.906 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:58.952 INFO:tasks.ceph.osd.7:Stopped 2023-08-10T10:34:58.952 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-10T10:34:58.953 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-10T10:34:58.953 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:59.015 INFO:tasks.ceph.mgr.y:Stopped 2023-08-10T10:34:59.015 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-10T10:34:59.016 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:59.073 INFO:tasks.ceph.mgr.x:Stopped 2023-08-10T10:34:59.074 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-10T10:34:59.074 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-10T10:34:59.075 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:59.093 INFO:tasks.ceph.mon.a:Stopped 2023-08-10T10:34:59.094 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-10T10:34:59.094 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:59.111 INFO:tasks.ceph.mon.b:Stopped 2023-08-10T10:34:59.112 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-10T10:34:59.112 INFO:teuthology.orchestra.run:waiting for 300 2023-08-10T10:34:59.169 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-08-10T10:34:59.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-08-10T10:34:59.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-08-10T10:34:59.170 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-08-10T10:34:59.170 INFO:tasks.ceph.mon.c:Stopped 2023-08-10T10:34:59.171 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-10T10:34:59.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-10T10:34:59.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:34:59.252 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-10T10:34:59.665 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:34:59.666 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-10T10:34:59.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:34:59.872 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-10T10:35:00.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:35:00.087 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-10T10:35:00.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:35:00.268 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-10T10:35:00.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:35:00.505 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-10T10:35:00.728 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:35:00.729 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-10T10:35:00.932 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:35:00.933 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-10T10:35:01.124 INFO:tasks.ceph:Archiving mon data... 2023-08-10T10:35:01.125 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/data/mon.a.tgz 2023-08-10T10:35:01.126 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-08-10T10:35:01.177 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.IjtZpHPao5 2023-08-10T10:35:01.177 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.IjtZpHPao5 2023-08-10T10:35:01.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.IjtZpHPao5 2023-08-10T10:35:01.445 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.IjtZpHPao5 is 318KB 2023-08-10T10:35:01.543 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.IjtZpHPao5 2023-08-10T10:35:01.589 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/data/mon.b.tgz 2023-08-10T10:35:01.590 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-08-10T10:35:01.639 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.FpJSiVmhTV 2023-08-10T10:35:01.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.FpJSiVmhTV 2023-08-10T10:35:01.808 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.FpJSiVmhTV 2023-08-10T10:35:01.925 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.FpJSiVmhTV is 426KB 2023-08-10T10:35:02.026 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.FpJSiVmhTV 2023-08-10T10:35:02.071 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/data/mon.c.tgz 2023-08-10T10:35:02.072 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-08-10T10:35:02.157 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.zgEDmnbBu4 2023-08-10T10:35:02.158 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.zgEDmnbBu4 2023-08-10T10:35:02.350 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.zgEDmnbBu4 2023-08-10T10:35:02.468 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.zgEDmnbBu4 is 425KB 2023-08-10T10:35:02.567 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.zgEDmnbBu4 2023-08-10T10:35:02.613 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-10T10:35:02.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-10T10:35:02.618 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-10T10:35:02.721 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-10T10:35:02.722 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-10T10:35:02.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-10T10:35:02.802 INFO:teuthology.orchestra.run.smithi088.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-10T10:35:02.808 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-10T10:35:02.823 INFO:tasks.ceph:Archiving crash dumps... 2023-08-10T10:35:02.825 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi088/crash 2023-08-10T10:35:02.826 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-10T10:35:02.894 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi187/crash 2023-08-10T10:35:02.895 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-10T10:35:02.964 INFO:tasks.ceph:Shutting down logrotate 2023-08-10T10:35:02.964 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:02.969 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:03.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:03.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-10T10:35:03.202 INFO:tasks.ceph:Compressing logs... 2023-08-10T10:35:03.203 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T10:35:03.207 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-10T10:35:03.271 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120427.log 2023-08-10T10:35:03.272 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131528.log 2023-08-10T10:35:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120427.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120427.log.gz 2023-08-10T10:35:03.273 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124056.log 2023-08-10T10:35:03.274 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131106.log 2023-08-10T10:35:03.274 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.131528.log.gz 2023-08-10T10:35:03.275 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124056.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124056.log.gz 2023-08-10T10:35:03.276 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113947.log 2023-08-10T10:35:03.277 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122234.log 2023-08-10T10:35:03.277 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131106.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.131106.log.gz 2023-08-10T10:35:03.278 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114011.log 2023-08-10T10:35:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122234.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.122234.log.gz 2023-08-10T10:35:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120080.log 2023-08-10T10:35:03.288 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.114011.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.114011.log.gz 2023-08-10T10:35:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119932.log 2023-08-10T10:35:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120080.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120080.log.gz 2023-08-10T10:35:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129523.log 2023-08-10T10:35:03.289 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119932.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.119932.log.gz 2023-08-10T10:35:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128305.log 2023-08-10T10:35:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129523.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.129523.log.gz 2023-08-10T10:35:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129621.log 2023-08-10T10:35:03.290 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128305.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.128305.log.gz 2023-08-10T10:35:03.291 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125100.log 2023-08-10T10:35:03.291 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129621.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129621.log.gz 2023-08-10T10:35:03.292 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122944.log 2023-08-10T10:35:03.292 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125100.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.125100.log.gz 2023-08-10T10:35:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126913.log 2023-08-10T10:35:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122944.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.122944.log.gz 2023-08-10T10:35:03.293 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123958.log 2023-08-10T10:35:03.294 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.126913.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126913.log.gz 2023-08-10T10:35:03.294 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119647.log 2023-08-10T10:35:03.295 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123958.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.123958.log.gz 2023-08-10T10:35:03.295 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129474.log 2023-08-10T10:35:03.300 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.121144.log 2023-08-10T10:35:03.300 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113947.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-10T10:35:03.300 INFO:teuthology.orchestra.run.smithi187.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113947.log.gz 2023-08-10T10:35:03.300 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.3.121144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.121144.log.gz 2023-08-10T10:35:03.301 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113899.log 2023-08-10T10:35:03.301 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113997.log 2023-08-10T10:35:03.301 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113899.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.113899.log.gz 2023-08-10T10:35:03.301 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-10T10:35:03.302 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113997.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113997.log.gz 2023-08-10T10:35:03.302 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.120465.log 2023-08-10T10:35:03.302 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113801.log 2023-08-10T10:35:03.302 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.120465.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-10T10:35:03.302 INFO:teuthology.orchestra.run.smithi187.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.120465.log.gz 2023-08-10T10:35:03.303 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113700.log 2023-08-10T10:35:03.303 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113801.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113801.log.gz 2023-08-10T10:35:03.303 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113850.log 2023-08-10T10:35:03.303 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113700.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113700.log.gz 2023-08-10T10:35:03.303 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-10T10:35:03.304 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113850.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.113850.log.gz 2023-08-10T10:35:03.304 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-10T10:35:03.304 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-10T10:35:03.304 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-10T10:35:03.304 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-10T10:35:03.305 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-10T10:35:03.305 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.b.log: 93.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-10T10:35:03.305 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-10T10:35:03.305 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.d.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-10T10:35:03.305 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-10T10:35:03.306 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-osd.4.log: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-10T10:35:03.306 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113750.log 2023-08-10T10:35:03.309 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-10T10:35:03.309 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.113750.log.gz 2023-08-10T10:35:03.309 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113651.log 2023-08-10T10:35:03.309 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.113651.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113651.log.gz 2023-08-10T10:35:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119647.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.119647.log.gz 2023-08-10T10:35:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119447.log 2023-08-10T10:35:03.311 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129474.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.129474.log.gz 2023-08-10T10:35:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124053.log 2023-08-10T10:35:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119447.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119447.log.gz 2023-08-10T10:35:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123271.log 2023-08-10T10:35:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124053.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124053.log.gz 2023-08-10T10:35:03.312 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130265.log 2023-08-10T10:35:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123271.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.123271.log.gz 2023-08-10T10:35:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125051.log 2023-08-10T10:35:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.130265.log.gz 2023-08-10T10:35:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124414.log 2023-08-10T10:35:03.313 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125051.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.125051.log.gz 2023-08-10T10:35:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113899.log 2023-08-10T10:35:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124414.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124414.log.gz 2023-08-10T10:35:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-10T10:35:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.113899.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.113899.log.gz 2023-08-10T10:35:03.314 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.125891.log 2023-08-10T10:35:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122993.log 2023-08-10T10:35:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.0.125891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.125891.log.gz 2023-08-10T10:35:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128501.log 2023-08-10T10:35:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122993.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.122993.log.gz 2023-08-10T10:35:03.315 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-10T10:35:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128501.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.128501.log.gz 2023-08-10T10:35:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122065.log 2023-08-10T10:35:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124054.log 2023-08-10T10:35:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122065.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122065.log.gz 2023-08-10T10:35:03.316 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123042.log 2023-08-10T10:35:03.317 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124054.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124054.log.gz 2023-08-10T10:35:03.317 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129376.log 2023-08-10T10:35:03.317 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123042.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.123042.log.gz 2023-08-10T10:35:03.317 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130118.log 2023-08-10T10:35:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129376.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.129376.log.gz 2023-08-10T10:35:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123662.log 2023-08-10T10:35:03.318 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130118.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130118.log.gz 2023-08-10T10:35:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124610.log 2023-08-10T10:35:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123662.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123662.log.gz 2023-08-10T10:35:03.319 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129670.log 2023-08-10T10:35:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124610.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.124610.log.gz 2023-08-10T10:35:03.322 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130216.log 2023-08-10T10:35:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130738.log 2023-08-10T10:35:03.323 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129670.log.gz 2023-08-10T10:35:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130216.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.130216.log.gz 2023-08-10T10:35:03.323 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129327.log 2023-08-10T10:35:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123660.log 2023-08-10T10:35:03.324 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130738.log.gz 2023-08-10T10:35:03.324 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129327.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.129327.log.gz 2023-08-10T10:35:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120329.log 2023-08-10T10:35:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123660.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123660.log.gz 2023-08-10T10:35:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130836.log 2023-08-10T10:35:03.325 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120329.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120329.log.gz 2023-08-10T10:35:03.326 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130069.log 2023-08-10T10:35:03.326 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120178.log 2023-08-10T10:35:03.326 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.130836.log.gz 2023-08-10T10:35:03.326 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130069.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.130069.log.gz 2023-08-10T10:35:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129180.log 2023-08-10T10:35:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120178.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120178.log.gz 2023-08-10T10:35:03.327 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123648.log 2023-08-10T10:35:03.331 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129180.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.129180.log.gz 2023-08-10T10:35:03.331 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-10T10:35:03.331 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123648.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.123648.log.gz 2023-08-10T10:35:03.332 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128740.log 2023-08-10T10:35:03.332 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129131.log 2023-08-10T10:35:03.333 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128740.log: 88.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-10T10:35:03.333 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128740.log.gz 2023-08-10T10:35:03.334 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124806.log 2023-08-10T10:35:03.334 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129131.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.129131.log.gz 2023-08-10T10:35:03.334 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125002.log 2023-08-10T10:35:03.335 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124806.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124806.log.gz 2023-08-10T10:35:03.335 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128354.log 2023-08-10T10:35:03.336 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124904.log 2023-08-10T10:35:03.336 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.125002.log.gz 2023-08-10T10:35:03.338 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128354.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.128354.log.gz 2023-08-10T10:35:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124561.log 2023-08-10T10:35:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124904.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.124904.log.gz 2023-08-10T10:35:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128599.log 2023-08-10T10:35:03.339 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124561.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.124561.log.gz 2023-08-10T10:35:03.340 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113556.log 2023-08-10T10:35:03.340 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128599.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128599.log.gz 2023-08-10T10:35:03.340 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128985.log 2023-08-10T10:35:03.340 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.113556.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.113556.log.gz 2023-08-10T10:35:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128887.log 2023-08-10T10:35:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128985.log: 88.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.128985.log.gz--verbose 2023-08-10T10:35:03.341 INFO:teuthology.orchestra.run.smithi088.stderr:-- /var/log/ceph/ceph-client.admin.122527.log 2023-08-10T10:35:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128887.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.128887.log.gz 2023-08-10T10:35:03.342 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125198.log 2023-08-10T10:35:03.343 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122527.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122527.log.gz 2023-08-10T10:35:03.343 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-10T10:35:03.343 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129278.log 2023-08-10T10:35:03.344 INFO:teuthology.orchestra.run.smithi088.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.125198.log.gz 2023-08-10T10:35:03.344 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124855.log 2023-08-10T10:35:03.344 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129278.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129278.log.gz 2023-08-10T10:35:03.345 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124038.log 2023-08-10T10:35:03.345 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124855.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124855.log.gz 2023-08-10T10:35:03.345 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129719.log 2023-08-10T10:35:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124038.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124038.log.gz 2023-08-10T10:35:03.346 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-10T10:35:03.347 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129719.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129719.log.gz 2023-08-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120674.log 2023-08-10T10:35:03.348 INFO:teuthology.orchestra.run.smithi088.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-10T10:35:03.349 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130885.log 2023-08-10T10:35:03.350 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120674.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.120674.log.gz 2023-08-10T10:35:03.351 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123272.log 2023-08-10T10:35:03.352 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123653.log 2023-08-10T10:35:03.352 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130885.log.gz 2023-08-10T10:35:03.353 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123272.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.123272.log.gz 2023-08-10T10:35:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119554.log 2023-08-10T10:35:03.354 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123653.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123653.log.gz 2023-08-10T10:35:03.355 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123663.log 2023-08-10T10:35:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119554.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.119554.log.gz 2023-08-10T10:35:03.356 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122724.log 2023-08-10T10:35:03.358 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123663.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123663.log.gz 2023-08-10T10:35:03.358 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119982.log 2023-08-10T10:35:03.359 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122724.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122724.log.gz 2023-08-10T10:35:03.360 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131332.log 2023-08-10T10:35:03.361 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119982.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119982.log.gz 2023-08-10T10:35:03.362 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129572.log 2023-08-10T10:35:03.363 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131332.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.131332.log.gz 2023-08-10T10:35:03.364 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.106012.log 2023-08-10T10:35:03.364 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129572.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.129572.log.gz 2023-08-10T10:35:03.365 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130518.log 2023-08-10T10:35:03.365 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.tmp-client.admin.106012.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.106012.log.gz 2023-08-10T10:35:03.366 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121918.log 2023-08-10T10:35:03.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130518.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130518.log.gz 2023-08-10T10:35:03.367 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125400.log 2023-08-10T10:35:03.368 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121918.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121918.log.gz 2023-08-10T10:35:03.369 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130314.log 2023-08-10T10:35:03.370 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131577.log 2023-08-10T10:35:03.370 INFO:teuthology.orchestra.run.smithi088.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.125400.log.gz 2023-08-10T10:35:03.371 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130314.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.130314.log.gz 2023-08-10T10:35:03.372 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123263.log 2023-08-10T10:35:03.372 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131577.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131577.log.gz 2023-08-10T10:35:03.373 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120278.log 2023-08-10T10:35:03.374 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123263.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.123263.log.gz 2023-08-10T10:35:03.374 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120723.log 2023-08-10T10:35:03.375 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120278.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120278.log.gz 2023-08-10T10:35:03.376 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121967.log 2023-08-10T10:35:03.377 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120723.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120723.log.gz 2023-08-10T10:35:03.377 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128789.log 2023-08-10T10:35:03.379 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121967.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.121967.log.gz 2023-08-10T10:35:03.379 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128403.log 2023-08-10T10:35:03.380 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128789.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.128789.log.gz 2023-08-10T10:35:03.381 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123257.log 2023-08-10T10:35:03.382 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128403.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.128403.log.gz 2023-08-10T10:35:03.383 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124057.log 2023-08-10T10:35:03.384 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122185.log 2023-08-10T10:35:03.384 INFO:teuthology.orchestra.run.smithi088.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123257.log.gz 2023-08-10T10:35:03.386 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124057.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.124057.log.gz 2023-08-10T10:35:03.386 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130934.log 2023-08-10T10:35:03.387 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122185.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.122185.log.gz 2023-08-10T10:35:03.388 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126146.log 2023-08-10T10:35:03.389 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130934.log: 88.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.130934.log.gz--verbose 2023-08-10T10:35:03.389 INFO:teuthology.orchestra.run.smithi088.stderr:-- /var/log/ceph/ceph-client.admin.122797.log 2023-08-10T10:35:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.126146.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.126146.log.gz 2023-08-10T10:35:03.390 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124365.log 2023-08-10T10:35:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122797.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122797.log.gz 2023-08-10T10:35:03.392 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122283.log 2023-08-10T10:35:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124365.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.124365.log.gz 2023-08-10T10:35:03.393 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128936.log 2023-08-10T10:35:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122283.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.122283.log.gz 2023-08-10T10:35:03.394 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131187.log 2023-08-10T10:35:03.395 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124953.log 2023-08-10T10:35:03.396 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128936.log.gz 2023-08-10T10:35:03.397 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131187.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131187.log.gz 2023-08-10T10:35:03.397 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122332.log 2023-08-10T10:35:03.398 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124953.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.124953.log.gz 2023-08-10T10:35:03.399 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121869.log 2023-08-10T10:35:03.400 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131283.log 2023-08-10T10:35:03.401 INFO:teuthology.orchestra.run.smithi088.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.122332.log.gz 2023-08-10T10:35:03.401 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121869.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.121869.log.gz 2023-08-10T10:35:03.401 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123665.log 2023-08-10T10:35:03.402 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130689.log 2023-08-10T10:35:03.403 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.131283.log.gz 2023-08-10T10:35:03.403 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123665.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123665.log.gz 2023-08-10T10:35:03.404 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122381.log 2023-08-10T10:35:03.405 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120478.log 2023-08-10T10:35:03.405 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.130689.log.gz 2023-08-10T10:35:03.406 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122381.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.122381.log.gz 2023-08-10T10:35:03.406 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124267.log 2023-08-10T10:35:03.407 INFO:teuthology.orchestra.run.smithi187.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-10T10:35:03.407 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123664.log 2023-08-10T10:35:03.408 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.120478.log.gz 2023-08-10T10:35:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124267.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124267.log.gz 2023-08-10T10:35:03.409 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119883.log 2023-08-10T10:35:03.410 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120576.log 2023-08-10T10:35:03.410 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.123664.log.gz 2023-08-10T10:35:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119883.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.119883.log.gz 2023-08-10T10:35:03.411 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131626.log 2023-08-10T10:35:03.413 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124316.log 2023-08-10T10:35:03.413 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.120576.log.gz 2023-08-10T10:35:03.414 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131626.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.131626.log.gz 2023-08-10T10:35:03.414 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131381.log 2023-08-10T10:35:03.415 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124316.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124316.log.gz 2023-08-10T10:35:03.416 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129971.log 2023-08-10T10:35:03.417 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131381.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.131381.log.gz 2023-08-10T10:35:03.417 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120821.log 2023-08-10T10:35:03.418 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129971.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.129971.log.gz 2023-08-10T10:35:03.419 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-10T10:35:03.420 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120821.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-10T10:35:03.421 INFO:teuthology.orchestra.run.smithi088.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.120821.log.gz 2023-08-10T10:35:03.422 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122136.log 2023-08-10T10:35:03.422 INFO:teuthology.orchestra.run.smithi088.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-08-10T10:35:03.423 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131033.log 2023-08-10T10:35:03.424 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122136.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.122136.log.gz 2023-08-10T10:35:03.425 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123273.log 2023-08-10T10:35:03.426 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122846.log 2023-08-10T10:35:03.426 INFO:teuthology.orchestra.run.smithi088.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.131033.log.gz 2023-08-10T10:35:03.427 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123273.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.123273.log.gz 2023-08-10T10:35:03.428 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130020.log 2023-08-10T10:35:03.429 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122846.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122846.log.gz 2023-08-10T10:35:03.429 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124512.log 2023-08-10T10:35:03.430 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130020.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130020.log.gz 2023-08-10T10:35:03.431 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124047.log 2023-08-10T10:35:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124512.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124512.log.gz 2023-08-10T10:35:03.432 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120031.log 2023-08-10T10:35:03.433 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124047.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124047.log.gz 2023-08-10T10:35:03.434 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130983.log 2023-08-10T10:35:03.435 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120031.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120031.log.gz 2023-08-10T10:35:03.435 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124659.log 2023-08-10T10:35:03.437 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120378.log 2023-08-10T10:35:03.437 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.130983.log.gz 2023-08-10T10:35:03.438 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124659.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124659.log.gz 2023-08-10T10:35:03.439 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131236.log 2023-08-10T10:35:03.440 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120378.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-10T10:35:03.440 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120378.log.gz 2023-08-10T10:35:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131236.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.131236.log.gz 2023-08-10T10:35:03.441 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131430.log 2023-08-10T10:35:03.442 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121771.log 2023-08-10T10:35:03.443 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131430.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.131430.log.gz 2023-08-10T10:35:03.444 INFO:teuthology.orchestra.run.smithi088.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-08-10T10:35:03.444 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123270.log 2023-08-10T10:35:03.445 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130167.log 2023-08-10T10:35:03.446 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.121771.log.gz 2023-08-10T10:35:03.446 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123270.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123270.log.gz 2023-08-10T10:35:03.447 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130581.log 2023-08-10T10:35:03.448 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124055.log 2023-08-10T10:35:03.449 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.130167.log.gz 2023-08-10T10:35:03.449 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130581.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130581.log.gz 2023-08-10T10:35:03.450 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121820.log 2023-08-10T10:35:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124055.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.124055.log.gz 2023-08-10T10:35:03.451 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122576.log 2023-08-10T10:35:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131699.log 2023-08-10T10:35:03.453 INFO:teuthology.orchestra.run.smithi088.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121820.log.gz 2023-08-10T10:35:03.453 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122576.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122576.log.gz 2023-08-10T10:35:03.454 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122626.log 2023-08-10T10:35:03.455 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131699.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-10T10:35:03.456 INFO:teuthology.orchestra.run.smithi088.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131699.log.gz 2023-08-10T10:35:03.456 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122626.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122626.log.gz 2023-08-10T10:35:03.457 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123650.log 2023-08-10T10:35:03.458 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123259.log 2023-08-10T10:35:03.459 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123650.log: 85.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-10T10:35:03.459 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.123650.log.gz 2023-08-10T10:35:03.460 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129229.log 2023-08-10T10:35:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123259.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.123259.log.gz 2023-08-10T10:35:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129425.log 2023-08-10T10:35:03.462 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129229.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.129229.log.gz 2023-08-10T10:35:03.463 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120129.log 2023-08-10T10:35:03.464 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130363.log 2023-08-10T10:35:03.464 INFO:teuthology.orchestra.run.smithi088.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129425.log.gz 2023-08-10T10:35:03.465 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120129.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.120129.log.gz 2023-08-10T10:35:03.466 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131479.log 2023-08-10T10:35:03.466 INFO:teuthology.orchestra.run.smithi187.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-10T10:35:03.467 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128550.log 2023-08-10T10:35:03.467 INFO:teuthology.orchestra.run.smithi088.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.130363.log.gz 2023-08-10T10:35:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.131479.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.131479.log.gz 2023-08-10T10:35:03.468 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125149.log 2023-08-10T10:35:03.470 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128550.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.128550.log.gz 2023-08-10T10:35:03.471 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.126619.log 2023-08-10T10:35:03.471 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.125149.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.125149.log.gz 2023-08-10T10:35:03.472 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124463.log 2023-08-10T10:35:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.2.126619.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.2.126619.log.gz--verbose 2023-08-10T10:35:03.473 INFO:teuthology.orchestra.run.smithi088.stderr:-- /var/log/ceph/ceph-client.admin.126864.log 2023-08-10T10:35:03.474 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124463.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.124463.log.gz 2023-08-10T10:35:03.474 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124757.log 2023-08-10T10:35:03.476 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.126864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120772.log 2023-08-10T10:35:03.477 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.126864.log.gz 2023-08-10T10:35:03.477 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124757.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.124757.log.gz 2023-08-10T10:35:03.477 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124708.log 2023-08-10T10:35:03.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128452.log 2023-08-10T10:35:03.478 INFO:teuthology.orchestra.run.smithi088.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.120772.log.gz 2023-08-10T10:35:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.124708.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.124708.log.gz 2023-08-10T10:35:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130787.log 2023-08-10T10:35:03.481 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128452.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.128452.log.gz 2023-08-10T10:35:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129768.log 2023-08-10T10:35:03.482 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121529.log 2023-08-10T10:35:03.483 INFO:teuthology.orchestra.run.smithi088.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.130787.log.gz 2023-08-10T10:35:03.483 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129768.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.129768.log.gz 2023-08-10T10:35:03.484 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122016.log 2023-08-10T10:35:03.485 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.121529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120625.log 2023-08-10T10:35:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122016.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.122016.log.gz 2023-08-10T10:35:03.487 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129034.log 2023-08-10T10:35:03.488 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120625.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.121529.log.gz 2023-08-10T10:35:03.488 INFO:teuthology.orchestra.run.smithi088.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.120625.log.gz 2023-08-10T10:35:03.489 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120527.log 2023-08-10T10:35:03.489 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.129034.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.129034.log.gz 2023-08-10T10:35:03.490 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130640.log 2023-08-10T10:35:03.491 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122430.log 2023-08-10T10:35:03.492 INFO:teuthology.orchestra.run.smithi088.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120527.log.gz 2023-08-10T10:35:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130640.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.130640.log.gz 2023-08-10T10:35:03.493 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120894.log 2023-08-10T10:35:03.494 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122430.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.122430.log.gz 2023-08-10T10:35:03.495 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119696.log 2023-08-10T10:35:03.496 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122895.log 2023-08-10T10:35:03.496 INFO:teuthology.orchestra.run.smithi088.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120894.log.gz 2023-08-10T10:35:03.497 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119696.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119696.log.gz 2023-08-10T10:35:03.498 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120227.log 2023-08-10T10:35:03.499 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122895.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-10T10:35:03.499 INFO:teuthology.orchestra.run.smithi088.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122895.log.gz 2023-08-10T10:35:03.500 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.120227.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.120227.log.gz 2023-08-10T10:35:03.501 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119795.log 2023-08-10T10:35:03.502 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123264.log 2023-08-10T10:35:03.503 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.119795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130412.log 2023-08-10T10:35:03.504 INFO:teuthology.orchestra.run.smithi088.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.119795.log.gz 2023-08-10T10:35:03.504 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.123264.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123264.log.gz 2023-08-10T10:35:03.505 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130469.log 2023-08-10T10:35:03.506 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122675.log 2023-08-10T10:35:03.506 INFO:teuthology.orchestra.run.smithi088.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.130412.log.gz 2023-08-10T10:35:03.507 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.130469.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.130469.log.gz 2023-08-10T10:35:03.508 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128838.log 2023-08-10T10:35:03.509 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.122675.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.122675.log.gz 2023-08-10T10:35:03.510 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/ceph-client.admin.128838.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.128838.log.gz 2023-08-10T10:35:03.688 INFO:teuthology.orchestra.run.smithi088.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-10T10:35:03.924 INFO:teuthology.orchestra.run.smithi187.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-10T10:35:04.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-08-10T10:35:04.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-08-10T10:35:04.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-08-10T10:35:04.172 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-08-10T10:35:05.460 INFO:teuthology.orchestra.run.smithi187.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-10T10:35:05.656 INFO:teuthology.orchestra.run.smithi088.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-10T10:35:05.692 INFO:teuthology.orchestra.run.smithi088.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-10T10:35:05.839 INFO:teuthology.orchestra.run.smithi088.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-10T10:35:05.896 INFO:teuthology.orchestra.run.smithi187.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-10T10:35:06.040 INFO:teuthology.orchestra.run.smithi187.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-10T10:35:06.170 INFO:teuthology.orchestra.run.smithi088.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-10T10:35:06.174 INFO:teuthology.orchestra.run.smithi088.stderr: 2023-08-10T10:35:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m2.927s 2023-08-10T10:35:06.175 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m9.467s 2023-08-10T10:35:06.176 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m1.255s 2023-08-10T10:35:06.330 INFO:teuthology.orchestra.run.smithi187.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-10T10:35:06.333 INFO:teuthology.orchestra.run.smithi187.stderr: 2023-08-10T10:35:06.333 INFO:teuthology.orchestra.run.smithi187.stderr:real 0m3.083s 2023-08-10T10:35:06.333 INFO:teuthology.orchestra.run.smithi187.stderr:user 0m10.575s 2023-08-10T10:35:06.334 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m1.013s 2023-08-10T10:35:06.335 INFO:tasks.ceph:Archiving logs... 2023-08-10T10:35:06.335 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi088/log 2023-08-10T10:35:06.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T10:35:07.775 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi187/log 2023-08-10T10:35:07.776 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-10T10:35:09.155 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-10T10:35:09.165 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-10T10:35:09.166 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T10:35:09.171 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-10T10:35:09.299 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-10T10:35:09.307 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-10T10:35:09.308 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:35:09.313 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-10T10:35:09.354 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-08-10T10:35:09.356 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-08-10T10:35:09.362 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:35:09.362 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-08-10T10:35:09.362 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 59 -427us[ -427us] +/- 83ms 2023-08-10T10:35:09.363 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 61 -320us[ -369us] +/- 48ms 2023-08-10T10:35:09.363 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv03.front.sepia.ceph.com 3 6 377 59 +807us[ +759us] +/- 78ms 2023-08-10T10:35:09.363 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:35:09.364 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-10T10:35:09.365 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-08-10T10:35:09.365 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 61 -500us[ -500us] +/- 83ms 2023-08-10T10:35:09.365 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 59 -384us[ -384us] +/- 48ms 2023-08-10T10:35:09.366 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv03.front.sepia.ceph.com 3 6 377 62 +733us[ +718us] +/- 78ms 2023-08-10T10:35:09.366 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-10T10:35:09.367 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-10T10:35:09.376 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-10T10:35:09.376 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-10T10:35:09.385 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T10:35:09.573 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-10T10:35:09.735 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:35:09.810 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:35:09.812 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-10T10:35:09.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:35:09.888 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-10T10:35:09.898 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-10T10:35:09.907 INFO:teuthology.task.internal:Duration was 1541.545648 seconds 2023-08-10T10:35:09.908 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-10T10:35:09.920 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-10T10:35:09.921 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T10:35:09.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-10T10:35:10.038 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:35:10.042 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-10T10:35:10.338 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-10T10:35:10.339 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-08-10T10:35:10.339 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T10:35:10.401 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-08-10T10:35:10.401 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-10T10:35:10.461 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-10T10:35:10.462 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T10:35:10.466 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-10T10:35:10.550 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-10T10:35:10.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T10:35:10.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-10T10:35:10.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-10T10:35:10.689 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-10T10:35:10.690 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T10:35:10.759 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-10T10:35:10.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-10T10:35:10.841 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:35:10.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:35:10.910 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-08-10T10:35:10.915 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-08-10T10:35:10.948 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:35:10.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:35:10.993 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-10T10:35:11.036 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-10T10:35:11.037 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-10T10:35:11.050 INFO:teuthology.task.internal:Transferring archived files... 2023-08-10T10:35:11.051 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi088 2023-08-10T10:35:11.051 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T10:35:11.132 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552/remote/smithi187 2023-08-10T10:35:11.133 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-10T10:35:11.220 INFO:teuthology.task.internal:Removing archive directory... 2023-08-10T10:35:11.221 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T10:35:11.226 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-10T10:35:11.272 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-10T10:35:11.284 INFO:teuthology.task.internal:Not uploading archives. 2023-08-10T10:35:11.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-10T10:35:11.294 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-10T10:35:11.295 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T10:35:11.311 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-10T10:35:11.353 INFO:teuthology.orchestra.run.smithi088.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 10:35 /home/ubuntu/cephtest 2023-08-10T10:35:11.357 INFO:teuthology.orchestra.run.smithi187.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 10 10:35 /home/ubuntu/cephtest 2023-08-10T10:35:11.361 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-10T10:35:11.371 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-10T10:35:11.394 INFO:teuthology.nuke:Checking targets against current locks 2023-08-10T10:35:11.419 DEBUG:teuthology.nuke:shortname: smithi088 2023-08-10T10:35:11.420 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:35:11.439 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:02.020187', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBH5wpnKCIikdp0BqxJqI/9xcGy/x9i/pb84v8jm6pptJQjZTRhXYHyv0PqPh22WebOF1YopHoYEz9Bh0rBS6NRc='} 2023-08-10T10:35:11.443 DEBUG:teuthology.nuke:shortname: smithi187 2023-08-10T10:35:11.443 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-10T10:35:11.462 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-08-10_09:50:44-fs-wip-rishabh-2023Aug1-3-testing-default-smithi/7364552', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-10 09:52:02.021526', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDg3yWpJ25I1+DYhU8GPbrnjwI2ohh4qrbh9pKYPWEsLIOqEcQO2XhiRIHsU1i7fIgnBGnToa6wL7m0woVaxa10A/B5el4Awi5tBKdk3kaFgQ5qt5dbbqfhe29MyVc119Uy4mrxx4Xc3zo1Cqyy1fSTUsIhI6es9ny/j63ErK5H+khOnsL8nTSB9fJusgz7eM+6mNzOpj772bw6Y8pyxhFyP8OQlerWf2unlfSPecI1u3HQVVvQA//tPNYbwIZwGIqDK62vn+CIgGm3OYged002Gqr4dUwJiUwXeqxVU1SNwx1Ad/r5MtbukP5IMSi/ywXR/hDnvC43xN55p9z6Ui0bV8HoakfM4HzJ/ZUbJeR7lm6/7GT/YxmnXtDYIEf+Lgt1QnqWLEZk5BfGpESTbCZDoefJ2qmfe7PsjK8z8NeZcKwwdPrp3m5oAyS273F3qdNxrGH8kmY1H6SIwS9xyxo3tVDMtCa9Fm26i7TlK4nZZ9j4YuNn4ZUqLyeSnkXZP7s='} 2023-08-10T10:35:11.492 INFO:teuthology.orchestra.console.smithi088:Power off 2023-08-10T10:35:11.494 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:35:11.517 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-08-10T10:35:11.518 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:11.539 INFO:teuthology.orchestra.console.smithi187:Power off 2023-08-10T10:35:11.540 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-10T10:35:11.550 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-08-10T10:35:11.562 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-08-10T10:35:11.562 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:11.588 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-10T10:35:15.552 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:15.590 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:15.664 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-08-10T10:35:15.702 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-10T10:35:19.666 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:19.703 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:19.779 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-08-10T10:35:19.814 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-08-10T10:35:23.784 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:23.815 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-10T10:35:23.895 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-08-10T10:35:23.927 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-08-10T10:35:23.997 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-08-10T10:35:24.028 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-08-10T10:35:24.134 INFO:teuthology.run:Summary data: client.0-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 client.1-kernel-sha1: a7fb1265323db972dd333f71b9a53e9479f62e37 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/workunit/quota} duration: 1541.5456478595734 failure_reason: 'Command failed (workunit test fs/quota/quota.sh) on smithi187 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && cd -- /home/ubuntu/cephtest/mnt.3/client.3/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8bf445f2d27d8e12e060dff0fd151d481b5290b TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="3" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.3 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.3 CEPH_MNT=/home/ubuntu/cephtest/mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.3/qa/workunits/fs/quota/quota.sh''' flavor: default owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e8b988dea60d4b799cb4d37f29bee8dd status: fail success: false 2023-08-10T10:35:24.135 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-10T10:35:24.213 INFO:teuthology.run:FAIL